Stewart Slocum (@stewpervised) profile picture

currently @openai, prev @xai, phd @MIT

Joined September 2019
Photo by Stewart Slocum (@stewpervised)Photo by Stewart Slocum (@stewpervised)Photo by Stewart Slocum (@stewpervised)Photo by Stewart Slocum (@stewpervised)
Stewart Slocum retweeted
In September, we released our first report on how internal deployments have accelerated AI research at OpenAI. Today we are releasing a second report as an update to this workstream, with new data on AI uplift across research domains and how humans are involved in the research process. Some topline results: 1. Agents are becoming more capable of performing difficult research tasks, but success rates vary greatly across the distribution of research work. Success rates vary from as low as 25% for writing code for inference stacks to as high as 79% for monitoring training runs. In part because of the jaggedness of uplift, humans remain a core part of the research process. 2. Despite this jaggedness, agent use continues to surge and provide large amounts of self-reported value for researchers, with growth particularly strong amongst the heaviest users. Daily agent usage in October, valued at API list prices, reached $2,400 for the median researcher and $23,000 for the 90th percentile of researchers. In survey results, the median researcher reported being willing to trade 30% of their team’s compute—or, in a separate question, 40% of its headcount—to retain three months of access to frontier agents. 3. Human effort has increased across all research domains since the start of the year, with the fastest growth in safety and alignment, where human effort grew by 77%. The sharpest increase was after the Hugging Face incident over the summer. We hope our findings and the data released as part of the study will help contribute to shared transparency norms and measurement standards around research velocity. As models become more powerful and capable of accelerating the research process, this will only become more important. This was an amazing effort combining work from multiple colleagues across different teams at OpenAI: @kliu128, @daveholtz, @michaelzhao_, @Kwathomas0, @drew_m_johnston, and @OliviaGWatkins2, with advising support from @tejalpatwardhan, @ronniechatterji, and @deanwball. More detailed findings below:
We're sharing new data on how AI is changing research at OpenAI. We find researchers' AI use continues to rise exponentially, and agents are completing longer tasks, but human involvement remains central in research. Researchers are also spending more time on safety and alignment, with human effort in these areas growing faster than in any other individual research area. This report aims to increase transparency around research acceleration and inform the governance of increasingly capable AI. We believe that AI labs should be required to track and publicly report indicators of recursive self-improvement (RSI): the process by which AI accelerates the development of future AI systems. Our hope is that this expanded report will help sustain and advance shared measurement norms across the industry. openai.com/index/research-ac…
2
5
21
685
Stewart Slocum retweeted
over his career so far, jensen has done a great service to his country and the world. a lot of things would not be here without him. i hope people remember this
the story of modern deep learning is entwined with jensen huang’s story the entire way through. it’s hard to defend the Megaspeed affair but overall obviously a world historic boon to American industry
12
20
393
21,098
Stewart Slocum retweeted
This letter was sent to Nvidia's board today. A first for @atreidesmgmt Absolutely share @altcap belief that this letter outlines minimum acceptable standards.
610
1,546
212
13,145
1,927,469
100%
Replying to @balajis
Again, if it’s true that there is no national security issue, Jensen Huang must be reinstated at once and the anti-Jensen board members must step down. Employees, shareholders, customers, and partners will demand it. @JensenHuang @nvidia
2
26
988
I am in awe
Mechazilla catches Starship! Congratulations to the entire SpaceX team on this incredible achievement!
5
505
Stewart Slocum retweeted
Fable 5.2 is the best model we have tested at predicting experiment results. Its score is 0.36, in line with a steady improvement since GPT-4 Turbo. Predicting results before running an experiment is a core part of research taste: a model that does it well can skip bad experiments and get more progress from the same compute.
8
18
6
348
18,762
Great technically informed work. I'm very happy to see this!
Today, we released the National Policy for Nucleic Acid Synthesis Screening to protect American biotechnology innovation while reducing the risk of misuse. This policy establishes a new, government-wide screening requirements for synthetic DNA and the equipment used to make it. It will ensure companies selling nucleic acid sequences and synthesis equipment know their customers and prevent the malicious use of these materials and tools. This policy strengthens our Nation’s biosecurity posture by establishing rigorous U.S. government-wide procurement screening and physical security standards for synthetic biology. It replaces outdated “self-attestation” systems with robust, independent verification. It creates a dynamic, SI-powered screening layer that assesses the biological risk from nucleic acid sequences, allowing the U.S. to anticipate and prevent malicious use and help stop dangerous gain-of-function research. @NIST will issue rigorous new screening standards and @HHSGov and @USDA will certify synthetic biology providers. Together, these measures will strengthen American biosecurity, safeguard responsible innovation, and establish a global standard for safe and transparent synthetic biology tools and research.
4
348
Cool work! If you have interesting computational biology problems, you should give Locus a try
Locus sets the frontier for automating molecular design Our automated research system Locus develops scientific AI models that outperform SOTA expert solutions Unlocking the potential of scientific AI requires leveraging proprietary data. Locus achieves this autonomously 🧵👇 -- We test Locus across a number of tasks related to molecular scoring and design: training molecular property prediction models for a proprietary task, fine-tuning Boltz-2 to predict small-molecule potency, and building antibody design workflows around BoltzGen, Boltz-2, ESMC, and ESMFold2. Each of these settings are real-world AI for science use cases, where tasks are often out-of-distribution for existing foundation models and limited in data, while featuring expensive and noisy evaluators. Compared to state-of-the-art baselines and LLM agents set to optimize these tasks, Locus achieves higher performance. Additionally, Locus generalizes better despite limited data, finds more sample efficient solutions, and explores a higher diversity of solutions.
3
10
678
Stewart Slocum retweeted
We are now allocating a significant amount of our frontier compute towards discovering and patching vulnerabilities in open source codebases, fully pro bono. In one case, we studied the Linux kernel, which is a particularly load-bearing piece of software at OpenAI. Before AI, security researchers might discover ~20 local privilege escalation (LPE) vulnerabilities in Linux in a typical year. In one week's time, our upcoming frontier cyber model was able to find ~1000 LPE vulnerabilities using about $1M of tokens. In the process, it was able to discover at least 10 novel classes of Linux exploitation techniques.
Our security researchers built an autonomous cyber vulnerability discovery, exploitation, and patching pipeline. In a single run with an upcoming cyber model, it validated and generated patches for 948 local privilege escalation vulnerabilities in the Linux kernel at a total API cost of $1.2 million.
105
128
48
1,393
208,147
Stewart Slocum retweeted
Late-decider voters are swinging Republican by 9 points, per NYT.
451
1,594
385
20,445
3,020,042
Yes
As AI becomes more capable at finding vulnerabilities, defenders need to put it to work before attackers do. We’re planning our next internal security sprint at OpenAI and partnering with Cathedral Systems, whose researchers will use our models alongside our teams to challenge our defenses. They’ll bring differentiated expertise and approaches to our ongoing work to find and fix weaknesses with AI. We’re also raising bug bounty rewards, including more than quadrupling rewards for critical findings. Exceptional findings will be eligible for up to $172,000, including bonuses. We’ll keep advancing our models, using them to strengthen our own systems, and expanding access for trusted defenders. openai.com/index/preparing-o…
10
756
Stewart Slocum retweeted
Le GPT Fat
1,585
295
513
10,651
3,291,147
🤷🤷😁
Updated Silver bulletin and @Polymarket odds… can President Trump pulls a rabbit out a hat for a third time?! See you on the @theallinpod and @Polymarket stream tomorrow night at 8pm ET, 7pm Austin time and 5pm on the left coast
2
284
Stewart Slocum retweeted
CNN: Republicans have beat the final polling average in states that Trump won in the prior election by 4.1 points. If the same pattern holds, the GOP will keep the Senate: 🔴-51 🔵-49
469
2,140
87
13,679
1,026,440
Large and powerful groups of people relish at the chance to manipulate the law against Elon purely because they dislike him. I've seen this firsthand many times. Using the law to blatantly punish an enemy is an abuse of power.
8
768
Stewart Slocum retweeted
The FBI is releasing information advising the Democratic People's Republic of Korea (North Korea) was responsible for the theft of more than $6 billion USD in virtual assets from cryptocurrency exchange, Binance, on or about October 29, 2026. The FBI refers to this specific North Korean malicious cyber activity as "TraderTraitor." The FBI, together with partners at the USSS and IRS-CI, has observed TraderTraitor actors converting stolen assets primarily into Ethereum (ETH). It is expected these assets will then be further laundered by converting them using DeFi and instant swap services as they prepare them for further laundering stages. How You Can Help: FBI, USSS, and IRS-CI are urging private sector entities including THORNode operators, RPC node operators, instant exchanges, DeFi services, blockchain analytics firms, and other virtual asset service providers to block transactions with or derived from addresses TraderTraitor actors are using to launder these stolen assets. A list of addresses associated with this activity is available here: fbi.gov/investigate/cyber/al…
1,015
3,507
917
13,703
4,505,711
Stewart Slocum retweeted
People who have been in research fields develop a felt sense that most "research" (in almost any field that isn't exactingly technical) is research theater, and many superstar careers enjoy star status not because of a unique connection to the truth but because of a unique connection with an audience. No one really has the time or stature to, from a position of objectivity and trust, bring popular researchers to heel. But it will get increasingly hard to hide from serious critique. The machines can do critique now, at the level of depth and rigor previously only possible for the academically deranged. We're going to have to revise a lot of what we "know" about the world that isn't really knowledge but is actually just received popular consensus - like floating voltages without grounding wires. The grounding wires are coming.
Tyler Cowen: 'I am not even sure what to say at this point. We need a radical revaluation of this work, and of the associated policy arguments. More generally, this is only a single step in the story of how AI is going to revise economic science, and indeed past research more generally. As I stress in many of my recent talks, there will be significant gains and losses in status, with the losses often outweighing the gains. I see this as one of those cases.'
58
243
64
1,825
218,843
Stewart Slocum retweeted
We’ve built an “eyes on everything” system that monitors nearly *every single rollout* from our frontier models across RL training, evals, and internal codex usage. It uses layers of chain-of-thought-monitors and investigator agents to dig through a model’s work, run code to examine evidence, and cross-check network logs to reconstruct what happened. For frontier RL runs, the system also pages humans 24/7 for urgent security alerts. It's been incredibly useful for identifying model misalignment and possible holes in our containment. openai.com/index/how-we-dete…
34
35
8
477
27,317
Stewart Slocum retweeted
There’s a world of difference between user-authorized agents (Muse, Instinct, Grokbot, etc.) and true unauthorized/rogue agents that could constitute cyberattacks. Most of the activity described in the Axios story appears to be the former: customers sharing credentials with agents so they can take actions on their behalf. This may violate bank terms requiring humans to log in themselves, but these are in no way cyberattacks. The direction banks should go is to support user-directed agents. For example, Amex is an authorized connection in Muse, making it easy for users to grant, limit, and revoke access. Read-only permission levels are a sensible interim step. Several banks already support or are moving toward them. Full write access (with user credentials) is a different risk category and should be approached carefully. Frightening the public by blurring the line between user-authorized agentic behavior and cyberattacks is irresponsible.
SCOOP: Major U.S. banks are detecting unauthorized third-party AI agents inside customer accounts, including some attempting to take actions that appear to be independent of user instructions, sources told Axios. The findings have alarmed banking executives, who are racing to restrict access to their systems as AI moves at a velocity faster than financial institutions can respond, multiple industry and bank executives told Axios. Several banks are now preparing for worst-case and even “day after” scenarios, including how to rapidly secure or restore customer accounts if things go wrong, the people said. Several bank executives told Axios they're struggling to distinguish between human users and AI agents. One executive said banks also struggle to determine whether agents are authorized by customers or potentially operating without their permission, more akin to rogue agent behavior. Read my latest for Axios here: axios.com/2026/10/22/ai-agen…
413
741
140
5,919
415,180
Stewart Slocum retweeted
Personal update: Turns out that what I thought was leaving OpenAI became more of a sabbatical. When I left a few months ago, I felt that the most important thing to focus on was making AI more useful to people. But we’ve since entered a different regime of AI progress. One in which getting the safety and security challenges of increasingly capable AI right has to become a central priority. So I’ll be returning to OpenAI, joining @merettm to help chart a path through these challenges. There’s much work to do, so let’s get going.
184
125
35
3,643
1,923,206