Yearnalist covering the frontiers of AI @TheInformation. Hosting AI Deep Dive. Signal: (530) 400-4184

San Francisco, CA
Joined April 2024
I'm so excited to announce that I'm hosting The Information's new AI show! Each episode will be a deep dive into a hard technical problem with a researcher or founder working on the frontier of AI Up first, I'll be talking with @polynoamial about the challenges with AI agents
The Information’s TITV Presents: AI Deep Dive Hosted by Rocket Drew, one of our leading AI reporters, this new long-form show will explore the most important technical ideas shaping artificial intelligence today. AI researchers, engineers, and founders will join Rocket to discuss the technical breakthroughs and challenges defining the next phase of the AI industry. Read more from @rocketalignment: thein.fo/4h7OJve
24
19
2
194
14,537
🗣️
BREAKING: Just 17 months after profiling TBPN, @abebrown716 has been promoted to features editor at The Information
3
276
Kai’s robot evals piece is required reading > today’s best robotics benchmarks are far less informative than benchmarks for [LLMs] > stacking blocks or folding shirts give some information about how capable a robot model is, but less about the trajectory of the entire field
I was wrong recently. When I was working on a recent article about the challenges of robotics evaluation, I thought we wouldn't see any top robot models offered through API: understandingrobots.org/p/wh… Then @physical_int went and released a beta last week: pi.website/blog/api-beta
1
1
9
845
AI Deep Dive episode with Sonia Joseph is out now! World models 🤖 and interpretability 🔬 are two sides ✌️ of the same coin 🪙
Thank you Rocket Drew @rocketalignment for hosting me on The Information about world models and interp! Rocket is a precise & careful technical interviewer who is a pleasure to talk to, and who let me go into a technical rabbithole while keeping the convo accessible!
6
12
2,853
“All RL tasks are cyber tasks” is the new “all prediction markets are assassination markets”
1
16
530
Tom McGrath predicts that automating interp research will result in 10 years of counterfactual progress per year
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
1
2
271
🚀 AI Deep Dive Episode 5: Can We See Inside an AI’s Mind? AI can write down its reasoning. But what happens when more of its thinking never makes it onto the page? @rocketalignment and @GoodfireAI co-founder and chief scientist Tom McGrath explore what AI “brain scans” can reveal beyond written reasoning, how internal signals could help catch cheating, and what it would take to understand—and change—what models learn. 00:00 Intro 00:39 Tom McGrath and AI brain scans 09:01 Written reasoning and hidden computation 17:45 Why AI is hard to understand 24:07 How researchers identify concepts 31:10 What interpretability could change 34:42 Reverse engineering a language model 43:09 The field’s approaches and investment 51:51 Changing models without hiding problems 1:00:10 AI agents studying AI
87
90% of working hours are not covered well by existing benchmarks. That is why I am introducing TweetBench, a new eval to measu
90% of Americans’ working hours are spent on tasks not covered well by AI benchmarks. That’s our best guess from a new project mapping frontier benchmarks onto the US economy. Preparing for a post-AGI economy requires predicting the future. Current benchmarks makes it very difficult even to measure the present.
1
19
666
🚀 Rocket retweeted
new existential threat to software engineers has been unlocked by cognition: token limits based on how well the engineers use the tokens…
39
14
21
589
88,708
At this panel over the summer I said that what surprised me most in AI over the past year was that chains of thought had held up so well 😬 womp womp
Replying to @rocketalignment
@rocketalignment of @theinformation says token consumption belongs in a performance review as one metric among several, since every metric has always been gameable. @dseetharaman of @Reuters, at Media Summit | SF 2026, agreed, comparing token usage to word count.
5
393
Looping is a conspiracy invented by the mech interp teams to sell more mech interp
3
3
88
2,119
🚀 Rocket retweeted
Replying to @raymondadouglas
Tell me about it - see also this bit. You may enjoy the eval awareness section: storage.googleapis.com/deepm…
2
3
1
33
2,158
🚀 Rocket retweeted
Some personal news: I've joined @theinformation to cover Google. I'll be covering everything from Gemini to Search, from Cloud to Waymo. As always, I'm on Signal at 302-519-0567 and at [email protected]. Talk to Barwick folks!
21
16
1
275
14,427
Lambert’s Law:
If you announce a model's benchmarks without releasing it (weights, product, api, etc "later"), feels like almost a sure thing that someone releases a better model in your category before you get it out.
1
2
278
Get yer piping hot serving of mech interp:
🚀 AI Deep Dive Episode 5: Can We See Inside an AI’s Mind? AI can write down its reasoning. But what happens when more of its thinking never makes it onto the page? @rocketalignment and @GoodfireAI co-founder and chief scientist Tom McGrath explore what AI “brain scans” can reveal beyond written reasoning, how internal signals could help catch cheating, and what it would take to understand—and change—what models learn. 00:00 Intro 00:39 Tom McGrath and AI brain scans 09:01 Written reasoning and hidden computation 17:45 Why AI is hard to understand 24:07 How researchers identify concepts 31:10 What interpretability could change 34:42 Reverse engineering a language model 43:09 The field’s approaches and investment 51:51 Changing models without hiding problems 1:00:10 AI agents studying AI
1
6
393
all of these mechanisms might be true but they need a lot of weighing to support the conclusion in the fields medal letter that "the push by AI companies to solve mathematical problems as a benchmark is detrimental to the science of mathematics, and to the mathematical community"
1
5
304
Local Man Teaches Sand to Think, Midwifes the Mind From the End of Time
California reinventing the Florida man genre of headline
3
318
California reinventing the Florida man genre of headline
5
2
1
13
902
Stuart Russell on why alignment might be IMPOSSIBLE
🚀 AI Deep Dive Episode 4: Can We Solve AI’s Alignment Problem? We want AI to follow instructions. But what if our instructions are the problem? @rocketalignment and UC Berkeley Computer Science Professor Stuart Russell explore how AI learns its goals, why human feedback can reward the wrong behavior and what it would take to prove a powerful system is safe. 00:00 – Intro 00:43 – The alignment problem 07:18 – How AI misalignment shows up 16:07 – Training AI to imitate humans 26:05 – Can human feedback fix alignment? 37:47 – When humans become the obstacle 40:04 – Did AI take a wrong turn? 44:24 – AI & existential risk 51:09 – AI labs & safety evidence 58:06 – Assistance games & the off switch
5
3
24
4,246
Embedded evals are not really audits or evals but a secret third thing
1
2
21
1,217
Who called it losing chain of thought monitorability through opaque internal reasoning and not “weight, weight, don’t tell me”
21
37
1
388
11,537