@aisysbooks @goodailist AI Engineering: https://xitter.cf/t.co/94dv4uTU1H Designing MLSys: https://xitter.cf/t.co/G81hL2dWmr Reading @chipslib

San Francisco, CA
Joined June 2008
My 8000-word note on agents: huyenchip.com//2025/01/07/ag… Covering: 1. An overview of agents 2. How the capability of an AI-powered agent is determined by the set of tools it has access to and its capability for planning 3. How to select the best set of tools for your agent 4. Whether LLMs can plan and how to augment a model’s capability for planning 5. Agent’s failure modes AI-powered agents are an emerging field with no established theoretical frameworks for defining, developing, and evaluating them. This post is a best-effort attempt to build a framework from the existing literature, but it will evolve as the field does. As always, feedback is much appreciated!
75
466
46
2,929
435,602
Braden and team are great! Highly recommend this program for independent researchers working on cool stuff!
Slingshots // Four is live! Another batch, another fourteen projects shipping open source artifacts that I’m excited about. See below for the full list. A few themes from the batch: 1. Harness time: This quarter harnesses shot up in visibility, with increased appreciation for the parts of an agent that aren’t the model and what they can give you. This batch includes a harness supporting persistent agency (Headlong); a harness supporting self-improvement via context management (ACE); a harness supporting self-improvement of the agentic harness itself (Exo); and a harness supporting multi-agent setups (dotagents). 2. Up and down the stack: There’s innovation to be had at every layer of the stack. We saw projects worth backing at the level of kernels (Thunderkittens); inference (M*); training (Marin); data (Atlantic-CC); evals (Decision Assistants); optimization (SkyDiscover); applications (Wagglehaus), etc. 3. Talk of the town: Slingshots continue to tackle timely problems at the frontier. Concurrent with Jev taking over X, an even faster type 1 decision model (CLM) came out of academia. With RSI on the brain of every big lab researcher, we now have a public literature retrieval benchmark grounded in authors’ firsthand accounts of their research process (ScholarCatalyst). And a new RL training method (Pedagogical RL) addresses head-on the question vexing RL practitioners of how privileged information can be used to discover generalizable behaviors, not just verify. Congrats to all the researchers in this batch and the previous three who continue to ship their research out into the world with open artifacts that can be adopted and built upon. Open science leads to better outcomes for everyone. And the good times will continue to roll – batch five is looking just as good. If you’re a researcher with a project that’s gaining momentum and ready for an adrenaline shot, shoot me a DM or apply at laude.org/slingshots. 👏 @a1zhang, @AlexKrentsel, @ankrgyl, @Azaliamirh, @bariskasikci, @bfspector, @chelseabfinn, @chipro, @Diyi_Yang, @dlwh, @drmapavone, @HazyResearch, @jackyk02, @jonasgeiping, @JonSaadFalcon, @jure, @kothasuhas, @lateinteraction, @martin_casado, @mertcemri, @michaelryan207, @MikeCafarella, @NickAJalbert, @NoahZiems, @nsagan271, @ohmyksh, @percyliang, @qizhengz_alex, @RussoMatthew, @samrmadden, @shagarw21, @ShashwatGoel7, @shulynnliu, @simran_s_arora, @souradipchakr18, @stuart_sul, @tianyu_li_, @tim_kraska, @WilliamBarrHeld, @yoonholeee, @YejinChoinka, @Stanford, @MIT, @LaudeInstitute, @CarnegieMellon, @UW, @UCBerkeley, @MPI_IS, @UWMadison
4
1
27
6,780
Interesting approach. Models can't output freeform text but can choose from a set of predefined values. Could be useful for data labeling and tasks with a fixed list of possible actions. Unclear how reasoning would work though, but it's super cheap (output tokens are free!)
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x cheaper (w/ output tokens free) • Frontier composable intelligence optimized for decisions AFAICT the shortest path to AI-based economic revolution
55
27
5
483
56,752
i'm researching best practices for skills. what's the most number of skills you've had installed for your agents?
16%0 / what's a skill?
36%1 - 5
17%6 - 10
30%> 10
820 votes • Final results
44
10
2
55
20,890
real question: why does gpt 5.6 over engineer so much?
237
32
12
1,012
141,289
what's a good model tiering system? i'm sick of telling my agent orchestrator things like: "for Claude, use model X, for OpenAI, use model Y, etc." i want to be able to tell my orchestrator: "use models tier ..." for this kind of task
51
11
4
188
34,987
that's the problem he should've sent them in all caps
We asked an unreleased research version of Claude to take a stab at the Riemann hypothesis. It didn’t solve it, but it did make strides on a related problem: it increased the lower bound for the fraction of zeros of the Riemann zeta function that satisfy the hypothesis from 41.6% to 67.2%. anthropic.com/research/riema…
4
16
100
22,078
why don't model providers price tokens like electricity, higher price during peak hours and cheaper off peak?
398
48
50
2,254
309,871
Auto science is gonna be 🔥 Congrats anh Quoc and team!
Excited to co-found Discovery Loop with my long-time collaborators @JeffDean @Sanjay_Ghemawat @OriolVinyalsML . Our mission is to automate machine learning, engineering and science. Learn more at: discoveryloop.com ♾
3
6
109
30,226
Chip Huyen retweeted
Our first model, Inkling. Trained from scratch, weights are open, fine-tunable on Tinker today.
Today, we are introducing Inkling. Inkling reasons efficiently across text, image, and audio modalities. We are making the full weights available. thinkingmachines.ai/news/int… Available today for fine-tuning on Tinker. Play with it in the Inkling Playground. 🧵
395
1,082
173
13,580
1,593,623
bored at the airport so i made this killedbygpt.com
30
21
3
141
32,711
Congrats to @AlecRad @Luke_Metz and @soumithchintala! It's really cool to see work produced by a group of 20-somethings without a single PhD between them winning this award. I hope to see these three collaborate again one day :)
We are honored to announce the Test of Time awards for #ICLR2026 🏆 This award recognizes papers published 10 years ago at ICLR 2016 that have had a lasting impact on the field: blog.iclr.cc/2026/04/22/anno…
2
16
128
24,984
Chip Huyen retweeted
Got to meet the wonderful Chip Huyen @chipro She’s so nice and smart!!
19
12
853
43,891
Chip Huyen retweeted
Excited to release PostTrainBench v1.0! This benchmark evaluates the ability of frontier AI agents to post-train language models in a simplified setting. We believe this is a first step toward tracking progress in recursive self-improvement 🧵:
49
101
31
768
209,092
How long do you think AI will be able to fully automate your job?
11%Already automated
41%<= 3 years
29%> 3 years
19%Never
2,306 votes • Final results
18
6
3
57
29,498
For those that chose Never, what do you do?
41
1
1
36
26,346
I built GoodAIList.com to help me stay-up-date with new AI stuff. It's tracking 14K open source repos so far, with contributions from over 145K developers. Every day, it: - searches for new AI repos (based on 123 keywords and topics) - surfaces repos that are gaining traction, and - categorizes each repo The annotations are done by AI so they are not super accurate, but they've helped me find some useful stuff. It also lets me see where the contributors are, so when I travel, I can find folks doing cool stuff in a new city or country.
16
46
7
259
20,467
Comparing the AI open source ecosystem in the US, China, Europe, and the rest of Asia over time
2
7
35
12,322
Super impressed by the projects at the Agentic Hackathon last weekend! Many teams work on really hard/important problems: * Long running tasks: memory management, recovering from mid-task failures, and maintaining consistency across steps and sub-agents * Adaptive retrieval from multiple sources: databases, search indices, and websites * Agents that work with voice, video, and even 3D environments If you are in SF, come check out the finalist demos tomorrow! luma.com/6bd4bt9j There will be talks by Douglas Eck, who is doing amazing work with Veo and Imagen and many other awesome folks. Thanks @MongoDB and @cerebral_valley for hosting and for letting me serve as a judge for these fantastic projects.
7
10
91
13,434
OMG there's a bookstore dedicated to technical books in Taipei!
53
87
20
2,058
243,378
Sam!!!
Small-but-happy win: If you tell ChatGPT not to use em-dashes in your custom instructions, it finally does what it's supposed to do!
186
186
67
10,223
1,474,934