Golang/observability hacker changing the world @typesafeai. alum @docker @honeycombio @Bauplan_labs

San Francisco, CA
Joined October 2010
still seems expensive to me
If you want to understand how fast AI is improving, look at intelligence per dollar. 1.5 years ago: o1 Pro: $150 / $600 per M tokens Today: GLM-5.3 Flash: $0.15 / $0.50 That’s a ~1000x collapse in price in under 1.5 years, while GLM-5.3 Flash is more intelligent than o1 Pro.
5
49
25,306
damn it guys
They allow them a sub agent to focus on the task. Don’t pause your main thread that’s literally turning the experience from active learning to loading screen brainrot.
2
8
566
but also hell yeah guys
106
ready for this to manifest in my own life 🙏
life has been better ever since i got a 5kt emerald gold pinky ring made leaning into the mob boss aesthetique
2
365
alright that does it i'm building a subagent scheduler* *markdown file on my computer i tell claude code to look in
alright guys you kinda played me encouraging me to be more subagentpilled forked off like five and they all spun up jobs maxing out the cpus, causing a grinding twenty minute beachball fest we need a local scheduler for agent workloads
8
13
721
alright guys you kinda played me encouraging me to be more subagentpilled forked off like five and they all spun up jobs maxing out the cpus, causing a grinding twenty minute beachball fest we need a local scheduler for agent workloads
typing "do it in a subagent", "do it in a subagent", etc. is getting really fucking annoying should i tell my AGENTS.md to understand this to mean it? go func() { make a worktree for that and do it }()
4
1
12
1,667
what i’ve learned from this is basically steer stans are vicious where my queue bois at
*on a first date in san francisco* so are you a queue-by-default or a steer-by-default in the agent kinda person?
3
9
663
typing "do it in a subagent", "do it in a subagent", etc. is getting really fucking annoying should i tell my AGENTS.md to understand this to mean it? go func() { make a worktree for that and do it }()
They allow them a sub agent to focus on the task. Don’t pause your main thread that’s literally turning the experience from active learning to loading screen brainrot.
11
1
1
21
2,405
yes. i think this will be huge. jev is really good at telling if agent is progressing in the right direction. my early experiments with directing, guiding and correcting agents with it have been really promising.
Another insane way to use Jev: Jev makes it dramatically cheaper to identify which corrections and trajectories from an agent run are reusable across agents. And finally, someone open-sourced a self-improving memory layer that can put that signal to work across agent harnesses: - Claude Code - Codex - Cursor - OpenCode - Hermes, and 20+ more Beacon by @asymptotelabs continuously captures agent sessions across harnesses and stores their traces in a shared index. I used it with Jev to build a live cross-agent memory workflow. Beacon captures each run as it happens across all harnesses on my machine. Then Jev evaluates whether the trace contains a reusable engineering lesson, and the approved lesson becomes available to the next agent. GitHub repo: github.com/Asymptote-Labs/ag… (don't forget to star it ⭐) Preserving an agent run and learning from it are two different problems. Most traces contain file reads, failed commands, routine exploration, and implementation details that only apply to one task. Passing the complete transcript to another agent adds context without identifying what matters. In this workflow, one agent never receives another agent's raw transcript. It receives only the specific engineering lesson produced from the evaluated trace. A correction made in one agent can then prevent the same mistake when another agent encounters a similar problem. The recording shows the complete workflow I built. If you want to dive deeper into Jev, I also wrote a hands-on guide to building this Jev-style decision path with open models, entirely locally. Read it below.
2
7
184
14,662
Nathan LeClaire retweeted
1/ Our long national nightmare is over. The wall has been smashed. New community checkpoint for integer multiplication: κ = 0.00268647 ≈ 2⁻⁸·⁵⁴⁰ T(n) = O(n(log n)⁰·⁹⁹⁷³¹³⁵³) A 66% improvement since last announcement. A 2^173 fold improvement from the OAI result
1/ New community checkpoint for integer multiplication: κ = 0.00161272137 ≈ 2⁻⁹·²⁷⁶ T(n) = O(n(log n)⁰·⁹⁹⁸³⁸⁷²⁸) Reviewed and merged to main. A cumulative community result
27
52
15
1,204
103,916
Opus 5.5 = 🐐
Opus 5.5 is such a good writer that I really enjoy reading its reports now. Such a huge improvement over Fable.
1
11
2,262
*on a first date in san francisco* so are you a queue-by-default or a steer-by-default in the agent kinda person?
25
11
4
244
10,139
Nathan LeClaire retweeted
Learn to build evals, folks. Highly recommended reading on using decision models for evals. From our internal evals, System One models like Jev are a great fit for LLM Judges. If you want to go beyond Hamel's great write-up, I've also put together a few resources on applying decision models to LLM judges. (bookmark it) 1) Jev-as-a-Judge for Agent Evaluations - academy.dair.ai/dashboard/re… 2) Jev-as-a-Judge: Evaluating Agents with a Decision Model - academy.dair.ai/labs/jev-as-… Bonus paper I would recommend, with a few other ideas that combine System One and System Two models: Jev-as-a-Judge paper - arxiv.org/abs/2609.26550
New blog post 🎉: How To Use Decision Models For Evals In this post, we show you how to choose a decision model for your task, tune its threshold (don't assume the 0.5 default is good!), and interpret its scores. Lots of cool interactive charts here.
60
145
7
1,633
121,730
Nathan LeClaire retweeted
New blog post 🎉: How To Use Decision Models For Evals In this post, we show you how to choose a decision model for your task, tune its threshold (don't assume the 0.5 default is good!), and interpret its scores. Lots of cool interactive charts here.
163
250
57
2,251
302,626
Nathan LeClaire retweeted
I just built Computer Use that’s cheaper, faster, and acts like a human 🖥️ Powered by @typesafeai’s JEV 1.14, using the new Image/Box feature. It looks at the screen, decides what to do, then clicks and types like a real person. ⚡ Way cheaper than using an LLM 🧑 Acts like a human: sees the screen, picks an action, clicks or types it 📋 Full report of every step: the screenshot, the action it picked and why Demo: I told it to open Wikipedia, search for an article about aliens, copy the link, and post a tweet with the link and some text. - Cost: $0.0019 - Tokens: ~50,000 OPEN SOURCING SOON on my github 👀 (as always)
71
92
6
1,377
62,037
Nathan LeClaire retweeted
Possibilities with decision models like Jev feel endless. We're using it to build an open-source developer tool, Traits, that desloppifies AI codegen. Crazy future incoming traits.sh/?v=04
1
2
1
11
897
Nathan LeClaire retweeted
Join the pink Jevolution!!
Hello Software Engineers, I lead TypeSafe AI Model Capabilities team. We are hiring. Here are a few qualities we are looking for: • strong plus for people who resonate with the title "Experience Engineers": mobile engineers, full stack engineers, or even (virtual) reality engineers. • strong coder (you need to be able to manually write code) • product oriented thinker I promise are fun! I trust that you will figure out how to apply.
2
24
3,017
can you use jev to de-sloppify? my early experiments suggest it could help i suspect codifying our tastes and preferences into "semantic linters" will become common. jev seems to thrive on comparisons, so the LLM can explore multiple drafts with jev as a judge.
Non-deterministic rules via decision models are about to radically improve AI codegen. Brace yourself for global desloppification.
9
10
3
177
6,626
Nathan LeClaire retweeted
the way I think about this, as a frontend person turned model capabilities at TypeSafe as a frontend person…is ur job to write JavaScript/CSS, or is it to improve UX/make it more delightful/etc? our interface is our models! it turns out many of the same principles apply
what does a frontend person actually do day to day on a model capabilities team?
2
6
1
86
30,479
Here's an example of stacking jev on jev inspired by Lily. Jev divides and conquers an image to find a bunch of bounding boxes. For straightforward detection it's worse/slower than SAM3 but for something intelligent - like finding all sheep who might "yee haw" - it does well.
Replying to @lotusfracture
First image, increase number of image cuttings allowed up to 15 times. Second, same but also included feedback. Each produced box is checked and asked if correctly on a beetle. If no, repeat cycle, if yes keep the box. Greyed squares, Jev said no beetle. Other squares, Jev said 1 beetle then asked to produce the box. Green dot, ground truth. Pink box, Jev box. Yellow dot, Jev box centroid. Blue dotted box, independent cuts for another test (can ignore here). Overall, the feedback loop helps throw away bad boxes but doesn't help finding more. 1 correct beetle was rejected too. Nice trick! :)
20
23
5
378
19,186