
Golang/observability hacker changing the world @typesafeai. alum @docker @honeycombio @Bauplan_labs
San Francisco, CA
Joined October 2010
- Tweets19K
- Following3.5K
- Followers8.5K
- Likes37K
damn it guys
Replying to @dotpem @allietheicon
They allow them a sub agent to focus on the task. Don’t pause your main thread that’s literally turning the experience from active learning to loading screen brainrot.
alright that does it i'm building a subagent scheduler*
*markdown file on my computer i tell claude code to look in
alright guys you kinda played me encouraging me to be more subagentpilled
forked off like five and they all spun up jobs maxing out the cpus, causing a grinding twenty minute beachball fest
we need a local scheduler for agent workloads
typing "do it in a subagent", "do it in a subagent", etc. is getting really fucking annoying
should i tell my AGENTS.md to understand this to mean it?
go func() { make a worktree for that and do it }()
Replying to @dotpem @allietheicon
They allow them a sub agent to focus on the task. Don’t pause your main thread that’s literally turning the experience from active learning to loading screen brainrot.
yes. i think this will be huge. jev is really good at telling if agent is progressing in the right direction. my early experiments with directing, guiding and correcting agents with it have been really promising.
Another insane way to use Jev:
Jev makes it dramatically cheaper to identify which corrections and trajectories from an agent run are reusable across agents.
And finally, someone open-sourced a self-improving memory layer that can put that signal to work across agent harnesses:
- Claude Code
- Codex
- Cursor
- OpenCode
- Hermes, and 20+ more
Beacon by @asymptotelabs continuously captures agent sessions across harnesses and stores their traces in a shared index.
I used it with Jev to build a live cross-agent memory workflow.
Beacon captures each run as it happens across all harnesses on my machine. Then Jev evaluates whether the trace contains a reusable engineering lesson, and the approved lesson becomes available to the next agent.
GitHub repo: github.com/Asymptote-Labs/ag…
(don't forget to star it ⭐)
Preserving an agent run and learning from it are two different problems.
Most traces contain file reads, failed commands, routine exploration, and implementation details that only apply to one task.
Passing the complete transcript to another agent adds context without identifying what matters.
In this workflow, one agent never receives another agent's raw transcript. It receives only the specific engineering lesson produced from the evaluated trace.
A correction made in one agent can then prevent the same mistake when another agent encounters a similar problem.
The recording shows the complete workflow I built.
If you want to dive deeper into Jev, I also wrote a hands-on guide to building this Jev-style decision path with open models, entirely locally.
Read it below.
Nathan LeClaire retweeted
1/ Our long national nightmare is over. The wall has been smashed. New community checkpoint for integer multiplication:
κ = 0.00268647 ≈ 2⁻⁸·⁵⁴⁰
T(n) = O(n(log n)⁰·⁹⁹⁷³¹³⁵³)
A 66% improvement since last announcement. A 2^173 fold improvement from the OAI result
*on a first date in san francisco*
so are you a queue-by-default or a steer-by-default in the agent kinda person?
Learn to build evals, folks.
Highly recommended reading on using decision models for evals.
From our internal evals, System One models like Jev are a great fit for LLM Judges.
If you want to go beyond Hamel's great write-up, I've also put together a few resources on applying decision models to LLM judges.
(bookmark it)
1) Jev-as-a-Judge for Agent Evaluations - academy.dair.ai/dashboard/re…
2) Jev-as-a-Judge: Evaluating Agents with a Decision Model - academy.dair.ai/labs/jev-as-…
Bonus paper I would recommend, with a few other ideas that combine System One and System Two models: Jev-as-a-Judge paper - arxiv.org/abs/2609.26550
Nathan LeClaire retweeted
New blog post 🎉: How To Use Decision Models For Evals
In this post, we show you how to choose a decision model for your task, tune its threshold (don't assume the 0.5 default is good!), and interpret its scores.
Lots of cool interactive charts here.
Nathan LeClaire retweeted
I just built Computer Use that’s cheaper, faster, and acts like a human 🖥️
Powered by @typesafeai’s JEV 1.14, using the new Image/Box feature.
It looks at the screen, decides what to do, then clicks and types like a real person.
⚡ Way cheaper than using an LLM
🧑 Acts like a human: sees the screen, picks an action, clicks or types it
📋 Full report of every step: the screenshot, the action it picked and why
Demo: I told it to open Wikipedia, search for an article about aliens, copy the link, and post a tweet with the link and some text.
- Cost: $0.0019
- Tokens: ~50,000
OPEN SOURCING SOON on my github 👀 (as always)
Nathan LeClaire retweeted
Possibilities with decision models like Jev feel endless.
We're using it to build an open-source developer tool, Traits, that desloppifies AI codegen. Crazy future incoming traits.sh/?v=04
Nathan LeClaire retweeted
Join the pink Jevolution!!
Hello Software Engineers, I lead TypeSafe AI Model Capabilities team. We are hiring. Here are a few qualities we are looking for:
• strong plus for people who resonate with the title "Experience Engineers": mobile engineers, full stack engineers, or even (virtual) reality engineers.
• strong coder (you need to be able to manually write code)
• product oriented thinker
I promise are fun! I trust that you will figure out how to apply.
can you use jev to de-sloppify? my early experiments suggest it could help
i suspect codifying our tastes and preferences into "semantic linters" will become common. jev seems to thrive on comparisons, so the LLM can explore multiple drafts with jev as a judge.
the way I think about this, as a frontend person turned model capabilities at TypeSafe
as a frontend person…is ur job to write JavaScript/CSS, or is it to improve UX/make it more delightful/etc?
our interface is our models! it turns out many of the same principles apply
Replying to @swyx @CompleteSkeptic
what does a frontend person actually do day to day on a model capabilities team?
Here's an example of stacking jev on jev inspired by Lily. Jev divides and conquers an image to find a bunch of bounding boxes. For straightforward detection it's worse/slower than SAM3 but for something intelligent - like finding all sheep who might "yee haw" - it does well.
Replying to @lotusfracture
First image, increase number of image cuttings allowed up to 15 times. Second, same but also included feedback. Each produced box is checked and asked if correctly on a beetle. If no, repeat cycle, if yes keep the box.
Greyed squares, Jev said no beetle.
Other squares, Jev said 1 beetle then asked to produce the box.
Green dot, ground truth.
Pink box, Jev box.
Yellow dot, Jev box centroid.
Blue dotted box, independent cuts for another test (can ignore here).
Overall, the feedback loop helps throw away bad boxes but doesn't help finding more. 1 correct beetle was rejected too.
Nice trick! :)























