Markus N Rabe retweeted
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: darioamodei.com/post/we-must…
Well, what a week to join Anthropic.
I'm impressed by the integrity of this company and proud to become a part of it.
A statement on the comments from Secretary of War Pete Hegseth.
anthropic.com/news/statement…
10
910
Hot take: most tokenization “fixes” are over-engineered.
We found a simple one that actually works.
- drop-in replacement for token embeddings
- zero inference overhead
- lowers test loss: +8% compute-equivalent
Spelling Bee Embeddings: arxiv.org/abs/2601.18030
Big thanks to the authors of this gem: arxiv.org/pdf/2510.04212. Will we get this in the official implementation? @tri_dao
Markus N Rabe retweeted
New post! This time, about the current state of Long Context Evaluation.
I discuss existing benchmarks, what makes a good long context eval, what's missing from existing ones and introduce a new one - LongCodeEdit :)
Markus N Rabe retweeted
I was one of the 16 devs in this study. I wanted to speak on my opinions about the causes and mitigation strategies for dev slowdown.
I'll say as a "why listen to you?" hook that I experienced a -38% AI-speedup on my assigned issues. I think transparency helps the community.
Markus N Rabe retweeted
People outside tech starting to realize how quality software and typing/generating code fast are not correlated
Markus N Rabe retweeted
Augment remote agent, your team of virtual interns:
1. Deeply integrated w/ IDE.
2. Spin up remote agents from EXACTLY your current code state and environment.
3. Apply their patches easily to your current local repo.
4. Steer and interrupt them the SAME way you interact with your in-IDE agent.
5. 1-key SSH takeover at any time.
Markus N Rabe retweeted
🆕 Live now: Self Coding Agents
@colin__flaherty has been working on SOTA coding agents and currently holds the #1 spot on SWE-Bench Verified!
youtube.com/watch?v=Iw_3cRf3…
It might sound like science fiction but @augmentcode has gone all the way and made coding agents that **BUILD THEMSELVES** :eliezeremoji:
Some really useful hard won lessons here exploring:
- What does it look like to supervise AI coding agents at scale?
- How far can we push AI coding agents - what tasks are out of scope?
- What might unlock when AI handles complexity and humans drive innovation?
One of my favorite co-workers of all times, @smloos, has openings in her team at Waymo. Take a look!
careers.withwaymo.com/jobs/s…
1
196
Markus N Rabe retweeted
🧵We just released the #1 open-source agent on the SWE-bench Verified leaderboard by assembling the best of Claude Sonnet 3.7 and O1.
Open-source repo here: github.com/augmentcode/augme…
Here's how we achieved 65.4% success rate on the hardest coding benchmark in the industry: 🧠👇
Proud to announce that we've just achieved to be 🥇 on SWE-bench verified.
swebench.com/#verified
Big props to amazing @colin__flaherty for pushing our agents to the limit and beyond.
Check out @augmentcode
Markus N Rabe retweeted
Most code retrieval benchmarks optimize for synthetic problems. But professional software engineers don't solve artificial puzzles--they navigate large, often messy codebases.
Optimizing for synthetic benchmarks means climbing the wrong hill. Models that top artificial leaderboards consistently stumble in real-world applications.
The most important and underreported work in ML is how to create good evals.
Simple benchmarks can still tell you a lot. @augmentcode uses a modified CCEval benchmark to measure the quality of context-aware, inline code completions — and it correlates well with actual user acceptance rates.
augmentcode.com/blog/augment…
6
267





















