Ani Rahul retweeted
for the record, I really like DeepSeek’s benchmarking approach, it controls for all the free variables and is probably the most compelling recent roofline curve to me.
every engine should be benchmarking this way, and kv caches/pd separately
see: xitter.cf/ekzhang1/status/208189…
To be fair they did say most of their stuff was based off vLLM
I think the most interesting part was the kv cache offloading they mentioned but that implementation wasn’t shared
🚨🚨🚨 vLLM is all you need to reproduce DeepSeek’s performance.
With Wide-EP and EPLB, vLLM can match DeepInfer’s decode performance within 6% and generate $39/gpu/hr in revenue at DeepSeek’s off-peak pricing, at 200 P90 TPS on the AgentX workload.
Specifically:
• Under DeepSeek’s decode configuration (DeepSeek-V4.1-Flash, 131K context, nextn=3), vLLM on GB200 achieves throughput within 6% of DeepInfer’s published results across batch sizes 8–256.
• On AgentX, vLLM pushes the Pareto frontier further on GB300, reaching up to 1M tokens/s/GPU and generating $38.96/gpu/hr in revenue at 196 P90 TPS, based on DeepSeek’s off-peak API pricing.
• Also, vLLM extended low-latency kernel support for DeepSeek-V4.1-Flash, achieving up to 826 TPS per user on AgentX.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗 github.com/deepseek-ai/DeepI…
1/4
Ani Rahul retweeted
This naming scheme is bonkers (minor model numbers and date tags) and the benchmark step is big. Could prove stronger than GLM 5.3 with vision built in.
The King of open weights is back?
🚀 DeepSeek-V4.1-Flash-1017 is here!
Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API.
🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model.
1/4
Very cool capabilities emerging out of the frontier models
Very cool, but this is mostly just well known math?
youtube.com/watch?v=r6sGWTCM…
Solve 3-sum in sub quadratic time
i feel like swe interviews could probably collapse into just 2 technical rounds:
• system design (how well can you articulate your ideas, do you actually know how to engineer something)
• onsite project to build a real thing with agents (can you translate your intent into high quality outcomes)
everything else we used to ask is no longer necessary
Ani Rahul retweeted
imo open source post-training has a lot of good components but still very little of the connective tissue needed to run frontier-ish experiments reliably. lowering the cost of running these experiments outside frontier labs might be one of the highest-value things for open post-training research right now. bullish on the proximal team.
People when they find out their favorite strava grindslop app was actually just trying to sell their data
introducing Promethee, an app that turns your work into a multiplayer game, to perform.
now available for everyone.
promethee.io
If you are interested in:
- Post-Training
- Data Research
- Infra at tremendous scale
or just generally want to know more about what we do @ProximalHQ, please reach out, I would love to chat :)
Excited to share i’ve joined @ProximalHQ here in SF! I think that there is a ton of interesting open problems related to data and post training at large. There is no better team to work with than the one we have and I am extremely excited to share our work :)
Most benchmarks people report on are already saturated if you only include the fair tasks
The RTX pro 6000 has double in price since it's pre-order
Old GPUs are turning into appreciating assets
More charts in State of Markets II: a16z.news/p/state-of-markets…
Google catching up on FrontierSWE 👀
Lots of discussion out there about our next model(!), so I wanted to give an early look as soon as possible. Introducing Gemini 4 Argon!
It shows frontier performance in complex workflows, cyber defense and software engineering. Teams are using it extensively at Google, from coding to quantum computing, great feedback.
Here’s a look at the benchmarks:
Ani Rahul retweeted
If I had to name one thing that we’ve done right at Proximal, it would be hiring.
Outside of raw technical talent, I’ve never seen a place at which people care as much and have as much fun together (I’ve been told that coming to the office feels like going back to college)
Proximal builds infrastructure that enables AI to improve from real-world experience.
In the past year, we have grown to more than $200M in annualized revenue helping frontier labs and enterprises improve coding agents. Now, we are expanding beyond software engineering.
Recent progress in mathematics demonstrates what happens when models are trained in domains with massive amounts of public data and easy verifiability, making it easy to find weaknesses, generate training tasks, and iterate quickly.
We build infrastructure that enables this feedback loop in other domains: we are excited about a world in which AI systems design targeted drugs, accelerate chip design, and rewrite legacy software that still runs hospitals, power grids, governments, and other critical infrastructure.
Since starting, we have assembled a small team of researchers and engineers and built world-class infrastructure for post-training and synthetic data research to overcome the challenges of scaling manual data curation.
Our team comes from Cursor, Google DeepMind, Meta Superintelligence, Prime Intellect, Citadel, and Jane Street. More than half are former founders.
We’re fortunate to be backed by investors who share that vision, including @generalcatalyst who led our $15M Seed Round at a $300M valuation, as well as @chemistry, @svangel, @dvlamoen and individuals like @LiamFedus, @kevinweil, and @bernhardsson


































