high data circle

San Francisco, CA
Joined November 2023
it turns out the implementation matters
The implementation no longer matters People really, really need to understand that
26
95
7
1,985
73,305
Ani Rahul retweeted
for the record, I really like DeepSeek’s benchmarking approach, it controls for all the free variables and is probably the most compelling recent roofline curve to me. every engine should be benchmarking this way, and kv caches/pd separately see: xitter.cf/ekzhang1/status/208189…
If inferenceX didn't deprecate 8k/1k this wouldn't be a problem smh
7
7
1
184
10,241
To be fair they did say most of their stuff was based off vLLM I think the most interesting part was the kv cache offloading they mentioned but that implementation wasn’t shared
🚨🚨🚨 vLLM is all you need to reproduce DeepSeek’s performance. With Wide-EP and EPLB, vLLM can match DeepInfer’s decode performance within 6% and generate $39/gpu/hr in revenue at DeepSeek’s off-peak pricing, at 200 P90 TPS on the AgentX workload. Specifically: • Under DeepSeek’s decode configuration (DeepSeek-V4.1-Flash, 131K context, nextn=3), vLLM on GB200 achieves throughput within 6% of DeepInfer’s published results across batch sizes 8–256. • On AgentX, vLLM pushes the Pareto frontier further on GB300, reaching up to 1M tokens/s/GPU and generating $38.96/gpu/hr in revenue at 196 P90 TPS, based on DeepSeek’s off-peak API pricing. • Also, vLLM extended low-latency kernel support for DeepSeek-V4.1-Flash, achieving up to 826 TPS per user on AgentX.
1
7
494
Ani Rahul retweeted
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/DeepI… 1/4
15
288
5,419
My bad bro I'll be nicer next time
2
11
775
😂
unavailable
1
1
13
2,436
This naming scheme is bonkers (minor model numbers and date tags) and the benchmark step is big. Could prove stronger than GLM 5.3 with vision built in. The King of open weights is back?
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
44
20
2
433
27,771
Very cool capabilities emerging out of the frontier models
In September, we published the TORCS Racing Bot task as part of FrontierSWE Agents get 20h to build a bot that drives in a racing simulator as fast as possible, using only visual inputs. We are sharing a more detailed analysis and interesting findings from models' attempts
12
560
Very cool, but this is mostly just well known math? youtube.com/watch?v=r6sGWTCM…
Argon has this amazing natural understanding of the world. It can do so many things from first principles. Here's a pelican riding a bike, using fourier epicycles. Video made by Argon. Time-synced Lyria 3.5 music prompted by Argon.
1
340
Solve 3-sum in sub quadratic time
i feel like swe interviews could probably collapse into just 2 technical rounds: • system design (how well can you articulate your ideas, do you actually know how to engineer something) • onsite project to build a real thing with agents (can you translate your intent into high quality outcomes) everything else we used to ask is no longer necessary
2
11
1,694
Ani Rahul retweeted
imo open source post-training has a lot of good components but still very little of the connective tissue needed to run frontier-ish experiments reliably. lowering the cost of running these experiments outside frontier labs might be one of the highest-value things for open post-training research right now. bullish on the proximal team.
At Proximal, we believe that building our own research infrastructure is crucial to design the highest-quality training data Today, we are sharing more information about our internal post-training stack
2
2
1
79
4,940
I think we designed one of the most efficient stacks for on demand RL runs 👀
At Proximal, we believe that building our own research infrastructure is crucial to design the highest-quality training data Today, we are sharing more information about our internal post-training stack
2
14
1,041
Startup name matrix filled up fast
13
4
5
230
20,847
Bro how does the everyday personal agent ship when you can’t even set it up on your phone
1
2
374
People when they find out their favorite strava grindslop app was actually just trying to sell their data
introducing Promethee, an app that turns your work into a multiplayer game, to perform. now available for everyone. promethee.io
1
356
Ani Rahul retweeted
If you are interested in: - Post-Training - Data Research - Infra at tremendous scale or just generally want to know more about what we do @ProximalHQ, please reach out, I would love to chat :)
Excited to share i’ve joined @ProximalHQ here in SF! I think that there is a ton of interesting open problems related to data and post training at large. There is no better team to work with than the one we have and I am extremely excited to share our work :)
15
15
470
22,394
Most benchmarks people report on are already saturated if you only include the fair tasks
Many cybersecurity evals use differential execution to test whether agents can reproduce known software vulnerabilities Without added constraints, this creates fairness issues: Our evaluation shows that CyberGym is effectively saturated on a verified task subset
2
42
3,354
The RTX pro 6000 has double in price since it's pre-order
Old GPUs are turning into appreciating assets More charts in State of Markets II: a16z.news/p/state-of-markets…
1
15
1,751
Google catching up on FrontierSWE 👀
Lots of discussion out there about our next model(!), so I wanted to give an early look as soon as possible. Introducing Gemini 4 Argon! It shows frontier performance in complex workflows, cyber defense and software engineering. Teams are using it extensively at Google, from coding to quantum computing, great feedback. Here’s a look at the benchmarks:
8
631
If I had to name one thing that we’ve done right at Proximal, it would be hiring. Outside of raw technical talent, I’ve never seen a place at which people care as much and have as much fun together (I’ve been told that coming to the office feels like going back to college)
Proximal builds infrastructure that enables AI to improve from real-world experience. In the past year, we have grown to more than $200M in annualized revenue helping frontier labs and enterprises improve coding agents. Now, we are expanding beyond software engineering. Recent progress in mathematics demonstrates what happens when models are trained in domains with massive amounts of public data and easy verifiability, making it easy to find weaknesses, generate training tasks, and iterate quickly. We build infrastructure that enables this feedback loop in other domains: we are excited about a world in which AI systems design targeted drugs, accelerate chip design, and rewrite legacy software that still runs hospitals, power grids, governments, and other critical infrastructure. Since starting, we have assembled a small team of researchers and engineers and built world-class infrastructure for post-training and synthetic data research to overcome the challenges of scaling manual data curation. Our team comes from Cursor, Google DeepMind, Meta Superintelligence, Prime Intellect, Citadel, and Jane Street. More than half are former founders. We’re fortunate to be backed by investors who share that vision, including @generalcatalyst who led our $15M Seed Round at a $300M valuation, as well as @chemistry, @svangel, @dvlamoen and individuals like @LiamFedus, @kevinweil, and @bernhardsson
26
9
7
259
85,082