
making gpu's that go brrrrr @AgraniLabs
Joined December 2024
- Tweets974
- Following505
- Followers71
- Likes28.2K
from making gpu's go brrr to making gpu's that go brrr
I am joining @AgraniLabs as an Performance Architect Intern
1
4
220
Darshan retweeted
In hindsight it's obvious that the fastest path to solving Millennium Prize Problems was to play lots of video games in order for GPUs to improve, so that ML could develop and language models could get trained. Gamers, thank you for your valuable contribution to mathematics!
Wow
The only thing faster than GB300 Dynamo + vLLM is Vera Rubin Dynamo + vLLM 🏎️💨.
The first DeepSeek V4.1 Flash results on @NVIDIA Vera Rubin NVL72 are here, powered by Dynamo + vLLM on @SemiAnalysis_'s AgentX benchmark.
Compared with GB300 NVL72 running Dynamo + vLLM, InferenceX's perf ruler shows:
• 63.4× total token throughput per chip at 400 tok/s/user
• 93.3× at 600 tok/s/user
1
108
Replying to @maharshii
You can look into sgl-nvidia-megakerles repo
Its a nice learning materal for PDL, they have got good gains
1
2
182
Replying to @AryaTschand
"and the insights should generalize to any hybrid transformer + MoE model architecture" -- why is that? can't think about it from first principles
23
claude --remote-control is the best thing this world has every produced; i can't switch to codex just because of this feature!
1
2
190
I can't believe the things happening to this world after corona
Still feels like a dream
NVIDIA announces CEO transition. Read the release: nvidianews.nvidia.com/news/n…
31
Replying to @cudagdb
Isn't that just a modern day megakernel
The thing which nvida-sglang-megakernel repo is doing
45
Replying to @TrijalSrivasta3 @cudagdb
Literally me after reading sglang PR which adds megakernel support for some chinese model to improve performance on inferncex
1
41


















