Reuben Stern (@ReubenConducts) profile picture

Reuben Stern

@ReubenConducts

Research Scientist at Colfax International. Conductor, bassoonist, mathematician, wannabe powerlifter. They/them

 Boston, MA
research.colfax-intl.com
Joined May 2019
  • Tweets197
  • Following113
  • Followers344
13Media
Photo by Reuben Stern (@ReubenConducts)Photo by Reuben Stern (@ReubenConducts)Photo by Reuben Stern (@ReubenConducts)Photo by Reuben Stern (@ReubenConducts)Photo by Reuben Stern (@ReubenConducts)Photo by Reuben Stern (@ReubenConducts)Photo by Reuben Stern (@ReubenConducts)Photo by Reuben Stern (@ReubenConducts)Photo by Reuben Stern (@ReubenConducts)
here's a fun little identity: ReLU(x) = (x + |x|) * 0.5
7
8
2
478
51,375
with sp00ky season upon us, throwing it back to being in hell for this production of No Exit by ethan cavanac 😈 (don't @ me for using a stool; the show was 2.5 hrs with no intermission, and if i moved too much, i'd fall off the stage) instagram.com/reel/DfIIPrbgB…
Ethan A. Cavanac (@e.a.cavanac) • Instagram reel

Ethan A. Cavanac (@e.a.cavanac) • Instagram reel

instagram.com
1
3
648
the face you make when inflicting existential dread onto the audience
Image from Reuben Stern (@ReubenConducts)
1
1
97
for those who don't know, i was (and still am!) a professional conductor long before i became a kernel engineer
1
31
thinking of the cheekiest exposition i snuck into a paper
Image from Reuben Stern (@ReubenConducts)
2
1
20
4,124
and my favorite observation due to all the cats
Image from Reuben Stern (@ReubenConducts)
2
2
495
and the diagram we lovingly call "the big triangle"
Image from Reuben Stern (@ReubenConducts)
3
388
kimi K3.1 is just a post-train of K3? damn, was kinda hoping they'd make kernel engineers' lives more interesting
4
17
2,545
though tbf i think k3 is one of the prettiest architectures out there—make your MLA sparse and it'll be immaculate!
4
254
the CPU is a megakernel
Mark Saroufim (@marksaroufim) profile pictureMark Saroufim
@marksaroufimAug 16
The megakernel literature, summarized
Image from Mark Saroufim (@marksaroufim)
1
10
427
since it seems like many people share my indolence, who wants to have an "i was too lazy to go to san jose for pytorch con" meetup in SF wednesday night?
1
5
267
linear attention variants, though challenging, are really pretty and rewarding to work on kernel-wise. please keep them coming! (delta rule variants in particular)
1
1
7
647
the fact that you can't use both 2-cta and 1-cta tcgen05 mma instructions in the same kernel is truly one of the most baffling and frustrating limitations of blackwell
6
1
1
32
4,217
NVL72 racks are like narwhals: i've never seen one, so i don't think they exist
7
296
Reuben Stern retweeted
Tinker (@tinkerapi) profile picture
Tinker
@tinkerapiOct 9
Tinkerers have been busy scaling up long-context RL! We’ve made significant improvements to Tinker’s efficiency to support those, and are passing these on with price cuts up to 70%. GLM-5.3-Flash and DeepSeek-v4.1-Flash are also live for cost-efficient long-context work.
Image from Tinker (@tinkerapi)
23
39
17
402
79,674
living the bicoastal life is ping-pong scheduling on a big scale anyway, flying back to SF today -- who wants to make some music (SF orchestra book club!?) or talk kernels?
1
8
303
for reference, orchestra book club is my nonprofit orchestra that does sightreading parties orchestrabookclub.org/

Orchestra Book Club

orchestrabookclub.org
1
112
big fan of driss-bait
driss guessous (@drisspg) profile picturedriss guessous@drisspgSep 21
drisspg.github.io/nuggets/KD… wrote up a new one; lil bit product pitch, lil bit click bait
KDA Doesn't Care About the Future

KDA Doesn't Care About the Future

Where Attention Gym is heading, a future-dependent rounding effect in the chunkwise KDA kernel, and TorchTitan runs asking whether models exploit it.

drisspg.github.io
3
195
as the tech world (and the world world) seems to be imploding in on itself, i'm happy to have music to turn to. time to brush up on my italian!
Image from Reuben Stern (@ReubenConducts)
8
413
Load more