Currently JAX & Pallas @GoogleDeepMind 🇨🇭 (prev XLA @Google 🇨🇭🇧🇻, PL PhD @UiB 🇧🇻) | ⚪⚫ Go player, 🇫🇷🥈'25 | Prev CTF @FlatNetworkOrg. Opinions my own

Joined September 2010
Benjamin Chetioui retweeted
Want to improve GPU compute/comms overlap? We just published a new short tutorial for you! A few small changes to the Pallas:MGPU matmul kernel is all it takes to turn it into an all-gather collective matmul that overlaps NVLINK comms with local compute: docs.jax.dev/en/latest/palla…
7
46
1
304
33,788
Benjamin Chetioui retweeted
Replying to @jeremyphoward
We have some Pallas tutorials (docs.jax.dev/en/latest/palla…) and in particular a reference guide for Mosaic GPU (docs.jax.dev/en/latest/palla…). It is of course far from being comprehensive, but we're working on it. If you have questions you should also just reach out and we'll help :)
2
4
2
17
18,825
Benjamin Chetioui retweeted
Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n
25
386
77
1,913
468,401
Benjamin Chetioui retweeted
Finally got around to writing a guide for matrix multiplication on TPUs using Pallas. Check it out! jax.readthedocs.io/en/latest…
1
26
5
155
17,308
Benjamin Chetioui retweeted
As much as I'm personally enjoying the AI ride at the moment, the attacks we are seeing are worryingly familiar web app attacks and one wonders if anyone in the AI world is aware of how you do web app security? Case in point: arxiv.org/abs/2403.06634 A very good paper firstly
3
6
1
26
3,811
Benjamin Chetioui retweeted
Tired of “LLM hacking” hype with no code? Here’s a breath of fresh air. arxiv.org/abs/2402.11814 1. Challenges: open source ✅ 2. Solution framework: open source ✅ If you’re interested in hackbots in offsec and you’re craving something you can RUN, you gotta read this
110
9
230
58,771
High quality steganographers
The Teaser 2024 is over! Congratulations to 🥇 @FlatNetworkOrg, 🥈 @justCatTheFish, 🥉 @hxpctf and everyone else! We hope to see you guys at SwissTech Convention Center in Lausanne. Thanks everyone for participating Insomni'hack Teaser 2024, #INSO24, #CTF
2
22
1,993
Benjamin Chetioui retweeted
Writing is an absolutely critical skill… and one that can be improved dramatically. Doing so requires not just repetitions, but deliberate efforts to improve. Some tips here: docs.google.com/document/d/1…
This quoted post is unavailable.
7
179
9
786
262,310
Benjamin Chetioui retweeted
Not announcing anything publicly yet, but please get in touch with me if you're interested in funded PhD opportunities in applied formal methods. I will make a proper announcement once everything is confirmed, but it would be good to make connections now.
7
32
5,776
Benjamin Chetioui retweeted
"You go into your toolchest and you select, I don't know, that sad excuse for a Scala effect system, for instance, because you're trying to tell the world that you take yourself too seriously to care about monad tutorials or abstract category-theory. [...] And you're also blithely unaware that in 2013, Andrej Bauer demonstrated a collection of effects in Eff, which helped pioneer the idea of using in-language handlers, using Pitts’ theory of minimal invariant relations to prove its core calculus adequate to the task. And then I think it was HOPE, which for years continued to push for non-MTL-based systems of effects. And then handlers started showing up in the effect systems of eight different designers. And then it filtered down, through Ocaml, into the .NET languages and finally over into some tragic open source clearance bin. It's sort of comical how you think that you've made a choice that exempts you from category theory, when in fact you are using the effect system that was selected for you."
we need an FP version of this meme "You think you don't care about monads? I think it was in 2007 that Peyton Jones and Wadler wrote the paper on comprehensions. And that influenced the development of CEs in F#. Which then trickled down to some tragic tutorial you no doubt read"
4
32
4
168
21,289
Benjamin Chetioui retweeted
There's a huge opportunity to use ML to replace hand-written heuristics in compilers. Want to try? Check out this @kaggle contest organized by Ashley Chow, Bryan Perozzi, HCL-Jevster, inversion, Mangpo Phothilimthana, and Sami Abu-El-Haija! kaggle.com/competitions/pred…
8
73
12
467
127,463
Benjamin Chetioui retweeted
You appear to be advocating a new: [ ] dependent [ ] refinement [ ] "functional" type system. Your type system will not work. Here is why it will not work. You appear to believe that: [ ] All code has a precise specification [ ] SAT solving can be fast because P = NP
1
1
8
413
Benjamin Chetioui retweeted
Announcing FlashAttention-2! We released FlashAttention a year ago, making attn 2-4 faster and is now widely used in most LLM libraries. Recently I’ve been working on the next version: 2x faster than v1, 5-9x vs standard attn, reaching 225 TFLOPs/s training speed on A100. 1/
38
633
92
3,264
903,673
Benjamin Chetioui retweeted
I've proven the strangest result of my career.. The classic idea that gradient descent's rate is best with constant stepsizes 1/L is wrong. The idea that we need stepsizes in (0,2/L) for convergence is wrong. Periodic long steps are better, provably. arxiv.org/abs/2307.06324
67
557
92
3,623
681,600
Benjamin Chetioui retweeted
A 14-line Python script using gzip outperforming a 345m parameter transformer model is probably the most hilarious result I've seen all year. aclanthology.org/2023.findin…
65
937
148
6,517
1,398,611
Benjamin Chetioui retweeted
PLDI'23 is proud to announce that it is free and open to virtual attendees. Please see the attendees guide on our webpage for how to participate. Free access is courtesy of our sponsor and those who generously paid $70, our optional virtual contribution. pldi23.sigplan.org/attending…
2
47
1
132
20,618
Benjamin Chetioui retweeted
46
159
15
1,109
155,006
Benjamin Chetioui retweeted
this is how I feel when a program’s output is written like “I could not find the file” instead of “file not found”
130
3,997
307
23,211
801,291