jdz (@4thd1m) header
jdz (@4thd1m) profile picture

writing our sicp of deep learning systems at https://teapawt.org/t.co/mZ01Xi1sCl distributed compilers @coinbase, mathematically trained @UWaterloo

a computer in the cloud
Joined April 2024
Photo by jdz (@4thd1m)Photo by jdz (@4thd1m)Photo by jdz (@4thd1m)Photo by jdz (@4thd1m)Photo by jdz (@4thd1m)Photo by jdz (@4thd1m)Photo by jdz (@4thd1m)Photo by jdz (@4thd1m)Photo by jdz (@4thd1m)
the motivation for numerics and determinism via pre-training hero runs seems stronger than temperature=0 inference?
80
hello tensor
1
2
241
borscht slowly coming online. software 2.0 equivalent of acwj :-) github.com/DoctorWkt/acwj
3
194
darn, no python jit. wanted to use the jit in between python and rust. hello pypy..
2
133
what's in a name?
2
240
sensei @karpathy are you selling the microgpt triptych? take my money! want to place it next to the spacex raptor triptych
97
neolab trinitarianism: cartesia, tilde, together
computational trinitarianism: types, propositions, categories pedagogical trinitarianism: language, pedagogy, curriculum
3
391
some rabbit ascii is borscht's little contribution to continuing alan perlis' hope that we never lose our sense of fun mitp-content-server.mit.edu/…
1
4
332
excited if 10-411.com isn't parody, will be a great addition to book.mlc.ai/ the goal of sitp.ai/ is to play the role of a nice bridge the same way sicp's little compiler is :D —i.e, no crazy ssa/son irs, no graph coloring register allocation, etc
3
24
270
10,402
pov: you are gen alpha trying to understand deep learning systems because the generations before you couldn't build agi and you are their only hope
4
17
844
*compile should be "below" Tensor. benefit of working in public is that you can correct your own mistakes 🤡
98
jdz retweeted
internals of FP8 MMA on hopper simonveitner.substack.com/p/…
1
14
153
5,001
OpenAI's Whisper model now fully runs on Magnetron and can be used for real time speech to text: github.com/magnetron-researc… The latest update also introduced an async CPU backend which hides Python latency in heavy workflows by overlapping computation and Python work
3
5
19
891
there is a very exciting opportunity to re-do the classic introduction to proofs that computer science majors take. —instead of the substance of number theory motivated by RSA "do you really want to know how that lock symbol in your browser works?"[0], you just go to straight to algebra and analysis like axler, artin, and tao. this would then segue into upper year courses that focus on interpretability and optimization respectively. grad school is then understanding the millenium proofs xD [0]: cs.uwaterloo.ca/~cbruni/pdfs…
Replying to @srush_nlp
Think it is roughly this much Math.
1
1
22
1,803