adam (@solarecho3) header
adam (@solarecho3) profile picture

soldier, cto

Joined January 2022
Photo by adam (@solarecho3)Photo by adam (@solarecho3)Photo by adam (@solarecho3)Photo by adam (@solarecho3)Photo by adam (@solarecho3)Photo by adam (@solarecho3)Photo by adam (@solarecho3)Photo by adam (@solarecho3)Photo by adam (@solarecho3)Photo by adam (@solarecho3)
I printed my town. USGS 3DEP 1 meter bare-earth digital elevation model. 2,600 x 1,596 meters. ~200 meters of elevation.
2
2
62
Can the singularity survive the civilizational great filter?
1
33
Progressive 2d fft focusing of raw umbraspace sar compensated phase history using python🐍. The earliest frames show sinc/Fresnel ripples before the radar accumulated enough energy to form an image. I noticed it looked like the fft of a linear chirp.
44
progressively processed synthetic aperture radar image from umbraspace odc
1
2
106
nanogpt by @karpathy on webgpu generating QKV vectors while it streams i can inspect any query, key, or value, swap layers, and heads
54
nanogpt by @karpathy generating QKV vectors while it streams inference is in the browser
40
Most civilizations die around 300 years. Pharaonic Egypt, and Rome are rare outliers. Their natural defenses, internal structures, and no small amount of luck allowed them to pass the filter. America has all the geographic advantages, and its industry is the most powerful ever. But it’s uniquely vulnerable to infiltration, and our immune system has been weakened from within.
1
4
54
wow they did it
1
52
adam retweeted
Mechazilla catches Starship! Congratulations to the entire SpaceX team on this incredible achievement!
6,799
27,375
9,115
141,318
17,694,841
It’s that time of year where I forget where the irrigation main is for 6 months
1
79
Learning with LLMs protip: deep dive a topic until you have a tenuous grasp on it, then instruct the model to quiz you socratically until you understand it. Do this before the compaction window.
2
95
USB-C has 24 pins, and at least 12 different ways to take them over. DisplayPort, Thunderbolt, an HDMI mode nobody built, a VR standard that died in 2 years, and hidden ones from Apple and Nintendo. Here's which pins each one takes.
22
149
10
1,625
110,681
Kids don’t like reading Shakespeare because it’s presented as a way to learn English. It should be presented as a way to examine the human condition. Shakespeare is meant to be ACTED, not read and memorized like a textbook.
Replying to @luke_winkie
This story also includes quotes from my 7th grade English teacher who changed my life. One of my favorite ever interviews…
1
127
Every day at work I get to see the stars
Replying to @luusssso
Real data, web format. Larx has great engineers.
1
145
18 of the 20 best open models today are Mixture-of-Experts. Dense is basically over. And yet the know-how to train a good MoE still lives mostly in the heads of a handful of teams. So we spent 800k GPU hours running the experiments ourselves and wrote everything down. Super happy to finally release "The Ultimate MoE Training Handbook", free and open, organized around the questions training teams hit: - how many experts, how big, shared or not? - why is half my step spent in all-to-all, and how do I hide it? - why is my run 25x slower with no error in the logs? - softmax, sigmoid or sqrt(softplus) router, and why keep it in fp32? - aux loss or DeepSeek's loss-free bias? - upcycle a dense checkpoint or train from scratch? - can I serve with fewer experts per token than I trained with? ⚠️ Warning: it's long (~70k words, budget a few days, sorry) but with 55 interactive figures, code you can run and numbers from our own runs. Read it here: huggingface.co/spaces/huggin…
139
626
82
4,570
280,947
Replying to @I_am_Bhu_shn
Because time is a product which is also physically represented as expansion, and local expansion due to recurrent structures has the same geometric effect locally experienced as time and gravity.
3
4
48
6,766
On mobile, set it to flat and scrub
I was interested in an absolute scale to measure the morphing ideologies of American politics. @bot mapped elections back to the start, using the political platforms of that election to define one dimension. Scrub in 4D. Mouse for more info. I've not validated each point.
82
I was interested in an absolute scale to measure the morphing ideologies of American politics. @bot mapped elections back to the start, using the political platforms of that election to define one dimension. Scrub in 4D. Mouse for more info. I've not validated each point.
1
1
4
292