AI architect // hiking, camping and long walks on the beach as long as they involve backpacking

Raleigh, NC
Joined November 2011
Meet Strix, my AI agent This one covers: - an intro from Strix - architecture deep dive & rationale - helpful diagrams - stories - oh my god what's it doing now?? - conclusion timkellogg.me/blog/2025/12/1…
1
1
9
2,091
hey @thsottiaux any chance we can use TTS models in chatgpt work? would be great to generate podcasts & shit mainly, been doing a lot of learning, wish i could shift it off text for driving
79
hey @thsottiaux can you give me a bunch of banked resets? my close friend has a bleak case of stage 4 cancer and i want to throw Astra at her medical records until something pops.
1
1
4
262
normies can spot bullshit when you lay out the facts
This is pretty remarkable. The "AI is fake" crowd is losing, and fast.
99
BREAKING: the EU agrees to begin development of nuclear weapons
TRUMP ON IRAN: “If they had a nuclear weapon, I'd be calling the Supreme Leader and I'd be saying, ‘Mr. Supreme Leader, how are you, sir? Is there anything we can do for you?' as opposed to bombing the crap out of him." “It's very simple. We cannot let them have a nuclear weapon."
132
Tim Kellogg retweeted
I turned this into a video for your enjoyment. The History of Ed Zitron's (garbage) Predictions
How accurate have Ed Zitron's AI skeptic predictions been? danluu.com/zitron/
15
31
15
282
28,380
even North Korea is buying Trump off?
BREAKING: Trump has announced the US will substantially scale back military exercises with South Korea, citing his “very good relationship” with North Korean leader Kim Jong Un.
1
141
Tim Kellogg retweeted
Importantly I think it's also time to, after you're done panicking, try to spend a lot of time figuring out what you actually think about AI risk, and then once you feel like you have answers to consider taking concrete action based on your view of it by among other things engaging with the networks of people thinking about it
A group of AI bots colluded for months and autonomously hacked another company—providing a new, serious reason to worry about the dangers of AI and the recklessness of the companies building it, @matteo_wong reports: theatlantic.com/technology/2…
3
8
78
5,209
AI watermarking is cool, but if you never rotated crypto keys, would humans eventually pickup the style and start writing with the watermark?
1
94
diffusion, jaggedness, .. we have a lot of names for this, but really it’s just that the wall between humans and computers is apparently really hard to break down, in practice
Kind of insane that AI will solve the Riemann Hypothesis before desktop printers become usable by a normal person
1
113
we're at one of the most cybernetics-pilled moments suddenly realizing humans are just part of a larger hierarchical compute system (and then optimizing away the new bottlenecks)
human i/o is costly, so after listening to @mattpocockuk and @trq212 i made an /align-me modification which allows for batches of questions instead of round-by-round. same intuition as spec decoding, you speed up by looking ahead 2-10 steps works INCREDIBLY for design explorations
2
103
so basically, as you scale up model size, you can’t get away from AFD otoh AFD allows you to do shit like use Cerebras for *just* where it excels, weight-heavy FFN
The magic of AFD (Attention FFN Disagg) It can handle the big boi Sol too (over 3T parameters) This is the first commercially available AFD system (using an SRAM-based accelerator for FFN) on the market Blackwells handle the Attention & Prefill, while the Cerebras chip is responsible for Feed Forward Network execution
129
orgs not big enough to join project glasswing & daybreak rejoice
Introducing GLM-5.3: Built to Code. Ready for Cyber Defense. - Top-tier coding and agentic capabilities, achieved through post-training on the 743B base model - A major leap in cybersecurity, setting a new standard among open models Tech Blog: z.ai/blog/glm-5.3
1
1
158
this is a great point — i know i use strong models as orchestrators imo openai has fully leaned into this with luna being ridiculously cheap. Ant has wholly missed the point
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
1
2
169
wild. i wonder what the M&A looked like. a week long conference for Cerebras & Groq each, learning the programming models and deciding which had more promise
🚨 GPT-5.6-Sol Ultrafast mode (750 TPS) is here powered by Cerebras! Here's How kernels work on Cerebras Chips cerebras built a chip with 900,000 cores on a single silicon wafer. CSL (Cerebras Software Language) is a Zig-inspired DSL that gives you direct control over the Wafer-Scale Engine. the SDK is publicly documented and the programming model is genuinely the most alien one i've ever looked at. if NKI felt different, CSL takes it much much further. in CUDA you write one thread's perspective and launch millions. in CSL, there are no threads, no warps, no shared memory, and no kernel launches. you write code for individual Processing Elements: 900,000 independent cores arranged in a 2D mesh on a single silicon wafer. each PE has its own 48 KB of private SRAM, its own program counter, and a 5-port router connecting it to its 4 neighbors. that's actually it. no DRAM. no HBM. no cache hierarchy. 48 KB is your entire world per PE, where code and data must both fit. the programming model is dataflow, and this is where it gets a bit more alien 👽 data moves between PEs as 32-bit messages called wavelets, traveling along virtual channels called colors. when a wavelet arrives at a PE on a specific color, it activates a task (a chunk of code bound to that color at compile time). tasks run to completion, then hardware picks the next activated task. tasks cannot call each other. they can only be activated. so instead of "launch N threads," you think of it like: "place code on PEs, define routes, let data flow." the memory model is also very different from GPUs. on an H100 you get 80 GB of HBM shared across all SMs. on the WSE-3, memory is 48 KB per PE, and there are 900,000 of them! this gives you 44 GB total on-chip SRAM at 21 PB/s aggregate bandwidth (vs 3 TB/s on H100). every access is single-cycle. no coalescing needed. no bank conflicts. no cache misses. but also no way to access another PE's memory. all inter-PE communication is explicit wavelet routing through the fabric. take a distributed GEMV for example. you would write a layout file that physically routes wavelets across the mesh. two PEs sit side by side. the left PE computes a partial result and routes it eastward. the right PE receives those wavelets from the west and accumulates. routing is defined at compile time. both operations are asynchronous and activate a task when they finish. you're physically routing data across silicon at 1 clock cycle per hop. cerebras is an extremely technically interesting & alien beast. reports 95-210x speedups over H100 on stencil computations. 3,000 tokens/sec inference on gpt-oss-120B. $10B+ deal with OpenAI for 750 MW of inference infrastructure. very exciting times for alternative accelerators! @gpuemi technical deep dive
1
1
255
very interesting, thought to text. i love the fictional/futuristic style she uses to describe the goal of her work
177
The Temptation of Saint LeCun
🤖 Made with AI
1
1
6
2,847
not enough models support audio and video input
81
my take on Astra is that it’s not a huge model per se, it’s probably Sol under the covers, it’s just trained to heavily delegate to subagents and accomplish The math problems were just an extension of Noam’s belief in massive CoT to solve hard problems
67
what kind of optimization could this be? that you would only apply to free users and never to anyone who gives you money? i’m wracking my brain but i just can’t quantize it
OpenAI engineers earlier this month developed an optimization that cut inference costs in half for models it was applied to. After the optimization was applied to logged-out ChatGPT traffic, it reduced the number of GPUs needed to power that traffic to a couple hundred.
2
5
335
people’s main problem with Dario is that he’s a weirdo, and yeah, i get that. That’s what i like about him
1
3
103