Software engineer exploring computer graphics and design tools. UI, math & physics

Tokyo
Joined January 2017
Aung Kyaw Soe (AK) retweeted
The prompt was "look at this [x post*], what is that, go fetch all specs in the internet, use classcad.ai mcp, model it" The result is live here → buerligons.io It is fully parametric. The ASM uses mate & gear constraints. *Had a screenshot of this thing
13
17
3
236
11,181
Aung Kyaw Soe (AK) retweeted
My dear friends, I’d like to show you my latest toy project Introducing Handwired: turn your regular JavaScript code into a neural net! - no training - exact outputs vs the JS program - fully differentiable All runnable in a browser, without GPU
454
1,013
464
11,320
1,446,835
Aung Kyaw Soe (AK) retweeted
We officially release smlibpy open source. A python API for the smlib nurbs kernel (inspired by cad-query, build123d & classcad). A wasm compile for javascript/ts (1.8mb dl/brotli total). And a MCP for agents. → smlibpy.classcad.ch → github.com/awv-informatik/sm… Thread ⤵
20
38
13
396
26,734
Aung Kyaw Soe (AK) retweeted
After six years in stealth, Atomic Machines is out. Our mission: on-demand, universal command of matter. First beachhead: the Matter Compiler, an AI-native manufacturing system that builds working micro-machines from code alone. No per-product tooling. No process development. Different code, different machine.
784
2,265
920
18,256
3,035,625
Aung Kyaw Soe (AK) retweeted
I've started a new company: @superlogical! We're going to begin by building a terminal multiplexer. The entire vision is much larger, but the multiplexer is the foundation. Sign up for the newsletter to get beta access and devlogs (product updates only I promise). superlogical.com/
551
519
233
9,150
1,189,878
Aung Kyaw Soe (AK) retweeted
Finally, the X Cheat Sheet is ready to launch! 🔥 And I decided to share this for free!! I poured 6 hours into this and am excited to share it. It contains all the strategies I used to gain 1,000 followers in just 15 days. When I started, I opened a $20 waitlist and 82 people signed up! If everyone bought it, that would’ve been $1,600, but I’ve decided to give it away for free. I’ve grown this fast thanks to your amazing support, and I want to pay it forward. No need to pay $20. Just follow, repost, and comment. I’ll DM you the Notion page link! Thank you for being on this journey with me. Let’s keep growing together! 🚀
709
431
34
794
104,712
Aung Kyaw Soe (AK) retweeted
Just learned that tensors go beyond 2D: scalars → vectors → matrices → tensors but we manipulate them in 2D 2D seems like a sweet spot? I mean we seem to be wired for 2D for best insights, we flatten things: terrain → maps hierarchies → trees 3D worlds → screens
1
1
113
Aung Kyaw Soe (AK) retweeted
Excited to release new repo: nanochat! (it's among the most unhinged I've written). Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single, dependency-minimal codebase. You boot up a cloud GPU box, run a single script and in as little as 4 hours later you can talk to your own LLM in a ChatGPT-like web UI. It weighs ~8,000 lines of imo quite clean code to: - Train the tokenizer using a new Rust implementation - Pretrain a Transformer LLM on FineWeb, evaluate CORE score across a number of metrics - Midtrain on user-assistant conversations from SmolTalk, multiple choice questions, tool use. - SFT, evaluate the chat model on world knowledge multiple choice (ARC-E/C, MMLU), math (GSM8K), code (HumanEval) - RL the model optionally on GSM8K with "GRPO" - Efficient inference the model in an Engine with KV cache, simple prefill/decode, tool use (Python interpreter in a lightweight sandbox), talk to it over CLI or ChatGPT-like WebUI. - Write a single markdown report card, summarizing and gamifying the whole thing. Even for as low as ~$100 in cost (~4 hours on an 8XH100 node), you can train a little ChatGPT clone that you can kind of talk to, and which can write stories/poems, answer simple questions. About ~12 hours surpasses GPT-2 CORE metric. As you further scale up towards ~$1000 (~41.6 hours of training), it quickly becomes a lot more coherent and can solve simple math/code problems and take multiple choice tests. E.g. a depth 30 model trained for 24 hours (this is about equal to FLOPs of GPT-3 Small 125M and 1/1000th of GPT-3) gets into 40s on MMLU and 70s on ARC-Easy, 20s on GSM8K, etc. My goal is to get the full "strong baseline" stack into one cohesive, minimal, readable, hackable, maximally forkable repo. nanochat will be the capstone project of LLM101n (which is still being developed). I think it also has potential to grow into a research harness, or a benchmark, similar to nanoGPT before it. It is by no means finished, tuned or optimized (actually I think there's likely quite a bit of low-hanging fruit), but I think it's at a place where the overall skeleton is ok enough that it can go up on GitHub where all the parts of it can be improved. Link to repo and a detailed walkthrough of the nanochat speedrun is in the reply.
673
3,311
731
23,946
5,822,587
Aung Kyaw Soe (AK) retweeted
Replying to @ChadNauseam
Compared popular calculators. I think numbat is almost perfect! Btwn, I'm working on a computational notepad and this thread is fascinating!
1
96
Aung Kyaw Soe (AK) retweeted
in a world where new ui can be generated in real time
40
80
17
2,244
170,714
Aung Kyaw Soe (AK) retweeted
if you could press a button that cures your child’s brain tumor in exchange for ending your life immediately, every parent would hesitate for zero seconds before fighting to be the first to press it the cruelest thing is that no such button exists. but there is always a move 👇
566
2,515
310
19,652
3,451,487
Aung Kyaw Soe (AK) retweeted
I had an idea in college which I've long thought could be, in many ways, the ultimate BCI technology. What if instead of using electrodes, we used biological neurons embedded in electronics to communicate with the brain? Enter biohybrid neural interfaces: science.xyz/news/biohybrid-n…
50
115
38
800
178,889
Aung Kyaw Soe (AK) retweeted
★ Dynamicland's new website documents ten years of progress toward a humane dynamic medium. dynamicland.org
23
197
72
821
190,238
Aung Kyaw Soe (AK) retweeted
Dynamicland's new documentation space will go online on Sept 4. As a prelude, here is a video about Dynamicland's precursor. youtube.com/watch?v=uI7J3II5…
14
87
31
407
42,999
Aung Kyaw Soe (AK) retweeted
Dynamicland's new website, documenting ten years of work, will be released tomorrow at dynamicland.org. In the meantime, this video about Dynamicland's precursor gives some backstory and motivations. youtube.com/watch?v=uI7J3II5…
12
99
17
576
42,671
Aung Kyaw Soe (AK) retweeted
I rewrote my thread from yesterday for better clarity and readability. Every two years, the idea of creating a new CAD kernel resurfaces, but these teams always fail (at least since 1984) - even though it would be great if they succeeded. Here's how I would think about developing a "new" geometry kernel. 👇 The main issue is that these teams approach the problem from the technology's perspective, rather than focusing on the customer's workflow. B-rep is designed to implement workflows, and thanks to the maturity of current b-rep kernels (especially Parasolid), any customer workflow that can be solved using b-rep can be already handled by these kernels exceptionally well. When I say exceptionally well, I mean pretty damn well. There's no potential for a 10x improvement here. Sure, you could make it a bit more robust or a little faster, but you won't achieve a 10x improvement in b-rep workflows due to the maturity of the existing kernels. The biggest issues with b-rep workflows today come come from applications that are built on the top of the kernels, and not from the kernels. That being said, to figure out what the next geometry kernel should look like, it's essential to identify the workflows that are highly valuable but can't be handled well by b-rep. It's also worth noting that b-rep has some excellent properties, such as parametric surfaces and topology. Topology is especially great because humans easily understand the concepts of faces and edges. Developing a new kernel can't happen outside the existing ecosystem. Even if the new kernel uses a different representation, it must be somehow compatible with b-rep. Otherwise, adoption will be challenging. B-rep is the standard protocol for all workflows today. If you want to solve all the b-rep workflows and even more to disrupt the b-rep world, you need something truly novel that resembles b-rep but isn't b-rep. One of the biggest flaws to eliminate is the double bookkeeping intrinsic to b-rep. Since b-rep works with tolerances, the geometry and topology data are somewhat independent, requiring handling an endless amount of corner cases and inconsistencies that are the inevitable by-product of b-rep operations. This double bookkeeping is at the root of many b-rep problems. You should look for a geometry representation that eliminates this issue. Implicits could be a great option, and @nTopology has done excellent work pioneering this technology. If we could somehow add topology to implicits, it could be a strong candidate for a next-generation kernel. You'd have infinite resolution, topology, the ability to run it directly on GPUs, real-time functionality, and extreme accuracy. There are, of course, countless reasons to write another b-rep kernel: it's fun (I'd do it for fun!), legal considerations, etc. But for a real breakthrough, we need to focus on workflows and figure out how to build a better geometry tech stack to support more workflows. Despite this, I'm rooting for everyone aiming to improve the world of computational geometry. However, I believe we should set more ambitious goals than just creating another b-rep kernel.
9
9
1
50
12,089
Aung Kyaw Soe (AK) retweeted
I just finished my first article for @elicitorg as their “internal journalist” Aiming to publicly document the impressive work this team is doing!
9
26
7
182
55,043