Zu (@zuwang95) header
Zu (@zuwang95) profile picture

learning representations at Genesis. Build by humans, for humans.

Bay Area, CA
Joined December 2022
Photo by Zu (@zuwang95)Photo by Zu (@zuwang95)Photo by Zu (@zuwang95)Photo by Zu (@zuwang95)Photo by Zu (@zuwang95)Photo by Zu (@zuwang95)
Two years ago, we released Genesis, a universal physics engine for robotics. Today, I’m excited to announce 🍎 Eden — a robot learning framework built from the ground up for agents, unleashing full potential of Genesis. One task definition. From simulation to real robots. Sim-to-sim and sim-to-real just got easier. Coding agents build tasks 1.6–4× faster than in Isaac Lab. 🧵 1/11
48
145
33
775
125,502
Robots need to feel where they touch and how forces change. Introducing PanoTac: an open-source, dense 3D tactile sensor for <$10 USD. Watch as the robot racks a test tube and pulls the stopper: PanoTac tells the tube orientation, and feels when the stopper comes free. 🧵
6
15
1
112
5,943
Zu retweeted
I won’t make it to CoRL this year, but our robot peeling work will be presented at Monday’s poster session! Paper, code and data are fully updated: toruowo.github.io/peel/ This work is almost a year old, and a lot has happened since. I checked this afternoon, and was relieved to find that peeling potato with a knife still isn’t something that Astra can do out of the box (yet)! Anyways, most publications eventually become obsolete as new advances emerge, and AI is accelerating that cycle. While the specific methods used in this work might not last, I hope the idea does: a robot policy shouldn’t just get the task done, but also do it the way people prefer. How to incorporate human preferences into robot policies still feels underexplored, and I’m excited to see more work in this direction. For any related discussion or follow-up, feel free to reach me by email :)
Peeling a potato is trivial -- until you try to make a robot do it with a knife. This is actually one of the hardest problems in manipulation: contact-rich, force-sensitive, and success is subjective. We taught a robot arm to peel with >90% success :D toruowo.github.io/peel
6
5
1
84
4,832
I believe that we are entering an era of abundant robot data. Therefore, the story of finetuning large pretrained video models as robot world models is the story of the past. We should discover the optimal architecture and training recipe for scaling world model training on robot-native datasets. @_YimingDou and I have been validating this belief at Amazon FAR and have obtained some preliminary success. Proud to share this work with everyone!
Introducing DreamFAR, a world model trained from scratch using only robot data, without internet pretraining. It supports: 🎮 Real-time teleoperation ⏱️ Minutes of long-horizon rollout 🧩 Generalization across 1,000+ tasks yimingdou.com/DreamFAR 🧵 (1/8)
6
10
1
110
9,435
. @ToruO_O also is a great and authentic writer on other platforms and have great artistic taste too :) “choosing and defining the right problems, and exercising judgment about what the results actually mean. But then, that high-level taste and judgment don't just come from nowhere. In the past, it was precisely through the mundane trial and error -- the very process that is being automated away today -- that researchers developed the so-called "scientific taste".”
How should we approach research, when the very field we work on is going through rapid and potentially fundamental changes? I recently gave a talk at the Stanford Vision Seminar, reflecting on my PhD journey and how AI is changing the way I think about research. I adapted part of it into a new blog post, organized around three questions: 1. What should we work on? 2. How should we work with AI? 3. What is a PhD for? I hope some of my reflections are helpful. The talk ended with an open discussion, and I’d love to continue it here; curious how others are thinking about these questions. Personally -- as much as there's FOMO, I also think life is very long, and we have time. toruowo.github.io/blog/posts…
1
1
6
1,397
Zu retweeted
How should we approach research, when the very field we work on is going through rapid and potentially fundamental changes? I recently gave a talk at the Stanford Vision Seminar, reflecting on my PhD journey and how AI is changing the way I think about research. I adapted part of it into a new blog post, organized around three questions: 1. What should we work on? 2. How should we work with AI? 3. What is a PhD for? I hope some of my reflections are helpful. The talk ended with an open discussion, and I’d love to continue it here; curious how others are thinking about these questions. Personally -- as much as there's FOMO, I also think life is very long, and we have time. toruowo.github.io/blog/posts…
13
85
15
587
66,976
Introducing Kimi K3.1 Pro: our most capable 3T-class open-weight model. 🔹 1M-token context, 2.8T total / 104B active params (MoE), Multimodal. 🔹 Full-project coding: games in Unreal, Unity & Godot. 🔹 Excels at parametric 3D modeling in Blender & CAD. 🔹 More reliable at finance work: Accurate modeling with hallucination down by 65%. 🔹 Matching the strongest proprietary models across coding, agentic and knowledge benchmarks. Kimi K3.1 Pro and K3.1 Pro Highspeed (2–3× faster) are now live on Kimi.ai, Kimi Work, Kimi Code, and the Kimi API. Open weights by Nov 4, 2026. 🔗 API: platform.kimi.ai 🔗 Tech blog: kimi.ai/blog/kimi-k3-1-pro
1,302
3,242
2,385
30,305
4,310,173
Zu retweeted
i love writing. i never let agents write for me. whether it's docs, or tweets, or shitposts, or even prompts (okay maybe that one's harder as agents manage other agents) there's a simple reason for that: i still strongly believe that writing is thinking. it's a skill i hope to never give up. it's also important to me that whatever i say is always authentic, mistakes and all. my favorite posts are the ones that i just full send without any editing i suspect it also helps with prompting. being able to clearly express what i want, and knowing the vocabulary i need to be able to direct my agents does seem to make for more effective usage of agents. in the same way that engineers have an advantage when we prompt agents to write code, because we are intimately familiar with the words that make up the discipline knowing the right word incantations to get an agent to produce a desired goal almost feels like spellcasting. as models get more capable, and that input box looks more and more like a magic box that can output anything, words become the interface between you and the genie there may come a time when we give up the keyboard in exchange for brain-computer interfaces. but until then, i'm writing every word.
501
564
211
8,451
432,654
Zu retweeted
See you soon for more ships from The Ship Company.
323
169
163
6,048
645,022
Perhaps counterintuitive, but this is fundamentally true. IK is built on a simple model of the arm and doesn’t account for things like friction, arm dynamics, environment. With RL you can get reactivity, distill to choose the right IK branches to avoid singularities. Bitter lesson much?
Any online optimization (IK, ID, MPC) for low-level control should be abandoned. A RL policy can fundamentally track more precisely, more robustly, and adaptively to unknown disturbances and uncharacterized noise, especially for low-cost hardware, even on a manipulator.
2
32
3,583
Being a kid (or a parent) in the age of @specs 🧑‍🔬 Made with @OpenAI Astra + Lens Studio.
65
133
27
1,291
152,669
ICYMI: General-purpose robots won’t be solved by AI models alone. The full stack has to work together. At #Actuate26, @gs_ai_ Co-Founder @theo_gervet shared why solving robotics means co-designing models, data, simulation, hardware, and control as one system. Full talk: youtube.com/watch?v=LFHW50ju…
2
3
8
2,337
This makes sense given that NYU has the max venn intersection of top Math and top AI people. @thegautamkamath any “interesting” comments made during this talk?
NYU Courant professor Tristan Buckmaster, of Navier-Stokes drama fame, gave a talk at the new NYU Mathematics in the Age of AI seminar series. It was... popular.
1
7
54
11,451
John Schulman (co-founder of Thinking Machines and OpenAI) wrote that goal-driven research beats idea-driven research. I realized it's also really good life advice. Don't chase what other people are doing. Figure out what life you want, and then figure out how to get there.
20
96
14
1,474
94,247
not now honey, I'm doing frontier AI research
46
109
18
1,917
103,159
unfortunately i contacted them on the night of wednesday, september 2nd making the following points 1. i had intel they had information about math work i was doing and a few days before they had spun up a group to try to compete. 2. i emphasized and reemphasized mine was a strictly personal mathematical collaboration 3. that this was a collaboration that had been going on for a year 4. that in my personal collaboration we were happy users of codex as well as obviously claude (and i later complimented astra explicitly after it came out for its help, and reassured i would obviously be sprinkling acknowledgments for it, previous models, and codex liberally in the writeups) 5. that it would look terrible if openai were competing against mathematician consumers, and my collaborator (Tristan) wanted to email about this explicitly 6. that i expected none but in the worst case intended to refuse marketing around the result we were working towards, being the fruit of a personal external academic collaboration, and wanted to express this because i figured worries about such marketing by their leadership was why a team was spun up to extraordinarily directly compete. sebastien and i have in the past months had our fun pushing each other on twitter, but as i process it all i keep feeling bad about Tristan. 1. neither of us could sleep Sunday night, so we went on a walk around the city. i finally asked him why fluids, and he told me it was the navier-stokes problem. he told me parts of the story about his classic nonuniqueness result with Vicol i hadn’t heard yet, and also about how he too grew up writing shaders as a kid and then switched to math 2. tristan is a mathematician’s mathematician. he kept rock solid to his principles during the tense calls and negotiations, immediately turning down a career dream and million dollar prize for me, the sort of strange excited unclear-quasiuseful confused idiot in our collaboration. fifteen minutes later, his feet were up on his desk with three toes per foot peeking out of ripped socks 3. our periodic call after i’d texted him euler blowup was just laughing for an hour or two. just laughing. i’d seen fable deal correctly with monge ampere in the equality case of ehrhart’s conjecture, so in some call before that i’d really pushed him for the craziest shit he could think of that i might try. i texted him the pdf as an update on that “diego luis 3” line, in which following his incredible expression of intuition i hodgepodge slapped together a bunch of our recent work, in particular correcting a bunch of better and lesser known papers in the literature, as well as on diego and luis’ ipm paper, and hoped an analogous construction for boussinesq (thus axisym euler) might work out. i managed to wade through enough confusion to insist to the model it stop telling me stupid regularity stuff about kelvin waves, and a rayleigh-taylor ansatz stuck. like i said, just laughing. when i texted him the pdf, the worst thing either of us had seen so far, i didn’t even comment on the euler blowup claim, only explaining why skepticism should remain for boussinesq, because i found it so shocking. i mean what the hell did i know, i must’ve confused myself by misunderstanding one adjective like i was used to with algebraic geometry. im so lucky to have been able to live that 4. he managed all this this entire time with unclear sleep, timestamps continue to amaze me, due to just recently having a kid it is obvious he deserves the same sort of praise he heaped upon luis, perhaps mutatis mutandis:)
Replying to @__alpoge__
nothing at all was locked we were just willing to talk but you didn't talk to us ... sorry but that's just untrue, we were willing to go above and beyond and have as many discussions as you would have liked to reach resolution.
136
546
88
6,213
722,435
Recently, there have been a lot of impressive demos of AI agents, like Claude, controlling robots. I wrote a short blog post with my thoughts on the advent of these "robot-use agents." web.mit.edu/phillipi/www/wri… I think it's an important change in the trajectory of robotics!
44
112
45
757
208,089
Zu retweeted
Congrats @micoolcho @chris_j_paxton @DJiafei and thanks for having me as the #3 guest! Was fun chatting about sim-to-real dexterous manipulation 😄 Amazing to see how much the AI robotics community has grown since then. Look forward to the next 100 episodes!
We've hit 100 episodes! Here's a look back on our journey so far (website with some stats): robopapers100.com/ Some highlights in the thread 🧵:
4
6
50
7,830
Today we sharing Atlas, our new multimodal world model. One reason this model is so special to me is that it combines two core visual intelligence tasks I have worked on for over a decade: generation and reconstruction
Introducing Atlas: The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D. Model the world, move the camera, and simulate space & time.
28
50
7
628
80,351