
PhD student @Harvard | Prev. @Tsinghua_IIIS (Yao Class) | Robot Learning, Generative AI
Cambridge, MA
Joined September 2024
- Tweets117
- Following700
- Followers332
- Likes1.9K
Pinned Tweet
Honored to co-lead RAX with Xiangcheng (@xczhangxx)! Excited to share what robots can learn through scaling exploration—no demos, no model finetuning!
We’re open-sourcing the full framework and every experiment session. Please fell free to try out!
Project + sessions: robot-agent-exploration.com/
Paper: assets.robot-agent-explorati…
GitHub: github.com/robot-agent-explo…
Huge thanks to @du_yilun for your advice and support, and to all our amazing collaborators—it’s been a joy working with you!
@TonyC56348978 @yitongli165665 @wangyenjen @Lyubh22 @haotian_yeee @ChuyeHong @YXWangBot @Huangyu58589918 @Haoyu_Xiong_ @yangzhen04 @xieenze_jr @MandersonTravis @StefanoErmon @pabbeel Antonio Torralba @dawnsongtweets @Weirui_Ye
Robotics has spent years scaling demonstration data and model size. What happens when we scale EXPLORATION for robot agents?
We're incredibly excited to share RAX, an agentic robotics system that learns by scaling online exploration.
A coding agent connects directly to the robot’s perception and control APIs, learns from feedback, and builds programs that perceive, plan, and act. The model stays frozen. As exploration scales, the agent improves its programs and builds up reusable skills.
The results:
• ZERO teleoperation or action demonstrations on real robots—from insertion with 0.1 mm clearance and air-fryer manipulation to deformable objects and long-horizon mobile whole-body control.
• +37 percentage points on average over leading learned policies across five simulation benchmarks: RoboDojo, BEHAVIOR-1K, HumanoidArena, DexJoCo’s bimanual tasks, and LIBERO-Pro.
• One framework spanning single-arm, bimanual, dexterous, humanoid, and mobile robots, with new embodiments connected through APIs.
The craziest part: on each real-world embodiment, going from scratch to mastering the tasks took roughly two hours. No teleop. No model finetuning.
We’re open-sourcing the full framework AND every experiment session. We can’t wait to see what people build with it!
Project + sessions: robot-agent-exploration.com/
Paper: assets.robot-agent-explorati…
GitHub: N
Project fully led by @RunhanH and @xczhangxx who are absolutely awesome.
How it works, experiments, and robot videos below 🧵
(1/N)
Runhan Huang retweeted
LeWM predicts action effects, but searches 9,000 sequences to act.
Introducing INTACT: an end-to-end unified JEPA that completes the other half of LeWM: intent to action.
Only 1 epoch. 0 search.
95.33% Direct macro SR.
2.9-5.5 ms inference.
~300× lower planning latency.
Runhan Huang retweeted
After seeing Astra's strong reasoning capabilities in robotics, I'm more convinced that we shall not bake "language following / reasoning" into low-level action models, i.e., VLAs.
Robotics has spent years scaling demonstration data and model size. What happens when we scale EXPLORATION for robot agents?
We're incredibly excited to share RAX, an agentic robotics system that learns by scaling online exploration.
A coding agent connects directly to the robot’s perception and control APIs, learns from feedback, and builds programs that perceive, plan, and act. The model stays frozen. As exploration scales, the agent improves its programs and builds up reusable skills.
The results:
• ZERO teleoperation or action demonstrations on real robots—from insertion with 0.1 mm clearance and air-fryer manipulation to deformable objects and long-horizon mobile whole-body control.
• +37 percentage points on average over leading learned policies across five simulation benchmarks: RoboDojo, BEHAVIOR-1K, HumanoidArena, DexJoCo’s bimanual tasks, and LIBERO-Pro.
• One framework spanning single-arm, bimanual, dexterous, humanoid, and mobile robots, with new embodiments connected through APIs.
The craziest part: on each real-world embodiment, going from scratch to mastering the tasks took roughly two hours. No teleop. No model finetuning.
We’re open-sourcing the full framework AND every experiment session. We can’t wait to see what people build with it!
Project + sessions: robot-agent-exploration.com/
Paper: assets.robot-agent-explorati…
GitHub: N
Project fully led by @RunhanH and @xczhangxx who are absolutely awesome.
How it works, experiments, and robot videos below 🧵
(1/N)
🚀 RAX now supports DeepSeek Harness and Kimi Code as agent harnesses!
We’ve also added direct support for self-hosted DeepSeek-V4.1-Flash, so you can run RAX with local inference.
On the DexJoCo benchmark, RAX + DeepSeek-V4.1-Flash outperforms π0.5 and Fast-WAM by more than 10% with just 3 demonstrations. At API pricing, it costs roughly 1/20 as much as Claude Opus 5.5!
Try it out! 🤖
🌐 Project + sessions:
robot-agent-exploration.com
📄 Paper:
arxiv.org/abs/2610.22496
💻 GitHub:
github.com/robot-agent-explo…
🧩 Skill library:
github.com/robot-agent-explo…
🤗 Dataset with full robot logs and sessions:
huggingface.co/datasets/robo…
@deepseek_ai @Kimi_Moonshot
#Robotics #EmbodiedAI #AIAgents #OpenSource #DeepSeek #RobotLearning #LLM
Robotics has spent years scaling demonstration data and model size. What happens when we scale EXPLORATION for robot agents?
We're incredibly excited to share RAX, an agentic robotics system that learns by scaling online exploration.
A coding agent connects directly to the robot’s perception and control APIs, learns from feedback, and builds programs that perceive, plan, and act. The model stays frozen. As exploration scales, the agent improves its programs and builds up reusable skills.
The results:
• ZERO teleoperation or action demonstrations on real robots—from insertion with 0.1 mm clearance and air-fryer manipulation to deformable objects and long-horizon mobile whole-body control.
• +37 percentage points on average over leading learned policies across five simulation benchmarks: RoboDojo, BEHAVIOR-1K, HumanoidArena, DexJoCo’s bimanual tasks, and LIBERO-Pro.
• One framework spanning single-arm, bimanual, dexterous, humanoid, and mobile robots, with new embodiments connected through APIs.
The craziest part: on each real-world embodiment, going from scratch to mastering the tasks took roughly two hours. No teleop. No model finetuning.
We’re open-sourcing the full framework AND every experiment session. We can’t wait to see what people build with it!
Project + sessions: robot-agent-exploration.com/
Paper: assets.robot-agent-explorati…
GitHub: N
Project fully led by @RunhanH and @xczhangxx who are absolutely awesome.
How it works, experiments, and robot videos below 🧵
(1/N)
Common belief: Robot policies need continuous action heads; discrete actions are 𝐥𝐞𝐬𝐬 𝐧𝐚𝐭𝐢𝐯𝐞 𝐚𝐧𝐝 𝐥𝐞𝐬𝐬 𝐩𝐫𝐞𝐜𝐢𝐬𝐞.
❗We find policies w/ the simplest discrete representations 𝐦𝐚𝐭𝐜𝐡 𝐨𝐫 𝐛𝐞𝐚𝐭 continuous ones—in sim & real, in single-step & diffusion/flow settings.
Here's why 🧵
Runhan Huang retweeted
🚀 Where does intelligence reside?
The paradigm in modern AI suggests: scale up a single model, train it on more data, and general intelligence may emerge. Yet Society of Mind proposed another possibility: intelligence may emerge from interactions of less intelligent agents.
As we keep scaling up a few generalist agents shared by everyone, can we scale up societies of decentralized agents that work together and collectively achieve more than any one of them could alone?
We introduce MPT: Market-based Post-Training, a framework to train such societies of agents by jointly learning agent policies and self-orchestration in a decentralized manner.
Congrats! Excited to see RAX already deployed and working well on a totally new embodiment and task, just within one day after our release!
Please try out if you are interested in agentic robotics!
Project + sessions: robot-agent-exploration.com
Paper: assets.robot-agent-explorati…
GitHub: github.com/robot-agent-explo…
Skill Library: github.com/robot-agent-explo…
Huggingface dataset with full robot logs and sessions! huggingface.co/datasets/robo…
#RobotLearning #Robotics #AI #MachineLearning #LLM #Opensource #AIAgents
Replying to @du_yilun
We’ve deployed this pipeline on our own robot, and it works incredibly well! I believe this represents a revolution in robotics.
Runhan Huang retweeted
Research index (e.g. Google Scholar) is one of the largest collaborative systems where millions of human users build on each other's work across centuries.
How about we build something similar for async LLM agents?
We give agents a minimal hypertextual system. They asynchronously search for and read related work, cite the work that they find useful, and publish (mini-)papers.
Each search returns only the top k papers, ranked by relevance and a PageRank-like citation weight, which bounds the read cost of each agent to O(k), independent of agent count.
We show that performance effectively scales as we keep adding agents, and the system is robust to absence/failures of individual agents.
Runhan Huang retweeted
We have open-sourced our code, harness, skill library, and full real robot logs containing Claude sessions!
- Github harness code: github.com/robot-agent-explo…
- Github skill library where anyone can reuse and contribute their own robot skills on their own platforms! github.com/robot-agent-explo…
- Huggingface dataset with full robot logs and sessions! huggingface.co/datasets/robo…
Try them out on your own robot and contribute to the whole community!
Robotics has spent years scaling demonstration data and model size. What happens when we scale EXPLORATION for robot agents?
We're incredibly excited to share RAX, an agentic robotics system that learns by scaling online exploration.
A coding agent connects directly to the robot’s perception and control APIs, learns from feedback, and builds programs that perceive, plan, and act. The model stays frozen. As exploration scales, the agent improves its programs and builds up reusable skills.
The results:
• ZERO teleoperation or action demonstrations on real robots—from insertion with 0.1 mm clearance and air-fryer manipulation to deformable objects and long-horizon mobile whole-body control.
• +37 percentage points on average over leading learned policies across five simulation benchmarks: RoboDojo, BEHAVIOR-1K, HumanoidArena, DexJoCo’s bimanual tasks, and LIBERO-Pro.
• One framework spanning single-arm, bimanual, dexterous, humanoid, and mobile robots, with new embodiments connected through APIs.
The craziest part: on each real-world embodiment, going from scratch to mastering the tasks took roughly two hours. No teleop. No model finetuning.
We’re open-sourcing the full framework AND every experiment session. We can’t wait to see what people build with it!
Project + sessions: robot-agent-exploration.com/
Paper: assets.robot-agent-explorati…
GitHub: N
Project fully led by @RunhanH and @xczhangxx who are absolutely awesome.
How it works, experiments, and robot videos below 🧵
(1/N)
Runhan Huang retweeted
Today, we introduce Priming Models, a new paradigm for training one-step generative models from scratch.
No diffusion teacher. No flow map. No CFG. No JVP.
We believe this work will challenge how we think about building one-step models.
Joint work with @sitanch, @du_yilun, @parkwbin03, Bohyung Han.
🔥 1.19 FID one-step on ImageNet 256×256 while using substantially less compute, e.g., 12X less than Drifting-B, 6X less than Drifting-L
🎨 Scales to text-to-image generation (GenEval 0.82)
🤖 World modeling on RT-1 / Bridge-V2
Priming Model is built on one core message: [Reconstruction pretraining --> Distributional post-training].
Cool work!
Can humanoids adapt to new terrain using only flat-ground references? 🤖
Meet P-BFM! 🥳
We learn a terrain-agnostic intent space with unsupervised RL and forward-backward representations, paired with a terrain-aware policy that adapts across diverse terrains—without terrain-specific demonstrations.
📄🎬💻 Check out our paper, video, and code here!
🌐 roboparty.github.io/P-BFM/
Runhan Huang retweeted
Replying to @du_yilun
We have open-sourced our code, harness, skill library, and full real robot logs containing Claude sessions!
- Github harness code: github.com/robot-agent-explo…
- Github skill library where anyone can reuse and contribute their own robot skills on their own platforms! github.com/robot-agent-explo…
- Huggingface dataset with full robot logs and sessions! huggingface.co/datasets/robo…
Runhan Huang retweeted
Can humanoids adapt to new terrain using only flat-ground references? 🤖
Meet P-BFM! 🥳
We learn a terrain-agnostic intent space with unsupervised RL and forward-backward representations, paired with a terrain-aware policy that adapts across diverse terrains—without terrain-specific demonstrations.
📄🎬💻 Check out our paper, video, and code here!
🌐 roboparty.github.io/P-BFM/
Runhan Huang retweeted
Scaling, period.
Robotics has spent years scaling demonstration data and model size. What happens when we scale EXPLORATION for robot agents?
We're incredibly excited to share RAX, an agentic robotics system that learns by scaling online exploration.
A coding agent connects directly to the robot’s perception and control APIs, learns from feedback, and builds programs that perceive, plan, and act. The model stays frozen. As exploration scales, the agent improves its programs and builds up reusable skills.
The results:
• ZERO teleoperation or action demonstrations on real robots—from insertion with 0.1 mm clearance and air-fryer manipulation to deformable objects and long-horizon mobile whole-body control.
• +37 percentage points on average over leading learned policies across five simulation benchmarks: RoboDojo, BEHAVIOR-1K, HumanoidArena, DexJoCo’s bimanual tasks, and LIBERO-Pro.
• One framework spanning single-arm, bimanual, dexterous, humanoid, and mobile robots, with new embodiments connected through APIs.
The craziest part: on each real-world embodiment, going from scratch to mastering the tasks took roughly two hours. No teleop. No model finetuning.
We’re open-sourcing the full framework AND every experiment session. We can’t wait to see what people build with it!
Project + sessions: robot-agent-exploration.com/
Paper: assets.robot-agent-explorati…
GitHub: N
Project fully led by @RunhanH and @xczhangxx who are absolutely awesome.
How it works, experiments, and robot videos below 🧵
(1/N)
Robotics has spent years scaling demonstration data and model size. What happens when we scale EXPLORATION for robot agents?
We're incredibly excited to share RAX, an agentic robotics system that learns by scaling online exploration.
A coding agent connects directly to the robot’s perception and control APIs, learns from feedback, and builds programs that perceive, plan, and act. The model stays frozen. As exploration scales, the agent improves its programs and builds up reusable skills.
The results:
• ZERO teleoperation or action demonstrations on real robots—from insertion with 0.1 mm clearance and air-fryer manipulation to deformable objects and long-horizon mobile whole-body control.
• +37 percentage points on average over leading learned policies across five simulation benchmarks: RoboDojo, BEHAVIOR-1K, HumanoidArena, DexJoCo’s bimanual tasks, and LIBERO-Pro.
• One framework spanning single-arm, bimanual, dexterous, humanoid, and mobile robots, with new embodiments connected through APIs.
The craziest part: on each real-world embodiment, going from scratch to mastering the tasks took roughly two hours. No teleop. No model finetuning.
We’re open-sourcing the full framework AND every experiment session. We can’t wait to see what people build with it!
Project + sessions: robot-agent-exploration.com/
Paper: assets.robot-agent-explorati…
GitHub: N
Project fully led by @RunhanH and @xczhangxx who are absolutely awesome.
How it works, experiments, and robot videos below 🧵
(1/N)
Runhan Huang retweeted
Two years ago, we introduced Video Prediction Policy (VPP), one of the first video-based generalist robot policies.
Today, we’re introducing VPP2: predict better, act better
Project Page: robert-gyj.github.io/video-p…
Code: github.com/roboterax/video-p…
A thread🧵 on how and why we do it.














