
Postdoc @UCSanDiego, @mbzuai | working on world models | Previously @CityUHongKong | Visitor @UvA_Amsterdam
Joined November 2016
- Tweets80
- Following737
- Followers374
- Likes5.3K
Fan Feng retweeted
Doing a PhD and interested in World Models?
Come work with me and the Meta FAIR World Model team for a year. Exciting research, hundreds of GPUs and free food are awaiting you.
Fan Feng retweeted
🤖 Understanding what exactly happens during your robot policy deployments is key to improving it. But interpreting raw rollouts is hard because they lack structure.
Introducing Behavior Graphs: turn many rollouts into an interpretable graph of what the policy is doing.
🧵👇
Can contrastive RL, or unsupervised RL more broadly, work for interaction-rich manipulation? We tackle this question both theoretically and algorithmically
Come say hi during Poster Session 1 (📍#138) today at #CoRL2026 today! 👋
Check out our recent paper with Fan Feng @ffeng01 and Caleb Chuck calcharles.github.io/.
We witnessed the success of unsupervised RL on locomotion, but found it hard to learn reusable skills on manipulation tasks. In this paper we dive deep into the mechanism of contrastive RL(CRL) and prove that successor feature(SF) has to memorize the piecewise nonlinearity when there is an interaction, compare to the smooth and linear representation in locomotion.
See the paper and project page for details.
Fan Feng retweeted
Can more pretraining improve a robot policy’s success rate, yet makes it worse for porttraining? 🤔
In our new work, we find that it can. Continued supervised pretraining of generative robot policies can improve reliability at the expense of coverage, and this tradeoff affects downstream posttraining.
Read on to see why this happens and how we can preserve coverage. 1/n 🧵
Fan Feng retweeted
What should a robot remember? Can it learn to remember better than we tell it to?
Excited to share MEMI: Reverse-Engineering What Robots Should Remember
📈 97.0% end-to-end, 99.4% w/ low-level controller on RoboMME, nearly solving it for the first time
🧵👇
Fan Feng retweeted
🚨 Stop feeding your world model the same boring demos. Switch to free-range play data! 🚨
Our CoRL 2026 paper finds we can optimize autonomous data collection to focus on missing action consequences, achieving up to 85x the data scaling efficiency of expert data collection!🧵
Fan Feng retweeted
If video models scale like LLMs, they'll soon generate a perfect video plan for any embodied task. Do we need anything else? Introducing Mirror, which learns to follow these plans just by practicing, and even crafts an iron pickaxe in Minecraft w/o rewards or action labels! (1/n)
Fan Feng retweeted
Why learn everything from scratch when centuries of science have already taught us how the world works?
We’re excited to introduce ReRoute 🔀: bringing what-if reasoning to scientific AI models by combining observational data with partial mechanistic knowledge.
🔥 No controlled intervention data required.
🧵 1/7
Excited to share ReRoute, our new framework for scientific counterfactual prediction: informed by partial physics knowledge for much better generalization. 🌍
AI models can be remarkably accurate on familiar data, yet struggle with scientific ‘what-if’ questions
The key idea: Combine observational data with partial physical knowledge to predict unseen interventions—without requiring new controlled experiments.
Instead of retraining models on expensive new simulations, ReRoute uses known partial physical mechanisms to guide pretrained models through lightweight fine-tuning on existing data.
The results:
🌍 Up to 31.8% lower prediction error under severe CO₂ distribution shifts in climate emulators.
🔬 Up to 89.6% lower counterfactual error in controlled advection–diffusion experiments.
⚡ No new intervention data. No retraining from scratch. Just lightweight fine-tuning.
We also establish a causal identification result under explicit structural assumptions, with a machine-checked proof in Lean.
The bigger picture: Scientific AI doesn't always need more data or bigger models to generalize beyond what it has seen. Sometimes, knowing just a little about how the world works can make a big difference. @Dingling_Yao @kahaan_gandhi @FrancescoLocat8 @Caltech
📄 Paper: arxiv.org/abs/2610.02252
#AIforScience #ScientificML #ClimateAI #CausalInference #PhysicsAI
Robotics has spent years scaling demonstration data and model size. What happens when we scale EXPLORATION for robot agents?
We're incredibly excited to share RAX, an agentic robotics system that learns by scaling online exploration.
A coding agent connects directly to the robot’s perception and control APIs, learns from feedback, and builds programs that perceive, plan, and act. The model stays frozen. As exploration scales, the agent improves its programs and builds up reusable skills.
The results:
• ZERO teleoperation or action demonstrations on real robots—from insertion with 0.1 mm clearance and air-fryer manipulation to deformable objects and long-horizon mobile whole-body control.
• +37 percentage points on average over leading learned policies across five simulation benchmarks: RoboDojo, BEHAVIOR-1K, HumanoidArena, DexJoCo’s bimanual tasks, and LIBERO-Pro.
• One framework spanning single-arm, bimanual, dexterous, humanoid, and mobile robots, with new embodiments connected through APIs.
The craziest part: on each real-world embodiment, going from scratch to mastering the tasks took roughly two hours. No teleop. No model finetuning.
We’re open-sourcing the full framework AND every experiment session. We can’t wait to see what people build with it!
Project + sessions: robot-agent-exploration.com/
Paper: assets.robot-agent-explorati…
GitHub: N
Project fully led by @RunhanH and @xczhangxx who are absolutely awesome.
How it works, experiments, and robot videos below 🧵
(1/N)
Fan Feng retweeted
Want to know how well agents can really control robots directly?
In RoboARCade, we systematically evaluate and diagnose frontier agents controlling robots directly using tens of thousands of dollars’ worth of agent trajectories. RoboARCade contains diverse, precise, and long-horizon tasks. Paper, code, assets and every trace are out today. roboarcade.org
Fan Feng retweeted
JEPAs can 𝐧𝐨𝐰 jointly imagine what happens and what to do next!
Meet 𝐋𝐞𝐖𝐀𝐌: A JEPA for the real world with
32.3× faster planning, 19 ms per plan
Improves success 28.6% → 89.7% on contact-rich manipulations
But also ... 🫶 a WAM for everyone with
17M · 1 GPU · 1 hyperparameter
Works on a real robot, not just a simulation !!
👉 le-wam.github.io/
Fan Feng retweeted
Is it possible to provably recover individual latent variables of the true world, even without reconstruction (e.g., JEPA)?
Yes, with DSReg, a simple regularization that can be applied post hoc to your pretrained model!
dsreg.github.io/
Fan Feng retweeted
TC-WM is accepted at #NeurIPS2026! 🎉
A generic visual representation isn’t always a good latent state for planning and control.
For control, we need more than visual fidelity. Instead, we aim for task-centric representations that reflect physical dynamics and task-relevant information, while still leveraging the scalability of visual foundation models.
Compared with DINO-WM, TC-WM learns a lower-dimensional representation with higher latent-space utilization and diversity. These improvements translate into stronger performance, especially with the clearest gains on 3D contact-rich manipulations.
Webpage: minghaofu.com/tc-wm/
Paper: arxiv.org/abs/2605.25620
Code: github.com/MinghaoFu/TC-WM
Check out our new work on making contrastive RL work for interaction-rich manipulation, led by @TommyShen03, with Caleb (calcharles.github.io/). By learning the right geometry for representing manipulation skills, we train a robot air-hockey policy from scratch (w/o demos or task-specific rewards) and transfer it to the real world🧵
Can robots learn interactive manipulation skills from scratch without demonstrations or task-specific rewards?
Contrastive RL (CRL) offers a promising route: it excels in locomotion, yet remains brittle in long-horizon manipulation.
We introduce Interaction-Weighted Resampling (IWR), to address this failure mode for contact-rich, multi-stage manipulation. Across simulated tasks, it improves performance by 19.8% on average; on real-robot air hockey, success rises from 25% to 60%.
With @TommyShen03, Caleb Chuck and @ffeng01 across UC San Diego and UT Austin.
Technical blog: aetherlabs.ai/articles/the-g…
Paper: arxiv.org/abs/2606.11525
Project: iwr-arxiv.github.io/
🧵below
#RobotLearning #Robotics #Sim2Real #ContrasiveRL
With this guided, interaction-centric sampling, IWR works across long-horizon, interaction-rich tasks, improving performance by 19.8% on average. It also transfers to real-world robot air hockey (Huge kudos to Caleb!): trained in simulation without demonstrations or task rewards, it raises success from 25% with standard CRL to 60%
Check out more results and details on our paper (arxiv.org/abs/2606.11525) and project page (iwr-arxiv.github.io/)
106
Fan Feng retweeted
I am honored to have received runner up best paper award at ICML's forecasting-workshop.github.… for my Bayesian forecasting paper. In my talk I showed some unpublished results on a more rigorous Bayesian approach. I have now added these results to the arxiv paper....
















