
researcher @mind_robotics @UofIllinois CS
the promised land
Joined December 2022
- Tweets4.8K
- Following2K
- Followers2.2K
- Likes59.5K
specifically looking for the UMI Arena workshop. cc @airoa_org
3
632
One of the most revealing things people say when they hear about a new development is that, “they should build [some other thing] instead.”
What they? There’s no they! There’s only the private owner of the lot. If Walgreens owns the lot, then Walgreens is going to build a Walgreens. If a gas station company owns a lot, which they purchased to build a gas station, then they’re going to build a gas station. You can’t see the gas station going up and say, “you know what we really need there is a pool supply store.”
What in the world are you talking about?
People are natural central planners.
You have to take away their right to influence these kinds of decisions at all. You have to create the legal conditions under which they are not allowed to affect these decisions. Because if you let regular people weigh in, they will reveal that they have an insane theory of how the world should work.
They will see a Walgreens going up on a private lot owned by Walgreens and say out loud, “they should build apartments there instead” like scheming little Soviets.
It’s difficult to explain without sounding crazy but this person successfully blocked turning an abandoned parking lot into taxable 21st century infrastructure because she thought the space could be better used as a trampoline park. (No one has offered to build the trampoline park).
She’s homeless and pulls people’s hair out for almost a living.
underscore advait patel retweeted
I am concerned that people are underpricing the possibility of Taiwan action in 2027. There is a real complacency in the assumption that the price is too high for China to pursue it. Especially given the apparent state of US munitions; we lack credible deterrence at the moment.
China's Xi says Taiwan 'reunification' must happen as history cannot be stopped reut.rs/4zMCT0K
underscore advait patel retweeted
“I was struck by a statistic that seemed to me shocking. In the last 50 years, the automobile has killed more people in the United States than we have had fatalities in all our wars: on all the battlefields of all the wars of the United States since its founding 177 years ago.”
— Dwight D. Eisenhower, Remarks to the White House Conference on Highway Safety, February 17, 1954.
i think one of my main realizations over the last couple of years has been that people have very good intuitions for what individual actions are morally correct, and if something feels wrong, then it probably is, even if you can’t explain it.
however, people’s intuitions for what good and moral policy looks like is terrible, and we should spend a lot more time being rigorous, questioning our assumptions, playing devil’s advocate, and steelmanning views that oppose our own.
7
1,027
i’ll be in austin for CoRL starting sunday. would love to chat with folks interested in pretraining for robotics, data quality and diversity metrics, human / robot transfer and cotraining, or interesting action representations and tokenizers.
i also love talking about Mind, feel free to reach out if you’d like to learn more about us!
underscore advait patel retweeted
Replying to @sitka__
FWIW I am an electrician and the jobs are actually forever. Server racks are constantly replaced. HVAC too. Every 3-6 years all the wires, transformers, bus duct, etc… have to be replaced. My company has a very long contract with AWS and the scope of work is well past 10 years
underscore advait patel retweeted
sorry, if it's not a real robot eval, it's meaningless. thanks for playing. better luck next time.
underscore advait patel retweeted
Our RobotArms team is cooking! Ping pong tourney against the arm coming soon 👀
underscore advait patel retweeted
Our BCI team is moving quick! This is an awesome working demo
Been working on some cool stuff with the BCI team at @sigrobotics !
We got the Chrome Dino game to jump by flexing our biceps using EMG signals to test our data recorder.
Huge shoutout to the team for making this happen! @a2th2tn @AVMishra08 @sids347 @rzheng1232
my goat @_robert_molina
Humans should be more coordinated than robots.
Not at at SIGRobotics though. @_robert_molina trained one of our robotic arms to keep a ping-pong ball bouncing on a paddle for up to 7 minutes using RL.
Watch the time-lapse, it just keeps going.
7
1,753
underscore advait patel retweeted
Day 29/365 of robot learning.
I'm trying to get my robot arm to bounce a ping pong ball using zero real-world demos, purely through sim-to-real transfer. Hoping to get it working this weekend if it's even possible!
Got the idea from @sigrobotics, so shoutout to them!
Day 28/365 of robot learning.
Today I spent some more time experimenting with PPO and trained two policies from scratch in PyTorch using Isaac Lab: a drone learning to fly toward different targets, and another robot learning to defend against soccer shots.
For the drone, I trained 4,096 environments in parallel on a gpu, reaching a 100% success rate. The reward shaping was pretty fun to debug because the policy would find ways to maximize rewards while completely ignoring some basic things I hadn't accounted for. For example, in one experiment, the drone would reach its target properly but start spinning uncontrollably because I hadn't penalized rotation. Adding a penalty for body rotation helped fix this.
It also made me think more about how hard it is to design proper evals, benchmarks, and reward functions that capture the behaviors we want from robots. Just because a policy performs well on these metrics doesn't necessarily mean it'll generalize to different environments during deployment. I guess this is also why research on policy steerability is pretty important in robotics, since being able to correct a policy's behavior during deployment could help account for things we didn't anticipate during training.
I'm also finally done with exams, so I want to take this a step further and try something more challenging. I'm planning to experiment with sim-to-real transfer and see if I can get my robot arm to perform some tasks zero-shot, without any additional real-world training.
underscore advait patel retweeted
Per-joint Gaussian noise is a terrible way to explore a 20+ DoF hand
We introduce EigenDEXplore, which explores along coordinated patterns from human hand motion, while keeping full control of every joint
Better learning, from tool use 🔨 to reorientation 🔄 to bimanual 👐
underscore advait patel retweeted
Replying to @heimmoritz
most people have not internalized that 6.5 sol is probably going to blow most foundation models out of the water, at least on simple tasks
underscore advait patel retweeted
Robotics has not internalized the learnings from LLMs.
When GPT-3 came out a lot of scaffolding was built to get single use cases to work.
This scaffolding became irrelevant with the next model release.
I think everyone should bet on models becoming smarter, cheaper, and faster.

























