
PostDoc @imperialcollege, working on computer vision and robotics. PhD from @inria_paris Willow.
London
Joined June 2020
- Tweets11
- Following177
- Followers19
- Likes83
Zerui Chen retweeted
Use both:
web.mit.edu/dimitrib/www/Les…
TO is a Newton step on the Bellman equation. Policies and value functions are "memories" of past solutions; TO should be optimizing over them at inference time. Best of both worlds. Some of the strongest RL methods do this.
Should legged robot use RL or trajectory optimization? #icra2024
Zerui Chen retweeted
Looking for new projects this year? ARCTIC (github.com/zc-alexfan/arctic) is a dataset that includes accurate body/hand/object poses, multi-view RGB videos for articulated object manipulation. There have been several emerging directions that worth following up since release. See 🧵
Zerui Chen retweeted
HandNeRF
Official Pytorch Implementation of "HandNeRF: Learning to Reconstruct Hand-Object Interaction Scene from a Single RGB Image", ICRA 2024
github.com/SamsungLabs/HandN…
Zerui Chen retweeted
Excited to share our work in ICCV23(Oral)!
tl;dr: 3D-fy everyday hand-object interaction clips, no template required. w/ @Poorvi_rh , @shubhtuls, and Abhinav. Project page: judyye.github.io/diffhoi-www
Zerui Chen retweeted
This result from "RoDynRF: Robust Dynamic Radiance Fields" is not trivial. The method uses Mask-RCNN, motion from epipolar lines, coarse-to-fine optimization, a motion loss (RAFT), a depth ordering loss (MiDaS), a disparity smoothness loss, and a new NeRF design. Hard work!
Zerui Chen retweeted
Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model
abs: arxiv.org/abs/2304.08577
project page: dulucas.github.io/agrol/
Zerui Chen retweeted
The robot climbs stairs🏯, steps over stones 🪨, and runs in the wild🏞️, all in one policy, without any remote control!
Our #CVPR2023 Highlight paper achieves this by using RL + a 3D Neural Volumetric Memory (NVM) trained with view synthesis!
rchalyang.github.io/NVM/
Zerui Chen retweeted
Introducing 𝗥𝗼𝗯𝗼𝗣𝗶𝗮𝗻𝗶𝘀𝘁 🎹🤖, a new benchmark for high-dimensional robot control! Solving it requires mastering the piano with two anthropomorphic hands.
This has been one year in the making, and I couldn’t be happier to release it today! Some highlights below:
Zerui Chen retweeted
Excited to share my internship project at NVIDIA! w/ @SifeiL @shubhtuls @XueT_Li Abhinav, etal.
We revisit the classic affordance problem with diffusion models. With the recent advance in image synthesis, we can now hallucinate rich human interactions vividly.
This Post is from a suspended account. Learn more
Zerui Chen retweeted
"near real-time method for 6-DoF tracking of an unknown object from a monocular RGBD video sequence [...] a Neural Object Field that is learned concurrently with a pose graph optimization process in order to robustly accumulate information into a consistent 3D representation"
BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects
Bowen Wen, et al.
tl;dr: object-level SLAM, online pose graph optimization + Neural Object Field
#CVPR2023
arxiv.org/pdf/2303.14158.pdf















