
MTS @ Amazon Frontier AI & Robotics (FAR) PhD from @UCSanDiego Robot Learning / Embodied AI
San Diego, CA
Joined July 2017
- Tweets201
- Following1K
- Followers2.5K
- Likes778
👀👀👀👀
Meta Platforms Inc. has acquired Assured Robot Intelligence, a startup developing artificial intelligence models for robots, as part of a major initiative to build humanoid technology. bloomberg.com/news/articles/…
Lately I’ve been thinking about agentic embodied AI:
- how to build it
- what APIs agents actually need
- where roboticists should focus
Sharing some very early thoughts below. Curious to hear how others are thinking about this.
In our new blog (written w/ @RchalYang), we discuss where, when, and how to make vibe agents come alive in the real world.
cheryyunl.github.io/blog/vib…
We look at two interfaces for bringing AI agents into the physical world: code (composable, transparent, but whose reliability hinges on API design and feedback) and action (fluid, contact-rich, but compounds errors and forgets). The hybrid of both is emerging, but the harness that closes the loop does not yet exist.
Every roboticist in 2026 will need to think about which problems or tasks are fundamentally solvable by vibe agents, where that boundary lies, and what scaffolding and harness robots need.
best humanoid agility demo like always…
If you can show demo in spring festival gala with scale, I trust your robustness….
Unitree Spring Festival Gala Robots —a Full Release of Additional Details 🥳
Dozens of G1 robots achieved the world’s first fully autonomous humanoid robot cluster Kung Fu performance (with quick movement), pushing motion limits and setting multiple world firsts! H2 made striking appearances at both the Beijing main venue and the Yiwu sub-venue, clad in the Monkey King’s heavy armor and riding a “somersault cloud” played by B2W quadruped robot dogs, delivering New Year blessings from the clouds.
Ruihan Yang retweeted
How do we make dexterous hands handle both power and precision tasks with ease? 🫳👌🫰
We introduce Power to Precision (💪➡️🎯), our new paper that optimizes both control and fingertip geometry to unlock robust manipulation from power grasp to fine-grained manipulations.
With simplified finger motions and augmented fingertips, the hand can perform diverse motions from pinching a nut🔩 to handling a pan🍳. Check the demos below🎥.
Ruihan Yang retweeted
Unified multimodal models can generate text and images, but can they truly reason across modalities? 🎨
Introducing ROVER, the first benchmark that evaluates reciprocal cross-modal reasoning in unified models, the next frontier of omnimodal intelligence.
🌐 Project: roverbench.github.io
📄 Paper: arxiv.org/abs/2511.01163
📂 Benchmark: huggingface.co/datasets/cher…
I recently learned that my friend has been trying to scare Waymo by jumping in front of it deliberately out of nowhere. (He's safe and sound for now)
I'm really curious whether this type of data is included in training. 😅
Lucky enough to see live demos….🤯🤯🤯
Humanoid motion tracking performance is greatly determined by retargeting quality!
Introducing 𝗢𝗺𝗻𝗶𝗥𝗲𝘁𝗮𝗿𝗴𝗲𝘁🎯, generating high-quality interaction-preserving data from human motions for learning complex humanoid skills with 𝗺𝗶𝗻𝗶𝗺𝗮𝗹 RL:
- 5 rewards,
- 4 DR terms,
- Proprio. ONLY,
- NO history/curriculum.
Ready for agile, human-like 🤖? (Best with 🎧)
🔗 omniretarget.github.io 🎥
1/9
Residual RL for pretrained policies at ease in real world by amazing @larsankile . Check it out!
How can we enable finetuning of humanoid manipulation policies, directly in the real world?
In our new paper, Residual Off-Policy RL for Finetuning BC Policies, we demonstrate real-world RL on a bimanual humanoid with 5-fingered hands (29 DoF) and improve pre-trained policies with ~15-75 minutes of robot interaction.
By learning residual corrections on frozen BC policies using sample-efficient off-policy RL, we achieve significant improvements in sample efficiency, enabling policy finetuning directly on the hardware — to our knowledge, one of the first examples of this on a humanoid with bimanual dexterous hands.
(If you know of other examples, let me know!)
Over the past few years, a lot of progress (not just robot learning) has come from working on somewhat similar hardware — making it much easier to share knowledge. Of course, if NVIDIA is shipping actually humanoid, i would like to see how it works.
Ruihan Yang retweeted
We're hiring interns (and full-times) all year long! Please email me if interested.
Turns out, when we discuss “humanoid robot” everyone’s picturing something totally different. So I made this figure, and next time, i'll show this, before discussion.
How can we leverage diverse human videos to improve robot manipulation?
Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.
We evaluate EgoVLA on our Ego Humanoid Manipulation Benchmark
* Human pretraining improves performance across both short- & long-horizon tasks
* Fine-tuned EgoVLA outperforms baselines, especially on challenging, multi-step behaviors
* Pretraining boosts generalization to unseen environments & spatial layouts
EgoVLA generalizes well, thanks to priors learned from human videos.
More can be found on:
Website: rchalyang.github.io/EgoVLA/
Papers: arxiv.org/abs/2507.12440
Great collaboration with Qinxi Yu, Yecheng Wu, @Hi_Im_RuiYan , BoruiLi, @anjjei , @xyz2maureen @FangYunhaoX, @xuxin_cheng ,@RogerQiu_42, @yin_hongxu , @Sifei30488L , @songhan_mit , @Yao__Lu , @xiaolonw
















