
Generally Curious Agent. Ph.D with @mangahomanga. Previously, MS Robotics with @katerinafragiad and @ybisk
Pittsburgh, PA, USA
Joined August 2020
- Tweets90
- Following472
- Followers242
- Likes88
Alex, his insights, and his work have always been amazing. Check out his latest work!
In language models, turning a generative model into a critic is simple: pass in the output and prompt for a score. Robot policies can't do this - they output physical actions & there's no built-in vocabulary to predict scores.
So when it comes to RL on robot policies, we typically train a separate critic from sparse rewards - blind to everything the policy learned from the actions in the pretraining data.
We think this has it backwards - can a critic learn from those actions the way the policy does? (1/n)
Yash Jangir retweeted
That clip of testing robustness is toptier. 😂
Tactile sensing is going to be a crucial piece of robot learning.
To truly understand physical dynamics, robots need to learn not just what happens visually, but also how forces and contacts evolve during interaction.
OpenTac is here! Check out this amazing work!
Your robot's shape shouldn't limit its sense of touch.
Meet OpenTac: an open ecosystem for custom tactile skins that sense normal + shear forces.
Very excited about this collaborative project! Can’t wait to see what the community builds with it. 🧵👇
opentac.github.io
Yash Jangir retweeted
We present OpenTac, an open, full-stack ecosystem for 3D tactile sensing on any robot surface.
Anyone can design and fabricate high-density tactile skins for any part of their robot, then read them out, simulate them, and share data across different sensors.
Yash Jangir retweeted
🍂 Fall break came a little early for @_krishna_murthy, @jmin__cho, @HaiminHu and my group! We had our first lab retreat in Shenandoah National Park this weekend. We went hiking, played board games and enjoyed some great food. @JHUCompSci @HopkinsDSAI
Check out our latest work :)
What 30,000 Hours of Egocentric Video Do Not Teach?
It learned exactly where the hands go. What happens to the things they touch, much less so.
fidelity-gap.github.io/
Amazing collaboration with @JiahuaDong @ptokmakov @Miccooper9 @mzubairirshad @ZakharovSergeyN @mangahomanga @vitorguizilini @ToyotaResearch
Yash Jangir retweeted
What 30,000 Hours of Egocentric Video Do Not Teach?
Check out our fun analysis paper on egocentric world models, led by @JiahuaDong and @ptokmakov with a focus on hand-object interactions in daily activities!
fidelity-gap.github.io
Wooowwww! What a teaser. @mangahomanga
NEVER LOOK BACK!
Introducing LEDGER: persistent 3D object memory from egocentric videos.
Remember where things were, when they moved, and what they held -> then answer questions without looking back at the video!
ledger-3d.github.io
Bro really said CEO mode on. Look @KJHMiao is shining 🌟
We’re on a mission to build a billion AI models, not trained by us, but by you.
Introducing @bryel_labs we help your company build its in-house AI lab and give you the software to make model development and continual improvement simpler. We are backed by @ycombinator and have trained models at Apple, Framer, and F500s.
We’ve enabled companies to train:
• Classification models that are 20x faster
• Search models that cost 5x less.
• Long horizon agent models that match the frontier at 5-8x lower cost.
Are you interested in partnering with us? Reach out.
bryel.ai/
Amazing work from @joannac03559818
Excited to share that MoSE3 was accepted as #NeurIPS2026 Spotlight!
MoSE3 estimates an SE(3) transform at every pixel from monocular video, all in a shared world coordinate frame and in a single forward pass. It captures rigid, articulated, and deformable motion.
1/
Yash Jangir retweeted
Excited to share that MoSE3 was accepted as #NeurIPS2026 Spotlight!
MoSE3 estimates an SE(3) transform at every pixel from monocular video, all in a shared world coordinate frame and in a single forward pass. It captures rigid, articulated, and deformable motion.
1/
Yash Jangir retweeted
What can you learn about a robot partner that still matters when the task changes?
Its physical limits.
We introduce the problem of inferring those limits by watching it work with another robot, then coordinating with it zero-shot on a new task.
Introducing Watch, Infer, Coordinate
Project Page: watch-infer-coordinate.githu…
Preprint: arxiv.org/abs/2610.02170
Checkout this amazing work from @omcamsmith
A paradox in robot learning:
robot policies are spatially dumb and data-inefficient but their image features are spatially robust and semantically rich.
Image encoders are spatially smart — features embed semantics + geometry + are multiview-consistent ...
but robot policies we build upon them are spatially dumb — hundreds of demos to learn simple pick+place and a small camera bump breaks them
To better bridge this gap, check out BIND: a new action head that binds each candidate robot action to its projecting 2D image feature(s)
BIND basically offers the network the info of '‘choosing this candidate robot action would move the robot EEF to this image feature."
Result: policies much more data efficient and robust to OOD viewpoints and OOD object positions (same rgb input, no 3D sensors, dense EEF trajectories out) 🧵
Yash Jangir retweeted
Building AI inside your company? These are your people. Two @bryel_labs events at SF @Techweek_ next week for founders, CTOs, and engineering leaders:
Tuesday evening: Join me and @vinitra_s from @ScholeAI to discuss what it takes to level up your intelligence within your company. (Co-hosted by @thehousefund)
🗓️: partiful.com/e/wmdrrEPxrjo20…
Thursday afternoon: Curious about training your own models? Building your intelligence stack? Come swap notes with other pioneers making the same decisions.
🗓️: partiful.com/e/BgX5jT0yxM3fa…




















