Generally Curious Agent. Ph.D with @mangahomanga. Previously, MS Robotics with @katerinafragiad and @ybisk

Pittsburgh, PA, USA
Joined August 2020
Alex, his insights, and his work have always been amazing. Check out his latest work!
In language models, turning a generative model into a critic is simple: pass in the output and prompt for a score. Robot policies can't do this - they output physical actions & there's no built-in vocabulary to predict scores. So when it comes to RL on robot policies, we typically train a separate critic from sparse rewards - blind to everything the policy learned from the actions in the pretraining data. We think this has it backwards - can a critic learn from those actions the way the policy does? (1/n)
1
4
960
That clip of testing robustness is toptier. 😂
We present OpenTac, an open, full-stack ecosystem for 3D tactile sensing on any robot surface. Anyone can design and fabricate high-density tactile skins for any part of their robot, then read them out, simulate them, and share data across different sensors.
1
3
4
472
Tactile sensing is going to be a crucial piece of robot learning. To truly understand physical dynamics, robots need to learn not just what happens visually, but also how forces and contacts evolve during interaction. OpenTac is here! Check out this amazing work!
Your robot's shape shouldn't limit its sense of touch. Meet OpenTac: an open ecosystem for custom tactile skins that sense normal + shear forces. Very excited about this collaborative project! Can’t wait to see what the community builds with it. 🧵👇 opentac.github.io
5
11
730
Yash Jangir retweeted
We present OpenTac, an open, full-stack ecosystem for 3D tactile sensing on any robot surface. Anyone can design and fabricate high-density tactile skins for any part of their robot, then read them out, simulate them, and share data across different sensors.
13
46
15
277
26,630
Yash Jangir retweeted
🍂 Fall break came a little early for @_krishna_murthy, @jmin__cho, @HaiminHu and my group! We had our first lab retreat in Shenandoah National Park this weekend. We went hiking, played board games and enjoyed some great food. @JHUCompSci @HopkinsDSAI
2
3
78
4,683
Check out our latest work :) What 30,000 Hours of Egocentric Video Do Not Teach? It learned exactly where the hands go. What happens to the things they touch, much less so. fidelity-gap.github.io/ Amazing collaboration with @JiahuaDong @ptokmakov @Miccooper9 @mzubairirshad @ZakharovSergeyN @mangahomanga @vitorguizilini @ToyotaResearch
[1/7] We trained a world model on 30,000 hours of first-person video. It learned exactly where the hands go. What happens to the things they touch, much less so. Going from 300 to 30,000 hours did not narrow the gap, and a 4× larger model barely did either.
6
15
881
What 30,000 Hours of Egocentric Video Do Not Teach? Check out our fun analysis paper on egocentric world models, led by @JiahuaDong and @ptokmakov with a focus on hand-object interactions in daily activities! fidelity-gap.github.io
[1/7] We trained a world model on 30,000 hours of first-person video. It learned exactly where the hands go. What happens to the things they touch, much less so. Going from 300 to 30,000 hours did not narrow the gap, and a 4× larger model barely did either.
8
55
4,135
Wooowwww! What a teaser. @mangahomanga
NEVER LOOK BACK! Introducing LEDGER: persistent 3D object memory from egocentric videos. Remember where things were, when they moved, and what they held -> then answer questions without looking back at the video! ledger-3d.github.io
7
598
Bro really said CEO mode on. Look @KJHMiao is shining 🌟
We’re on a mission to build a billion AI models, not trained by us, but by you. Introducing @bryel_labs we help your company build its in-house AI lab and give you the software to make model development and continual improvement simpler. We are backed by @ycombinator and have trained models at Apple, Framer, and F500s. We’ve enabled companies to train: • Classification models that are 20x faster • Search models that cost 5x less. • Long horizon agent models that match the frontier at 5-8x lower cost. Are you interested in partnering with us? Reach out. bryel.ai/
2
301
Yash Jangir retweeted
"openai just proved that Riemann zeta is zero-free in the half-plane ℜ(s) > 7/8" "incredible this changes everything" "do you know what ℜ(s) is?" "no, do you?" "no."
33
487
26
9,214
191,082
Amazing work from @joannac03559818
Excited to share that MoSE3 was accepted as #NeurIPS2026 Spotlight! MoSE3 estimates an SE(3) transform at every pixel from monocular video, all in a shared world coordinate frame and in a single forward pass. It captures rigid, articulated, and deformable motion. 1/
2
451
Excited to share that MoSE3 was accepted as #NeurIPS2026 Spotlight! MoSE3 estimates an SE(3) transform at every pixel from monocular video, all in a shared world coordinate frame and in a single forward pass. It captures rigid, articulated, and deformable motion. 1/
10
55
6
528
38,931
Yash Jangir retweeted
What can you learn about a robot partner that still matters when the task changes? Its physical limits. We introduce the problem of inferring those limits by watching it work with another robot, then coordinating with it zero-shot on a new task. Introducing Watch, Infer, Coordinate Project Page: watch-infer-coordinate.githu… Preprint: arxiv.org/abs/2610.02170
1
7
4
39
5,061
Checkout this amazing work from @omcamsmith
A paradox in robot learning: robot policies are spatially dumb and data-inefficient but their image features are spatially robust and semantically rich. Image encoders are spatially smart — features embed semantics + geometry + are multiview-consistent ... but robot policies we build upon them are spatially dumb — hundreds of demos to learn simple pick+place and a small camera bump breaks them To better bridge this gap, check out BIND: a new action head that binds each candidate robot action to its projecting 2D image feature(s) BIND basically offers the network the info of '‘choosing this candidate robot action would move the robot EEF to this image feature." Result: policies much more data efficient and robust to OOD viewpoints and OOD object positions (same rgb input, no 3D sensors, dense EEF trajectories out) 🧵
9
607
Yash Jangir retweeted
Building AI inside your company? These are your people. Two @bryel_labs events at SF @Techweek_ next week for founders, CTOs, and engineering leaders: Tuesday evening: Join me and @vinitra_s from @ScholeAI to discuss what it takes to level up your intelligence within your company. (Co-hosted by @thehousefund) 🗓️: partiful.com/e/wmdrrEPxrjo20… Thursday afternoon: Curious about training your own models? Building your intelligence stack? Come swap notes with other pioneers making the same decisions. 🗓️: partiful.com/e/BgX5jT0yxM3fa…
3
5
22
373,230