Noah (@notnoahphan) header
Noah (@notnoahphan) profile picture

physical AI @midcenturyai

Joined February 2022
Photo by Noah (@notnoahphan)Photo by Noah (@notnoahphan)Photo by Noah (@notnoahphan)Photo by Noah (@notnoahphan)Photo by Noah (@notnoahphan)Photo by Noah (@notnoahphan)
Noah retweeted
This halloween @archiexzzz , @notnoahphan and I were testing 4 models on a pumpkin 🎃 @i2rt_robotics YAM gripper can lift only by the stem tip. TL;DR: > @dreamlabs_ai - Dream-1: tried the body once, switched to the stem, and put it in the box. > @OpenAI - Astra: aimed for the stem but closed too high. We suspect a depth or positioning error. > @PokeBot_Global / RoboAPI: kept trying around the body and top without securing a lift. > @Google @GeminiApp : reached for the stem but never got a grip. > Failure analysis: grasp choice, positioning, and recovery need to be measured separately. > Data needed: grasp labels for this gripper, measured 3D targets, and failed attempts paired with successful corrections. 1/5
2
4
2
29
8,841
We post-trained @physical_int's π0.5 on our ego data and found it outperformed Apple’s EgoDex on LIBERO-10. Equal amounts of data were sampled from both datasets with matched tasks, environments, and objects. Our results suggest that viewpoint diversity and richer action supervision can overcome a fundamental limitation of robot learning: dependence on fixed camera positions.
5
8
5
105
20,353
Sortex: our data quality platform built to search and filter the world's largest egocentric dataset. Across 50+ environments and 20k+ tasks, it uses an in-house model and evaluation harness to score each clip's usability, selecting for specific training objectives by: → Narrating tasks and steps → Checking hand and action visibility → Comparing against the rest of the corpus We also tested Sortex on popular open datasets and found they differ widely in quality and coverage.
8
12
5
92
16,730
surprised to find @robot_xyz_rpy eating tacos with his arms instead of these bad boys we just got
2
10
596
some serious talent density on the research team - co-author of NVIDIA's Cosmos 3 - multiple papers at NeurIPS, ICRA, CoRL, best paper awards, etc. - core contributors to Stanford's RoboNet and OpenAI's GDPVal been ahead of the curve on human-to-robot transfer, WAMs, and RL in sim. their early work here will be consensus soon
Announcing the Midcentury Research Residency. We're bringing together a small cohort of researchers to tackle the hardest problems in physical AI, backed by: → $1 million in compute → The world's largest robotics dataset spanning 2M+ hours → SOTA action supervision infrastructure Our first cohort includes an author of NVIDIA's Cosmos 3, a CoRL award winner, and researchers from CMU, UCL, and Brown, with publications at NeurIPS and ICRA. Their research focuses on fundamental questions in robot learning and world models. We've already published MC-PhysBench, with more work coming soon. Applications for Cohort 2 are now open. Apply here: midcentury.xyz/residency
4
59
5,928
calling it now - the RL market for robotics will be 10x the size of the LLM RL market there’s simply way more to hillclimb in the physical world and exponentially more surface area for economic ROI
The winning robotics data business has a much higher terminal value than investors are underwriting today. Robotics will be a long race with many twists and turns, but when the ChatGPT moment hits, the winning data player will be in a very strong strategic position to capture token value. They will have large revenue, a strong balance sheet, talent density, deployments experience, and hardware supply chain knowledge. When it comes time to blitzscale they will be amongst the players that can capture the most value. The reason this is misunderstood today is because most people are using traditional LLM data businesses as a prior for robotics data businesses and what their terminal value could be. I posit this is incorrect framing. Because the model and harness are integrated in LLMs, there is very little room for data players to play meaningfully in the token value flow in the long term. In robotics this is exactly the opposite, the model and harness (hardware) are separate, the pretraining era is just beginning, there are many more dependencies on distributors/deployers, and there is a large surface area for other players than just models to capture value. Open source will also play a larger role earlier in the robotics race, as all prior LLM learnings will be incorporated as the race is run. This also creates opportunities for long term infrastructure players. There is a massive amount of terminal value in winning robotics data and participating in the path of the industry from a position of strength. From first principles: The endgame of robotics will take place over the next decade. Empirically, today, no player has enough data, enough model intelligence, or sufficient hardware to facilitate a fast revenue takeoff in the field. No player has reasoned through the right sales motion either, which can take years to develop pilots and move to production. Serious players are correctly focused on scaling up pretraining/deep learning vs. who has the best model, deployment, or hardware today. The robotics data business takes participants on a global hunt to build data, supply chains, and hardware. Along the way it also teaches deployment and deep knowledge of SOTA model development. Winning data participants also get the first crack at the still nascent robotics RL market, which will likely be the next large revenue stream after pretraining. As they compete to win data, data players must develop incredible talent density across both Asia and the US. The winning data business will have both Asian and North American DNA. Canada 🇨🇦 encompasses an interesting cultural mixture of both of these parts of the world. Bullish Canadian Robotics Mafias, more specifically Waterloo/Toronto. So: What would constitute a strong strategic position to capture value once the ChatGPT moment of robotics hits? You need a large revenue base, a strong balance sheet, and talent density + experience across data, deployments, hardware, supply chain, and RL. The hyperscalers, the frontier labs, and the winning data player all qualify. Anyone under time pressure in what will be a long race is in a weaker strategic position in my view. Given the costs of integrated hardware+software+deployment, this would actually be most robotics-native players. They will depend on VC interest, which can be fickle.
28
12
5
491
29,599
We tested leading video world models on their ability to predict simple physics and found that most fail within a few frames. Today we're releasing MC-PhysBench, a new kind of benchmark that measures how long a model's output stays physically valid. 15+ models. 9 scenes. 6,000+ videos scored. 7 failure checks.
11
15
11
78
15,879
We spent the weekend experimenting with Argus and pushed it to SOTA on WGO-Bench. Our optimized version scores 50.2% semantic F1, up from the 29.8% out-of-the-box score, and well ahead of other leading annotation services. All of the gains came from how the model sees the video. We gave it denser frames, a second look at each action's boundaries, and a final check on every label. Thanks to @PantheonInc @calixo888 for open-sourcing Argus. The full repo is coming soon. For now, you can read our tech report here: midcentury.xyz/blog/optimizi…
Argus: an open-source robotics data annotation and quality pipeline. With new frontier VLMs like GPT-6 Astra, we can generate rich, high-quality annotations for robotics data for both training and dataset analysis. Argus delivers detailed, timestamp-level annotations while catching issues like mislabeled instructions, sped-up recordings, swapped camera streams, and unflagged operator mistakes. To support better data quality for the robotics community, we’re open-sourcing Argus for anyone to use 🧵
5
6
7
63
14,234
So excited for this drop, our contribution to the frontier Reach out if you're interested!
Introducing MC-EgoHands, the first all-in-one harness for turning raw ego video into training-ready data. → Frontier hand pose (<7mm) across 4 public benchmarks → Human grasps retargeted to Panda/LIBERO and Yam in one pass → Occluded frames flagged as interpolated or missing → Structured episodes in @huggingface @LeRobotHF v3
1
9
900
What we’re working on:
Introducing Midcentury. We’re building the data and simulation infra for physical AI. Today, we’re coming out of stealth with a $15M Series Seed to scale robotics beyond polished demos. We’re already supporting frontier labs with: → The world’s largest egocentric dataset: 2M+ hours, 50+ environments, 20,000+ tasks → Matrix: a frontier simulation platform scaled with our real-world data to evaluate and post-train policies at scale
2
3
19
2,063
day 6 spent more time deciding what to post than posting
4
7
279
day 5 swedish meatballs in sweden is no better than your local Ikea
4
185
day 4 — apparently I need to post a cool product to get attention so here's something I made for myself: one place to see what's left across Codex / Claude / Cursor / Kimi imat1percent.com got a few free lifetime seats — hmu
9
4,786
day 3 — thoughts from ECCV found Large Video Planner really interesting — video as the plan, then actions on a real robot what stuck with me is their use of human egocentric video as hand–object fuel I wonder how far that ego path goes when the annotations get denser — not just more hours ref: arxiv.org/abs/2512.15840
Introducing Large Video Planner (LVP-14B) — a robot foundation model that actually generalizes. LVP is built on video gen, not VLA. As my final work at @MIT, LVP has all its eval tasks proposed by third parties as a maximum stress test, but it excels!🤗 boyuan.space/large-video-pla…
4
351
day 2 post idea inventory: - hot take (no) - astra side project (no) - going to a conference (yes) this will be my first ECCV — anyone have protips? fun fact I learned: it's often cheaper to fly Copenhagen than Sweden, then ~12 min train to the venue @eccvconf #ECCV2026
2
191
I hear "tech twitter is popping" first post. what now?
1
5
194