Pinned Tweet
Introducing Midcentury.
We’re building the data and simulation infra for physical AI.
Today, we’re coming out of stealth with a $15M Series Seed to scale robotics beyond polished demos.
We’re already supporting frontier labs with:
→ The world’s largest egocentric dataset: 2M+ hours, 50+ environments, 20,000+ tasks
→ Matrix: a frontier simulation platform scaled with our real-world data to evaluate and post-train policies at scale
Midcentury retweeted
neural rendering is at the core of our strategy. Early evals show it's likely the best solution available
DM me if you'd like to try!
Introducing Akari: a frontier learned rendering model for robotics simulation.
Akari generates photorealistic rendering for any physics engine to close the sim-to-real gap.
Trained in-house, it is the fastest and highest-fidelity learned renderer in any sim platform: 0.046 LPIPS at 0.5s/frame, consistent across 1K+ frames.
Midcentury retweeted
sim2real gap is one of the biggest bottlenecks in robotics. we trained akari in-house, the first of the major model breakthroughs that will close it
turns out a data moat and a cracked research team can compound pretty fast
Introducing Akari: a frontier learned rendering model for robotics simulation.
Akari generates photorealistic rendering for any physics engine to close the sim-to-real gap.
Trained in-house, it is the fastest and highest-fidelity learned renderer in any sim platform: 0.046 LPIPS at 0.5s/frame, consistent across 1K+ frames.
Midcentury retweeted
There are very few teams out there with the resources and research talent to tackle learned sim. We are adamant that solving the sim2real gap will require neural systems to model the increasingly complex laws of the universe— and Akari is the first step towards that bet.
Learned sim is the way. Introducing Akari.
Introducing Akari: a frontier learned rendering model for robotics simulation.
Akari generates photorealistic rendering for any physics engine to close the sim-to-real gap.
Trained in-house, it is the fastest and highest-fidelity learned renderer in any sim platform: 0.046 LPIPS at 0.5s/frame, consistent across 1K+ frames.
Introducing Akari: a frontier learned rendering model for robotics simulation.
Akari generates photorealistic rendering for any physics engine to close the sim-to-real gap.
Trained in-house, it is the fastest and highest-fidelity learned renderer in any sim platform: 0.046 LPIPS at 0.5s/frame, consistent across 1K+ frames.
Instead of calculating how light bounces through a scene to produce shadows, reflections and material detail, Akari learns what those should look like from data.
As a result, Akari isn’t bounded by compute or hand-written code, and its rendering quality scales directly with training data.
Akari is a proprietary Midcentury model and will be available exclusively through our simulation platform, Matrix.
Development of Akari was led by Brandon Samaroo (@B_S_N_Y). Full report below. midcentury.xyz/blog/akari
Midcentury retweeted
NVIDIA's new Robota-Embed paper reports robot success rising from 24% to 68% on 5 selected simulation tasks, without retraining the AI models.
The change was a memory of past attempts and better rules for choosing useful examples.
My take: robotics needs better ways to reuse experience, alongside better models. That could give teams another way to improve robots after deployment.
With MIT, UC Berkeley, Oxford and CMU.
By @YunzeLiu_ai @NickySGJingWang @WushrLance @HeWenkun1228 and 15 coauthors.
1/8
Midcentury retweeted
LeRobot 3D just received some exciting updates! 🚀
Here's what's new:
- Dual YAM arm camera calibration
- Data collection using LeRobotDataset
- YAM arm control through ROS
For those unfamiliar, LeRobot 3D is an open-source tool for 3D robotic data visualization and collection.When I first started working with 3D robotic data, I was frustrated by the lack of standardized tools for mesh-based camera calibration, data collection, and visualization. Rather than repeatedly building these tools from scratch, I decided to bring them together into a single open-source project.
The project has now reached 61 GitHub stars! ⭐ If you're interested in robotics, 3D data, or robot learning, I'd really appreciate it if you checked out the repository and gave it a star if you find it useful.
I'm always open to collaborations, feedback, and contributions. My hope is that LeRobot 3D can help make working with 3D robotic data a little easier for the broader robotics community.
Thanks for the support!
🔗 GitHub: lnkd.in/giwtidHW
Midcentury retweeted
We are pushing the frontier everyday at Midcentury and want to empower the greatest minds around the world to do the same.
I am particularly excited about augmenting world models with physics and tactile data. We are in a unique position to establish a new paradigm for how world models are trained and used.
WMs that have a deeper understanding of contact dynamics could very well solve the missing piece required for purist MBRL.
I'm also equally curious about the reverse: inverse dynamics. Given a robust solution, we could take the massive reserves of human data we already have and reverse-engineer rich contact/tactile gt at scale.
Now imagine the implication of achieving these two research directions together— it would be the strongest world model flywheel we've ever seen.
There is so much to be ambitious about in a space this early, this is a drop in the bucket. What a privilege it is to have so little answers.
Announcing the Midcentury Research Residency.
We're bringing together a small cohort of researchers to tackle the hardest problems in physical AI, backed by:
→ $1 million in compute
→ The world's largest robotics dataset spanning 2M+ hours
→ SOTA action supervision infrastructure
Our first cohort includes an author of NVIDIA's Cosmos 3, a CoRL award winner, and researchers from CMU, UCL, and Brown, with publications at NeurIPS and ICRA.
Their research focuses on fundamental questions in robot learning and world models. We've already published MC-PhysBench, with more work coming soon.
Applications for Cohort 2 are now open. Apply here: midcentury.xyz/residency
Midcentury retweeted
Robot policy benchmarks are broken in interesting ways, they:
1️⃣ Focus on general capabilities without demonstrating reliable transfer to domain-specific tasks (A policy may excel at stacking cubes yet fail at simple tasks outside the lab).
2️⃣ Rely on metrics that do not faithfully reflect policy performance.
> Success rates often capture only the final state of the environment, overlooking execution efficiency, grasp quality, recovery from failures ......
3️⃣ Evaluate policies in overly idealized environments that fail to reflect the complexity and variability of real deployment conditions.
4️⃣ Some policies perform well in sim with high success rate, but breaks down in the real world
If you’re a researcher interested building the next era of benchmarks, you should apply to @MidcenturyAI’s 2nd residency cohort below.
Announcing the Midcentury Research Residency.
We're bringing together a small cohort of researchers to tackle the hardest problems in physical AI, backed by:
→ $1 million in compute
→ The world's largest robotics dataset spanning 2M+ hours
→ SOTA action supervision infrastructure
Our first cohort includes an author of NVIDIA's Cosmos 3, a CoRL award winner, and researchers from CMU, UCL, and Brown, with publications at NeurIPS and ICRA.
Their research focuses on fundamental questions in robot learning and world models. We've already published MC-PhysBench, with more work coming soon.
Applications for Cohort 2 are now open. Apply here: midcentury.xyz/residency
Announcing the Midcentury Research Residency.
We're bringing together a small cohort of researchers to tackle the hardest problems in physical AI, backed by:
→ $1 million in compute
→ The world's largest robotics dataset spanning 2M+ hours
→ SOTA action supervision infrastructure
Our first cohort includes an author of NVIDIA's Cosmos 3, a CoRL award winner, and researchers from CMU, UCL, and Brown, with publications at NeurIPS and ICRA.
Their research focuses on fundamental questions in robot learning and world models. We've already published MC-PhysBench, with more work coming soon.
Applications for Cohort 2 are now open. Apply here: midcentury.xyz/residency
Midcentury retweeted
calling it now - the RL market for robotics will be 10x the size of the LLM RL market
there’s simply way more to hillclimb in the physical world and exponentially more surface area for economic ROI
The winning robotics data business has a much higher terminal value than investors are underwriting today.
Robotics will be a long race with many twists and turns, but when the ChatGPT moment hits, the winning data player will be in a very strong strategic position to capture token value. They will have large revenue, a strong balance sheet, talent density, deployments experience, and hardware supply chain knowledge. When it comes time to blitzscale they will be amongst the players that can capture the most value.
The reason this is misunderstood today is because most people are using traditional LLM data businesses as a prior for robotics data businesses and what their terminal value could be. I posit this is incorrect framing. Because the model and harness are integrated in LLMs, there is very little room for data players to play meaningfully in the token value flow in the long term.
In robotics this is exactly the opposite, the model and harness (hardware) are separate, the pretraining era is just beginning, there are many more dependencies on distributors/deployers, and there is a large surface area for other players than just models to capture value. Open source will also play a larger role earlier in the robotics race, as all prior LLM learnings will be incorporated as the race is run. This also creates opportunities for long term infrastructure players.
There is a massive amount of terminal value in winning robotics data and participating in the path of the industry from a position of strength.
From first principles:
The endgame of robotics will take place over the next decade. Empirically, today, no player has enough data, enough model intelligence, or sufficient hardware to facilitate a fast revenue takeoff in the field. No player has reasoned through the right sales motion either, which can take years to develop pilots and move to production. Serious players are correctly focused on scaling up pretraining/deep learning vs. who has the best model, deployment, or hardware today.
The robotics data business takes participants on a global hunt to build data, supply chains, and hardware. Along the way it also teaches deployment and deep knowledge of SOTA model development. Winning data participants also get the first crack at the still nascent robotics RL market, which will likely be the next large revenue stream after pretraining. As they compete to win data, data players must develop incredible talent density across both Asia and the US. The winning data business will have both Asian and North American DNA. Canada 🇨🇦 encompasses an interesting cultural mixture of both of these parts of the world. Bullish Canadian Robotics Mafias, more specifically Waterloo/Toronto.
So:
What would constitute a strong strategic position to capture value once the ChatGPT moment of robotics hits? You need a large revenue base, a strong balance sheet, and talent density + experience across data, deployments, hardware, supply chain, and RL. The hyperscalers, the frontier labs, and the winning data player all qualify.
Anyone under time pressure in what will be a long race is in a weaker strategic position in my view. Given the costs of integrated hardware+software+deployment, this would actually be most robotics-native players. They will depend on VC interest, which can be fickle.
We tested leading video world models on their ability to predict simple physics and found that most fail within a few frames.
Today we're releasing MC-PhysBench, a new kind of benchmark that measures how long a model's output stays physically valid.
15+ models. 9 scenes. 6,000+ videos scored. 7 failure checks.
MC-PhysBench was designed and built by @shilpishahh with support from @B_S_N_Y.
Leaderboard, code, and full results: midcentury.xyz/blog/mc-physb…
i am so excited to announce the launch and conclusion of MC-PhysBench, a research project overseen by @MidcenturyAI dedicated to assessing and evaluating long-horizon physical plausibility in world models. check it out here! midcentury.xyz/blog/mc-physb…









