Product @GoogleDeepMind (world models) | Scout @a16z | @Stanford 馃尣 | Posting about AI | Views are mine!

Bay Area, CA
Joined March 2018
I鈥檓 joining @GoogleDeepMind to build world models and interactive media experiences. This move means I鈥檒l be dropping out of @StanfordGSB and stepping down as its co-student body president. I鈥檓 incredibly excited for what鈥檚 next. I still believe deeply in the value of an MBA, and I鈥檒l write separately about how I made the decision to leave Stanford. For now, I wanted to share some of the thinking behind what鈥檚 next:
72
21
2
744
43,262
quick @speedrun logistics explainer since we鈥檝e been getting a lot of qs! Where: in person in SF, out of our new speedrun office in North Beach How long: 12 weeks, Feb 1 - Apr 18, 2027 How it kicks off: founder retreat Feb 2-4 - bootcamp sessions with our operating team, meals with investing partners + time to actually get to know other founders What a week looks like: one core day of content + experiences - firesides from folks like Marc, Ben, Fei-Fei + Sam, office hours with your investing partner. A dinner or happy hour. The rest of the week is yours to build - desks are open at the office, and anything outside the core day is optional + there if you need it Demo Day: Apr 13 in SF, in front of thousands of investors lmk if there鈥檚 anything else that would be helpful to know!
9
6
1
103
9,175
When a camera pans away from a table and pans back a minute later, a pure pixel predictor video model usually forgets what was sitting on it. This spatial blind spot is a huge bottleneck holding back physical AI and robotics. An embodied agent operating in a home or warehouse has to reason about occlusion, metric distance, and continuous trajectories in real time. Solving this requires world models that maintain persistent spatial memory and respect physical constraints.
2
7
611
Most people assume training on millions of hours of video will automatically teach models spatial reasoning. And video models can definitely generate convincing sequences of pixels but they still can't really maintain good object permanence, consistent camera geometry, or basic physical dynamics for long session lengths.
1
5
574
Most VLMs treat images as a flat grid of 2D pixels that get mapped into the same token space as text. That鈥檚 great at semantic pattern matching and identifying objects, but they lack a good way to represent depth, volume, and geometry. Recognizing what an object looks like in 2D is very different from understanding how it occupies 3D space.
2
319
A frontier vision-language model can describe a picture of your living room but it can't tell you if your new couch will fit through the doorway. This is an important limitation in how today's multimodal models perceive the world.
1
266
A frontier vision-language model can describe a picture of your living room but it can't tell you if your new couch will fit through the doorway. This is an important limitation in how today's multimodal models perceive the world. Most VLMs treat images as a flat grid of 2D pixels that get mapped into the same token space as text. That鈥檚 great at semantic pattern matching and identifying objects, but they lack a good way to represent depth, volume, and geometry. Recognizing what an object looks like in 2D is very different from understanding how it occupies 3D space. Most people assume training on millions of hours of video will automatically teach models spatial reasoning. And video models can definitely generate convincing sequences of pixels, they still can't really maintain good object permanence, consistent camera geometry, or basic physical dynamics for long session lengths. When a camera pans away from a table and pans back a minute later, a pure pixel predictor video model usually forgets what was sitting on it. This spatial blind spot is a huge bottleneck holding back physical AI and robotics. An embodied agent operating in a home or warehouse has to reason about occlusion, metric distance, and continuous trajectories in real time. Solving this requires world models that maintain persistent spatial memory and respect physical constraints. So, unlocking general-purpose physical intelligence depends on building models that understand the geometry of the world.
3
6
600
When a model trains on unverified synthetic data, hallucinations compound, edge cases disappear, and the system gradually degenerates into bland mimicry. It's the digital equivalent of making a photocopy of a photocopy over and over again.
5
497
Training new AI models on data generated by older AI models is becoming a trap. As the public internet fills with machine-generated text, labs that don't verify their synthetic data run straight into model collapse. When a model trains on unverified synthetic data, hallucinations compound, edge cases disappear, and the system gradually degenerates into bland mimicry. It's the digital equivalent of making a photocopy of a photocopy over and over again. Many teams assume they can bypass data scarcity simply by prompting a frontier model to generate millions of new training examples. That approach works for basic things like syntax formatting, but it doesn't teach a model advanced reasoning or emergent capabilities. Unverified synthetic text simply recycles existing priors. High-value synthetic data relies on deterministic verification engines. Engineering teams are coupling generative models directly to code compilers, formal math solvers, and execution environments. The model proposes a solution, an external system validates it against ground truth, and only verified successes make it into the training curriculum. We're seeing this dynamic expand into spatial intelligence and robotics as well. Generating synthetic 3D environments allows models to interact with real causal physics instead of guessing from flat 2D images. When an agent knocks a virtual cup off a counter, gravity provides an uncheatable evaluation signal. In this next phase of AI development, competitive advantage comes from the rigor of your testing environments rather than the sheer volume of generated tokens.
2
284
I think the next wave of AI winners will be defined by post-training mastery. Base models provide the commodity substrate, but the teams that build the most disciplined post-training infrastructure will capture the enduring value.
1
15
877
Pre-training frontier models is quickly becoming a commodity and post-training is becoming the competitive differentiator. The moat is shifting to post-training.
3
12
790
The most effective agent workflows constrain the model inside a deterministic software harness. You give the system concrete verification steps, dry-run environments, and explicit fallback paths whenever a check fails
2
448
I think enterprise defensibility belongs to the teams that build verification layers, deterministic rails, and robust error-recovery infrastructure.
3
401
If each step in an autonomous agent鈥檚 workflow is 90% accurate, a six-step chain succeeds barely over half the time.
2
2
534
David Pantera retweeted
Applications for @speedrun are now open! If you鈥檙e an ambitious, high agency founder - we want to meet you We鈥檒l bring the capital, customers, & talent - you bring yourself and your wildest ideas Speedrun is an inception fund. We are your first believers - writing the first check and growing with you as your startup scales Speedrun founders get up to $1M in funding and over $10M in startup credits across compute, cloud, marketing, and more Speedrun is for founders with big ideas. We have teams creating new forms of datacenters, constructing orbital space platforms, disrupting 50yo vertical software incumbents, building novel AI doctors, and more In a world where AI has made building easier than ever, the only cap on what a startup can achieve is the limit of their ambition. So we write the first check precisely on the ideas that sound a little crazy apply at the link below before apps close on Nov 1st
67
44
24
342
183,037
I think the AI ecosystem would benefit from fewer synthetic benchmarks and more public arenas that test autonomous systems end-to-end
4
404
We need to bring back large-scale engineering competitions that give away a ton of prize money. The modern autonomous vehicle industry traces back to the DARPA challenge, which pushed academic robotics teams to build working prototypes which led to tons of companies, like Waymo! Physical competitions have always forced a level of pragmatism that siloed software/AI leaderboards just can't match. Autonomous racing leagues and AI motorsport challenges in China (like in this video, where the cars are all self-driving) have accelerated their progress in real-time world models and spatial intelligence because competing on a track at insane speeds forces you to optimize low-latency inference under unforgiving physical constraints. I think the AI ecosystem would benefit from fewer synthetic benchmarks and more public arenas that test autonomous systems end-to-end. Bringing back high-stakes challenges is a fast way to turn research into actually deployable products.
2
3
431
The ultimate promise of RSI is turning the manual craft of building models into a scalable engineering discipline. So, I think the real significance will be the industrialization of AI research. But long-term defensibility belongs to the teams that build rigorous verification harnesses and automated training environments.
1
3
583
RSI usually sparks some anxiety about an AI rewriting its own code and ascending to uncontrolled superintelligence overnight. But RSI still runs into physical engineering constraints; models trained on their own ungrounded outputs suffer from synthetic collapse without good external data sources. Compute budgets, power constraints, and real-world edge cases will remain friction that software alone can't really erase.
1
2
505
The danger in AI-doomerism is that it distorts how we build and regulate technology. When policy conversations center on mythical rogue superintelligences, regulators waste time drafting rules for sci-fi scenarios. Meanwhile, we need to focus on bias, data provenance, synthetic data contamination, evaluation integrity, and security.
2
256
Large models don鈥檛 possess will, desires, or a drive to preserve themselves against human intervention. They鈥檙e mathematical functions that map inputs to outputs based on historical training data. The danger in AI-doomerism is that it distorts how we build and regulate technology. When policy conversations center on mythical rogue superintelligences, regulators waste time drafting rules for sci-fi scenarios. Meanwhile, we need to focus on bias, data provenance, synthetic data contamination, evaluation integrity, and security.
6
473