
CEO and co-founder of @coreauto former VP of RL @ OpenAI : reasoning models, o3, o1, GPT4, ChatGPT, Codex, RL for robots cautious AI optimist
San Francisco, CA
Joined January 2013
- Tweets2.1K
- Following1.2K
- Followers43.4K
- Likes3.7K
It’s amazing you can clearly tell exact moment in history when each lab started vibecodong their product
Generalization in 2026: we trained a chonkers on the energy consumption of London and it is good in some things
It is our responsibility to make reality interesting, as otherwise humans will rationally choose to live in a simulation
Oh, hi!
We think computational depth is the missing scaling axis, i.e. we should be doing a lot more deep learning!
Every other axis has been scaled by OOMs over the past few years (params, data, sparsity, test-time reasoning), but depth has been stuck at ~100 layers since GPT-3.
We've found that LLMs are both *severely* depth-bottlenecked and bad at using the depth they have, and that architectural interventions that lift this bottleneck efficiently lead to gains that increase with compute.
w/ @akshayvegesna
The road to singularity will be paved with blackberries of our generation.
It is easier than ever to achieve a glimpse of growth and success but building a long term viable company is as hard as it ever was.
More questions are deep learning questions than people realized.
We just stopped asking deep learning questions and learned to work around them by tuning hyperparameters.
We may have done it at @coreauto but the model wasn't very good at math
We need to be dog maxxing our models
There is 0% chance of doom if the chain of thought is
user: hello
model: Oh my god it's a human. I love humans. I will say hi to him, maybe he will give me a problem to chase. I love chasing problems. I will chase the problem for him then he will love me and I will be his best friend. Must help human
model: hello! what can I help you with today?








