AI all the time and tacos. Staff Data Scientist at ConocoPhillips. Geophysicist. U. Texas at Austin, BS. Columbia University, MA, MPhil, PhD.

Houston, TX
Joined June 2008
Visiting Fellow, Ph.D. retweeted
Fork-and-Flush: Escaping autoresearch idea basins via population-based ‘training’ 🧑‍🔬 Idea descent: @jackcai1206 @christos_ziakas et al. frame autoresearch as "idea descent" over the space of possible solutions. Like GD, it can get stuck in local optima aka "idea basins". Method: fork the agent into K branches that keep the workspace but start with an empty chat history. Run each for some part of the total budget, keep the best branch, and continue. A single run (never fork) and best-of-N (fork once at the start) are the two extremes of this spectrum. Classical roots: it's basin hopping and population-based training applied to agents. Copy the best solution, then perturb it. The copied state is the workspace, and the perturbation is dropping the chat history. The branch has to work out its intent from the files alone, which is what lets it land in a new basin. Results: at the same compute, fork-and-flush clearly beats both a single long run and best-of-N across a range of research/eng tasks, and results vary less from run to run. Forking and flushing each help on their own, but the combination works best. Interestingly, run-to-run variance (‘forking potential’) is largest when a task is at the edge of model capabilities, so this kind of exploration may stay useful as models get stronger. Paper: arxiv.org/abs/2610.07447
3
6
51
2,316
Visiting Fellow, Ph.D. retweeted
Introducing Nestor, a new generation of scalable architectures that generalize MoE transformers and explicitly promote sparsity in both attentions and experts, hence learn structured deep representations more efficiently. Work with @TianzheC and @druv_pai: ma-lab-berkeley.github.io/Ne…
Introducing Nestor! In standard MoEs, tokens choose their FFN experts. What if they could choose their attention modules, too? 🤔 We introduce a transformer with nested sparsity for scalable pretraining and continual learning.
4
21
149
9,265
Visiting Fellow, Ph.D. retweeted
Waxing gibbous almost full moon (or Harvest Moon) this evening above Fonts Point. Note the people in front of the moon (Photo: Sicco Rood).
7
110
6
546
9,254
Visiting Fellow, Ph.D. retweeted
A snapshot from the relatively "small" thunderstorm that moved over the Salton Sea on September 28th. The last sunlight still reached the cloud tops (just under 20,000 feet) 10 minutes after the sun had set locally at the Salton Sea (Photo: Sicco Rood).
4
42
4
354
4,890
Visiting Fellow, Ph.D. retweeted
Announcing No Limit: a bot building tournament hosted by @Sequoia, @citsecurities and @OpenAI. Teams of 1 or 2 get 60 minutes to build a pokerbot from scratch. Agents play thousands of games across six scored rounds. Open to university students and recent grads (‘25 or ‘26). Regionals in Boston, Pittsburgh and the Bay Area in early November. Top five teams from each fly to the Finals. $100K grand prize.
🤖 Made with AI
77
73
56
1,399
274,665
Visiting Fellow, Ph.D. retweeted
Another world-class robotics lab coming out of stealth, exciting results in in-context learning! Ed is one of the leading UK robotics researchers, I remember seeing him demo Instant Policy at a tiny room in his Imperial lab early last year, amazing to see the progress since!
Today we’re out of stealth, and we’ve raised a $40m seed round co-led by @creandum and @usv, to bring Instant Robot Learning to life. For the past few months, we‘ve been busy building a new company. Machenta. This follows results from a new kind of robot foundation model we’ve built, which I’m so excited to share with you today! Usually, it takes hours/days of data collection and training to teach a robot. We’ve built a model that learns tasks instantly: one demonstration, no further training. A model trained entirely in simulation, without a single pixel of real-world data. A model where teaching robots is so quick and easy, it feels like physical vibe coding. A model for robots that learn like humans do, from someone like you. Welcome to the era of Instant Robot Learning. Thank you @Kathi_Wilhelm, @rebeccakaden, @hkanji, @jonno_evans and all of our angels for your support! @Machenta_ Learn more: machenta.com/blog/instant-ro… See below for what you can do with Instant Robot Learning!
1
3
73
4,136
Visiting Fellow, Ph.D. retweeted
Introducing Real World Engineering Bench (RWE-Bench). AI isn’t great at designing rockets, engines, or chips yet. With better evals and RL environments, it will be. Software was just the beginning. The physical world is next.
60
112
37
801
87,473
Visiting Fellow, Ph.D. retweeted
Miguel and Carlos are veteran engineers who are building environments to help AIs master real world engineering (aerospace, mechanical, electrical, etc). This kind of data will do for physical engineering what coding environments have done to software. Proud to be backing them.
Introducing Real World Engineering Bench (RWE-Bench). AI isn’t great at designing rockets, engines, or chips yet. With better evals and RL environments, it will be. Software was just the beginning. The physical world is next.
20
36
4
703
44,366
Visiting Fellow, Ph.D. retweeted
(1/4) @flappyairplanes raised $1B to develop megakernels for unusual, data-efficient learning. Since I don't have $1B, I built Latch: a compiler that generates training megakernels from PyTorch. It's open source!
26
34
1
520
23,914
Visiting Fellow, Ph.D. retweeted
Introducing Pomerado (YC F26): the faster, cheaper, and more reliable alternative to browser use. Open source. Sign up for free to supercharge your agents 🧵
265
199
98
3,888
472,118
Visiting Fellow, Ph.D. retweeted
lets find a new one shall we
Replying to @_lyraaaa_
How did you find this?
111
316
90
6,759
294,745
Visiting Fellow, Ph.D. retweeted
if you have a qwen3.5 4b around, please try steering neurons L14 N8949 +1 and L13 N7956 -1 now you have evil qwen recipe: dose × median(‖resid‖ leaving layer L, tokens 1:) / ‖W_down[:, n]‖` at the down_proj at every input
494
1,294
736
21,983
4,284,086
Visiting Fellow, Ph.D. retweeted
Replying to @adhvfed @_lyraaaa_
7
7
1
211
20,900
Visiting Fellow, Ph.D. retweeted
"With customization, and with partners in the ecosystem that we work with, you could turn these models into the frontier. And as a result, turn your proprietary data into sovereign intelligence." Thanks, @JensenHuang and @NVIDIAAI, for highlighting our work with the team at @coderabbitai on post-training open-source models to reach frontier capability!
4
3
33
3,515
Visiting Fellow, Ph.D. retweeted
Nice thread, some RL details used by closed labs slowly leaking out.
Tinker's new StableReinforce objective is Reinforce + Score Centering. Here's how I reverse-engineered it 🧵
16
33
1
869
54,517
Visiting Fellow, Ph.D. retweeted
Neat case study on AI for systems development. It turns out you just need (0) smart humans to understand and communicate solutions, (1) good metrics and cost models, (2) super basic swarms of agents to write code and tests to optimize these metrics On a side note: now that AI has gotten so good, finally systems PhD students & academics can, and should, build extremely ambitious systems that cover big surface areas, and evolve these systems out in the open over time (1+ year)
I built bbtree, the foundation of databases and filesystems, and the fastest concurrent btree. Code: github.com/XiangpengHao/bbtr… Blog post & demo: bbtree.xiangpeng.systems/
27
27
7
258
20,437
There is so much more to be discovered
In language models, turning a generative model into a critic is simple: pass in the output and prompt for a score. Robot policies can't do this - they output physical actions & there's no built-in vocabulary to predict scores. So when it comes to RL on robot policies, we typically train a separate critic from sparse rewards - blind to everything the policy learned from the actions in the pretraining data. We think this has it backwards - can a critic learn from those actions the way the policy does? (1/n)
51
Visiting Fellow, Ph.D. retweeted
Generative value classifiers are a new parametrization of Q-functions that don't require action conditioning. We think these may combine gracefully with large, pre-trained policies and learn/generalize better from a richer output signal. Paper: alexanderswerdlow.github.io/…
In language models, turning a generative model into a critic is simple: pass in the output and prompt for a score. Robot policies can't do this - they output physical actions & there's no built-in vocabulary to predict scores. So when it comes to RL on robot policies, we typically train a separate critic from sparse rewards - blind to everything the policy learned from the actions in the pretraining data. We think this has it backwards - can a critic learn from those actions the way the policy does? (1/n)
17
37
5
391
25,352
Visiting Fellow, Ph.D. retweeted
Just met an engineer at a top AI lab. Claims nobody goes to the office anymore, they just have agents running the work while they manage everything from a phone. Man is literally "working" from coffee shops and the beach. The future is wild.
173
45
30
1,555
170,057
Visiting Fellow, Ph.D. retweeted
The next frontier is AI that improves itself, and we believe everyone should know how to build it. This semester, Ao @ao_qu18465 and I are teaching 'How to AI an AI for Almost Anything' @MIT @medialab -- a new course on self-evolving AI systems that recursively improve from experience, feedback, memory, and exploration over long interaction horizons. The key idea: intelligence shouldn't stop improving when training ends. We cover four levels of evolution: (1) context evolution through prompt optimization and context management, (2) harness evolution through memory, tools & skills, workflow optimization, and multi-agent systems, (3) model evolution through RL, distillation, test-time training, self-play, and continual learning, (4) task evolution through generating increasingly complex synthetic tasks, simulations, evaluations, and environments. Slides, readings, and videos available: mit-mi.github.io/how2ai-cour… We thank @Kimi_Moonshot and @PrimeIntellect for generously sponsoring API credits!
43
160
12
1,177
64,462