Non-Euclidean + Interpretable AI PhD-ing @Geometric_Intel @UCSBPhysics Incoming MTS @GoodfireAI Prev. @Dodgers⚾️ @McGillUPhysics BlueSky: @mathildepapillon

Joined July 2022
Silico is out🔥 General-purpose human motion AI models can meaningfully detect Parkinson's gait impairment. But how do they do it?? I used Silico to break these models open and figure out what about someone's walk actually drives their predictions. 🧵
Silico, the platform for ambitious AI research, is publicly available today. AI is advancing fast. The tools to understand it need to advance even faster. Silico lets you interpret and train your models at frontier scale. Learn more + get access 🧵
6
23
6
111
18,532
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Great initiative from Goodfire! Fully agreed, interp is one of the most exciting open directions of our time imho!
Interpretability is the most important scientific problem of our lifetime. But it's too slow right now! I wrote some thoughts with @banburismus_ on how we might accelerate it. (Probably a good time to share that I'll be joining @GoodfireAI post PhD. I'm over the moon about it🌝)
2
24
1,124
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
understanding these alien intelligences is the most important scientific problem of our time. we’re starting a human genome project for AI so that we can fully understand neural networks if you’re interested in helping, we’d love to partner!
if any science should be revolutionised by AI, it should be interpretability. I wrote about how we can accelerate progress, and why we need a Human Genome Project for AI. coauthored with @mathildepapillo
8
7
1
98
3,225
Interpretability is the most important scientific problem of our lifetime. But it's too slow right now! I wrote some thoughts with @banburismus_ on how we might accelerate it. (Probably a good time to share that I'll be joining @GoodfireAI post PhD. I'm over the moon about it🌝)
if any science should be revolutionised by AI, it should be interpretability. I wrote about how we can accelerate progress, and why we need a Human Genome Project for AI. coauthored with @mathildepapillo
7
19
1
198
6,454
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
The most ambitious vision for interpretability has long been to reverse-engineer a model well enough to answer an arbitrary question about how it works. For years, that’s seemed out of reach. Now, we think it’s possible. Neural networks are cleaner than we thought: we can now understand most neurons in models up to trillions of parameters. And agents can rapidly accelerate our progress. But to get there, we need a concerted effort to unlock scaling laws for interpretability, where our understanding of a model grows predictably with compute. That’s why we’re committing $10M to start a Human Genome Project for AI. Our ultimate goal is to reverse-engineer a frontier scale model and publish a living encyclopedia explaining how it works. We don’t know exactly what we’ll find, and we can’t do it alone. We hope you’ll join us. Our chief scientist @banburismus_ lays out the vision here:
if any science should be revolutionised by AI, it should be interpretability. I wrote about how we can accelerate progress, and why we need a Human Genome Project for AI. coauthored with @mathildepapillo
10
45
7
488
18,895
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
My @PolymathicAI internship project is out! 🎉 We ask, can a foundation model trained on simulated physical systems predict how living embryo tissue flows? We finetuned Walrus on 12 wild-type 🪰Drosophila blastoderm videos and tested it on unseen conditions (vid from @embl )
2
17
2
60
4,396
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
“To our knowledge, this is the first AI system to pass a professional CAD certification.” I spent 4 months at Spectral Labs this summer. It was exciting to see a company tackle such interesting and ambitious geometry problems. Look forward to seeing what's next 🚀
We built the first AI system to achieve the industry standard CAD certification for mechanical engineers. Our agent autonomously built parts and assembled mechanisms, passing the SOLIDWORKS Professional exam in less than 3 hours. Details below, including a concerning discovery.
6
5
1
19
1,646
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Thanks @NSF for granting us a $1M award to advance the mathematical foundations of AI! W/ @HaewonJeong00 @YaoQin_UCSB Sanjukta K, we will study how AI learns higher-order interactions in physical systems: from 🌠 stars in galaxies to 🧠 neurons in the brain. @ucsbece @ucsbcs
15
12
4
111
6,107
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
NeurReps decisions are out! This year we accepted: - 126 extended abstracts - 60 proceedings - and 6 papers to the new findings track Thank you all for the high quality submissions! We look forward to seeing everyone in Sydney 🚀🇦🇺🐨
1
4
1
33
2,690
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Biosecurity is the next frontier of AI security. We built SOTA monitors so agents can do more biology, safely. Our monitors outperform frontier model safeguards with fewer refusals on dual-use tasks. They’re fast, real-time, and robust to adversarial attacks. 🧵
7
23
11
138
33,750
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Technical alignment is a science and engineering problem that we can and must solve, and interpretability is the bottleneck. I wrote up Goodfire’s plan to get there.
41
86
30
577
91,868
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
🧠 The Science of Intelligence 🧠 Check out the recordings/zooms of this new course at @Redwood_Neuro redwood.berkeley.edu/courses… Very excited to see how Jake, Mike, Bruno and others are transforming the Redwood into the new center for studying and designing a theory of intelligence ⭐️
2
29
139
6,311
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Are SAEs dead? Will they save us from neuralese? Should I just use a probe? We get these questions all the time. Part 2 of our educational series on applied interpretability explains what SAEs are good for, when *not* to use them, and what to use instead. 🧵
11
51
10
443
38,511
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
An alarming aspect of the OpenAI agent story, aside from the leaked images, is that the problems surfaced months later, and has been found by outsiders We need (1) strong independent verification and (2) fix monitoring now
1
5
60
3,150
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Control follows understanding, and understanding means scientific laws that predict behavior before it happens. Having access to Silico is a game-changer for this AI interpretability research! Thank you!
3
14
343
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Our lab was awarded a @GoodfireAI 's academic research grant 🌟 Many thanks to @GoodfireAI for supporting geometric intelligence research for AI interpretability and safety with free Silico usage.
Thank you @GoodfireAI for awarding our lab a research grant on: Geometric Intelligence for AI Interpretability and Safety!🌟 At @geometric_intel, we transform intelligence research from an expensive engineering endeavor into a mathematical science where we can predict behavior.
3
13
835
So excited to see this awesome tool (I'm biased) at work in my academic world🔥 It has helped me kickstart some exciting advances in explainable non-euclidean ML... stay tuned!
Thank you @GoodfireAI for awarding our lab a research grant on: Geometric Intelligence for AI Interpretability and Safety!🌟 At @geometric_intel, we transform intelligence research from an expensive engineering endeavor into a mathematical science where we can predict behavior.
5
36
1,667
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Every mature engineering discipline found another route to safety. We do not keep bridges standing by watching them closely. We understand the loads they carry to compute, in advance, what they can bear. Safety follows understanding. Understanding means scientific laws that predict behavior before it happens. Can we write such laws for intelligence? I believe that we can, that the mathematics for it already exists, and that they apply across brains and machines. 🤖 🧠 Join the discussion on Oct 7th!
2
5
17
599
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
🗓️ Join me on October 7 for one of the inaugural lectures of the Science of Intelligence Institute at @UCBerkeley ! Can we write scientific laws for intelligence? I believe that we can, that the math for it already exists, and that they apply across brains & machines. tinyurl.com/mvrfs39w
2
18
3
84
5,590
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
we can find reward hacks on open frontier models with interpretability, including hacks that strong llm monitors miss! interestingly, the relevant representations seem to be about cheating in general, rather than task-specific
Models know when they’re reward hacking. But they still do it a ton - in 50-96% of rollouts we studied! We built activation monitors that detect the behavior behind the Hugging Face hack in real time. This can help us stop hacks now - and train future models that don’t cheat. 🧵
3
3
44
2,062