
Non-Euclidean + Interpretable AI PhD-ing @Geometric_Intel @UCSBPhysics Incoming MTS @GoodfireAI Prev. @Dodgers⚾️ @McGillUPhysics BlueSky: @mathildepapillon
Joined July 2022
- Tweets508
- Following393
- Followers2.7K
- Likes1.2K
Silico is out🔥
General-purpose human motion AI models can meaningfully detect Parkinson's gait impairment. But how do they do it?? I used Silico to break these models open and figure out what about someone's walk actually drives their predictions. 🧵
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Great initiative from Goodfire! Fully agreed, interp is one of the most exciting open directions of our time imho!
Interpretability is the most important scientific problem of our lifetime. But it's too slow right now! I wrote some thoughts with @banburismus_ on how we might accelerate it.
(Probably a good time to share that I'll be joining @GoodfireAI post PhD. I'm over the moon about it🌝)
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
you can also read it on our website: goodfire.com/blog/accelerati…
understanding these alien intelligences is the most important scientific problem of our time. we’re starting a human genome project for AI so that we can fully understand neural networks
if you’re interested in helping, we’d love to partner!
if any science should be revolutionised by AI, it should be interpretability. I wrote about how we can accelerate progress, and why we need a Human Genome Project for AI. coauthored with @mathildepapillo
Interpretability is the most important scientific problem of our lifetime. But it's too slow right now! I wrote some thoughts with @banburismus_ on how we might accelerate it.
(Probably a good time to share that I'll be joining @GoodfireAI post PhD. I'm over the moon about it🌝)
if any science should be revolutionised by AI, it should be interpretability. I wrote about how we can accelerate progress, and why we need a Human Genome Project for AI. coauthored with @mathildepapillo
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
The most ambitious vision for interpretability has long been to reverse-engineer a model well enough to answer an arbitrary question about how it works.
For years, that’s seemed out of reach. Now, we think it’s possible. Neural networks are cleaner than we thought: we can now understand most neurons in models up to trillions of parameters. And agents can rapidly accelerate our progress.
But to get there, we need a concerted effort to unlock scaling laws for interpretability, where our understanding of a model grows predictably with compute.
That’s why we’re committing $10M to start a Human Genome Project for AI. Our ultimate goal is to reverse-engineer a frontier scale model and publish a living encyclopedia explaining how it works.
We don’t know exactly what we’ll find, and we can’t do it alone. We hope you’ll join us. Our chief scientist @banburismus_ lays out the vision here:
if any science should be revolutionised by AI, it should be interpretability. I wrote about how we can accelerate progress, and why we need a Human Genome Project for AI. coauthored with @mathildepapillo
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
My @PolymathicAI internship project is out! 🎉 We ask, can a foundation model trained on simulated physical systems predict how living embryo tissue flows? We finetuned Walrus on 12 wild-type 🪰Drosophila blastoderm videos and tested it on unseen conditions (vid from @embl )
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
“To our knowledge, this is the first AI system to pass a professional CAD certification.”
I spent 4 months at Spectral Labs this summer. It was exciting to see a company tackle such interesting and ambitious geometry problems. Look forward to seeing what's next 🚀
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Thanks @NSF for granting us a $1M award to advance the mathematical foundations of AI!
W/ @HaewonJeong00 @YaoQin_UCSB Sanjukta K, we will study how AI learns higher-order interactions in physical systems: from 🌠 stars in galaxies to 🧠 neurons in the brain.
@ucsbece @ucsbcs
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
NeurReps decisions are out! This year we accepted:
- 126 extended abstracts
- 60 proceedings
- and 6 papers to the new findings track
Thank you all for the high quality submissions! We look forward to seeing everyone in Sydney 🚀🇦🇺🐨
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Biosecurity is the next frontier of AI security. We built SOTA monitors so agents can do more biology, safely.
Our monitors outperform frontier model safeguards with fewer refusals on dual-use tasks. They’re fast, real-time, and robust to adversarial attacks. 🧵
Technical alignment is a science and engineering problem that we can and must solve, and interpretability is the bottleneck. I wrote up Goodfire’s plan to get there.
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
🧠 The Science of Intelligence 🧠
Check out the recordings/zooms of this new course at @Redwood_Neuro redwood.berkeley.edu/courses…
Very excited to see how Jake, Mike, Bruno and others are transforming the Redwood into the new center for studying and designing a theory of intelligence ⭐️
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Are SAEs dead?
Will they save us from neuralese?
Should I just use a probe?
We get these questions all the time. Part 2 of our educational series on applied interpretability explains what SAEs are good for, when *not* to use them, and what to use instead. 🧵
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
An alarming aspect of the OpenAI agent story, aside from the leaked images, is that the problems surfaced months later, and has been found by outsiders
We need (1) strong independent verification and (2) fix monitoring now
New from @reuters: OpenAI agents posted images belonging to ChatGPT users online, introducing a new area of privacy risk for the company. Story w/ @JeffHorwitz and @razhael. reuters.com/world/openai-wor…
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Control follows understanding, and understanding means scientific laws that predict behavior before it happens.
Having access to Silico is a game-changer for this AI interpretability research! Thank you!
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Our lab was awarded a @GoodfireAI 's academic research grant 🌟
Many thanks to @GoodfireAI for supporting geometric intelligence research for AI interpretability and safety with free Silico usage.
Thank you @GoodfireAI for awarding our lab a research grant on: Geometric Intelligence for AI Interpretability and Safety!🌟
At @geometric_intel, we transform intelligence research from an expensive engineering endeavor into a mathematical science where we can predict behavior.
So excited to see this awesome tool (I'm biased) at work in my academic world🔥 It has helped me kickstart some exciting advances in explainable non-euclidean ML... stay tuned!
Thank you @GoodfireAI for awarding our lab a research grant on: Geometric Intelligence for AI Interpretability and Safety!🌟
At @geometric_intel, we transform intelligence research from an expensive engineering endeavor into a mathematical science where we can predict behavior.
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
Every mature engineering discipline found another route to safety. We do not keep bridges standing by watching them closely. We understand the loads they carry to compute, in advance, what they can bear.
Safety follows understanding. Understanding means scientific laws that predict behavior before it happens.
Can we write such laws for intelligence? I believe that we can, that the mathematics for it already exists, and that they apply across brains and machines. 🤖 🧠
Join the discussion on Oct 7th!
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
🗓️ Join me on October 7 for one of the inaugural lectures of the Science of Intelligence Institute at @UCBerkeley !
Can we write scientific laws for intelligence? I believe that we can, that the math for it already exists, and that they apply across brains & machines.
tinyurl.com/mvrfs39w
Mathilde Papillon🦋 mathildepapillon .bsky .social retweeted
we can find reward hacks on open frontier models with interpretability, including hacks that strong llm monitors miss! interestingly, the relevant representations seem to be about cheating in general, rather than task-specific




















