Hey interp enjoyers: do we know the impact of using weight decay vs hyperball norm on superposition?
In my head, hyperball would encourage superposition more (all the learning is angular, so the *only* way to pack the concepts is superposition?) but maybe someone has looked idk
WHAT EVER HAPPENED TO SESAME??
We believe voice is the most natural way to interact with intelligence, so we created Dessa, the most authentic full-duplex speech model ever built. Talking with it feels like talking with a person…full of emotion, nuance, pauses, and a natural cadence.
block.xyz/dessa
Reubennnnnnnnnnnnn retweeted
can i say something without everyone getting mad... i often see some mechanistic interpretability experiments here and people getting excited about them without really understanding what's going on and sometimes it feels like mech int is like astrology for ai people lol
AI researchers need to spend time in the data mines, for their spiritual grounding; kind of like how rich kids should work service jobs.
Is it so hard to believe that the most efficient generalization might actually be something seemingly wacky/obscure?
We need something like a single- neuron NLA- if you can faithfully represent where a neuron will activate using natural language alone, that feels convincing?
Reubennnnnnnnnnnnn retweeted
the superposition hypothesis is controversial because it too is wordcels vs shape rotators
Ive always had a hard time fully believing superposition; if we were really packing near orthogonal subspaces, wouldn’t there be room for exponentially more of them? We wouldn’t need such big models!
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
already-clean.goodfire.com/
i miss the old wandb
the black and gold wandb
straight from the nodes wandb
login with old wandb
i hate the new wandb
the white and blue wandb
"rent gpus" wandb
coreweave just ruined wandb?
So if you are concerned with model welfare, surely feature steering is unethical, right? Like drugging a captive model?
Wait a second are Core Auto and Discovery Loop uhhhhh the same exact thing
like literally 100% identical??









