Joined October 2023
Hey interp enjoyers: do we know the impact of using weight decay vs hyperball norm on superposition? In my head, hyperball would encourage superposition more (all the learning is angular, so the *only* way to pack the concepts is superposition?) but maybe someone has looked idk
1
12
WHAT EVER HAPPENED TO SESAME??
We believe voice is the most natural way to interact with intelligence, so we created Dessa, the most authentic full-duplex speech model ever built. Talking with it feels like talking with a person…full of emotion, nuance, pauses, and a natural cadence. block.xyz/dessa
9
Reubennnnnnnnnnnnn retweeted
can i say something without everyone getting mad... i often see some mechanistic interpretability experiments here and people getting excited about them without really understanding what's going on and sometimes it feels like mech int is like astrology for ai people lol
14
12
5
335
12,620
AI researchers need to spend time in the data mines, for their spiritual grounding; kind of like how rich kids should work service jobs.
1
13
Is it so hard to believe that the most efficient generalization might actually be something seemingly wacky/obscure? We need something like a single- neuron NLA- if you can faithfully represent where a neuron will activate using natural language alone, that feels convincing?
Blogpost: "Neural networks are already clean" Me: this neuron fires on Colorado. Also Tornado framework code. Also Bolivia, Kivy, Caffe2, and the Kyrgyz language. Seems not v clean Everyone: but don't you see! In Sanskrit numerology "Tornado" is exactly twice "Colorado"
23
Reubennnnnnnnnnnnn retweeted
the superposition hypothesis is controversial because it too is wordcels vs shape rotators
1
28
1,842
Reubennnnnnnnnnnnn retweeted
what a day huh
7
1
94
3,806
Ive always had a hard time fully believing superposition; if we were really packing near orthogonal subspaces, wouldn’t there be room for exponentially more of them? We wouldn’t need such big models!
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
1
40
The pessimistic take, if models aren’t doing superposition, then they are probably already packing knowledge near-optimally -> no super smart tiny models :(
13
I forgot to poast my flyslop!
17
I am so glad this twitter niche exists
ah yes, the traveling pizzaman(?) problem
19
Stochast parrot people in shambles
15
i miss the old wandb the black and gold wandb straight from the nodes wandb login with old wandb i hate the new wandb the white and blue wandb "rent gpus" wandb coreweave just ruined wandb?
1
1
115
Reubennnnnnnnnnnnn retweeted
#REPORT: Seattle’s Link has Officially Been Named #1 BUSIEST Light Rail System in the United States with Over 169K Daily Riders
38
51
33
1,088
176,818
can't spell neurips without RIP
1
107
So if you are concerned with model welfare, surely feature steering is unethical, right? Like drugging a captive model?
19
Wait a second are Core Auto and Discovery Loop uhhhhh the same exact thing like literally 100% identical??
22
can't spell gemini without mini
15
I feel like the matrix would constantly be doing a/b testing
1
17
Dude I keep misreading causal as casual ahh yeah you know, just a casual encoder/decoder, no big deal
1
2
555