
mechinterp, alignment & safety @flockcap, part-time independent journalist opinions my own đź’Ť @computerphile
Seattle / San Francisco
Joined March 2020
- Tweets11.3K
- Following1.1K
- Followers23K
- Likes32.3K
celeste retweeted
Replying to @amplifiedamp @WakaruLabs
While the Wakaru ontologizer performs worse that traditional methods on this particular dataset in terms of FVU and reconstruction, it produces significantly more useful labels by spreading differentiating capacity across heads
if you want the boring version with 77 pages of ablations:
flock.holdings/research/onto…
fun demo! this runs on the ontologizer work we’ve been doing.
sparse autoencoders can’t make this chart. they give you a bag of 16k latents per person. an ontologizer gives every attendee a discrete code word, which is why you get a typology instead of a feature dump.
At @WakaruLabs, we needed to decide who to prioritize talking to at EA Global. I used a truebase's residual stream activations and our library to make a color-coded ontologizer of conference attendees
celeste retweeted
At @WakaruLabs, we needed to decide who to prioritize talking to at EA Global. I used a truebase's residual stream activations and our library to make a color-coded ontologizer of conference attendees
celeste retweeted
Temple
She loves Factorio
Crack for autistic systems thinkers and engineers hyperoptimizers
Eventually she figured out in the lategame that the ultimate bottleneck is your computer’s memory and processing power to “hold state” on the entire map and gigabase, and you’d have to optimize for that
Every bottleneck you solve…creates the next bottleneck somewhere else
celeste retweeted
CLAUDE FOUND THE SEEDS
anthropic.com/research/ecdsa…
Replying to @kennethnym @vivariumsf
i gave you an hug and hour ago dude how did you forget where you were 💀💀💀








