m6

excited to announce a proposal from @flockcap and Wakaru: ontologize mixture-of-experts interpretability where the features are the parameters. instead of an SAE's flat bag of directions, you get stacks of contrastive classifiers you can read from weights and poke directly 🧵