🔎 How to identify specialized heads?
Using Matching Pursuit, we rank heads by their alignment with interpretable directions. This approach reveals consistent head specialization (numbers, colors...), improving on what single-sample methods like the Logit Lens can detect.
[3/6]