mts @ stealth | she/her
San Francisco, CA
Joined October 2019
- Tweets48
- Following42
- Followers19
- Likes113
ackermannkitten retweeted
Finally releasing the results of the arch ablations I was running with bux over the weekend
ackermannkitten retweeted
or make good dense RL environments
that is seemingly the future
RL against rubrics quietly reward-hacks: the training judge keeps scoring higher while true quality falls.
One-line fix: randomly drop part of the rubric each step, so the policy never optimize the same set of rubrics twice.
📄 arxiv.org/abs/2608.11669
