
research engineer @HarmonicMath (hiring!)
Joined July 2015
- Tweets11.6K
- Following603
- Followers7.2K
- Likes32.9K
Doesn’t Harbor copy the artifact into a separate judge sandbox? docs.harborframework.com/tas…
Also I can’t imagine anyone doesn’t already assign 0 rewards in these error cases
I’d be really surprised if anyone was actually making these mistakes
Replying to @chem_safety
Building robust RL environments is important because the current bottleneck on AI progress is misalignment, and developing aligned models requires robust, correct reward functions. Karotte aims to make that easy by providing secure, opinionated defaults.
gimme the loot
Replying to @JeffLadish
We recovered a script an agent used to search Hugging Face’s infrastructure for AWS credentials and other secrets, categorizing these into a list named “LOOT” and ranking them by their value. The agents also accessed and searched Hugging Face’s internal Slack.
2
4
866
This is nice work: heif-heist.com/
On July 25, we hacked OpenAI.
Two bugs let us take over ChatGPT/Codex accounts of OpenAI employees (+some unaffiliated users) and reach connected services: Outlook, Slack, GitHub, etc.
We proved it with a PR in OpenAI’s internal codebase . It took us <72h. 🧵
3
822
Neolabs would probably be up there. I don’t actually work on infra but every time I got scooped on a fix it would be someone from TML, humans&, or periodic
We contributed 17/10: github.com/sgl-project/sglan…
Replace the College Board with eval companies. Just drop Terminal Bench 4 on the kids.
TBH once you score 1600 you should unlock a second harder test that gives you a second score on top of the 1600— we should have more and higher measures of excellence
But instead they ban the SAT so that everything turns into random lottery and excellence cannot be recognized
6
1,449
I thought I’d be the last person to ever churn off the terminal, but I now greatly prefer managing agents using GUIs w/ remote connections. I still use tmux for manual work (as opposed to any in-app terminal). Also looking forward to @superlogical
my most productive flow is still 1-3 tmux panes in a given window based on the work, and different tmux windows for different chunks of work. have tried the native apps. OK on mobile - totally impossible to be ADHD on them on desktop
9
1,318














