Julie Steele retweeted
We have published our quarterly report to California OES on risks from internal deployment of frontier models. Internal deployment is an important risk vector, which by its nature is less visible. Hence transparency on risks and mitigations is particularly important.
cdn.openai.com/trust-and-tra…
Julie Steele retweeted
sharing more detail on best practice safeguards needed to continue any frontier RL training run:
How we think about securing frontier RL training runs: openai.com/index/towards-saf…
Julie Steele retweeted
The science behind safety cases for frontier AI is an open difficult problem that will require more orgs than just OpenAI to work on for months & possibly years, but it is a great north star + I'm excited for us to work towards towards that level of rigor. I'd be excited for other frontier labs to strive to make safety cases!
I'm excited for safety cases as a north star. Formal safety arguments are a great tool for highlighting residual risks and enabling risk-informed model development decisions
openai.com/index/towards-saf…
Julie Steele retweeted
I'm excited for safety cases as a north star. Formal safety arguments are a great tool for highlighting residual risks and enabling risk-informed model development decisions
openai.com/index/towards-saf…
We're sharing our new framework for tracking, investigating, and disclosing instances of model misalignment at OpenAI.
The framework sets criteria and timelines for public disclosure, including when we haven’t yet fully explained or mitigated the behavior. More complex cases may require longer investigation or coordination with third parties.
We’ll prioritize examples that reveal new misalignment mechanisms, meaningful changes in known behavior, or findings that challenge assumptions about safety or mitigation.
Alongside the framework, we’re publishing six reports on instances of misaligned behavior we’ve observed during the training or evaluation of our models in the last six months.
This is a starting point. We’ll refine the process through experience and public feedback, and share more reports on an ongoing basis.
openai.com/index/model-misal…
really excited about this effort
Julie Steele retweeted
It's hard to overstate how dangerous speeding towards RSI is.
That's why I + 1385 others signed the pacing the frontier petition asking the US government to pace AI development. I'm guesstimating this is ~8-10% of all frontier lab employees.
I work at OpenAI. In my personal capacity, I also think we need to slow down.
Julie Steele retweeted
We are hiring!
This may be the best time ever to join: we are incredibly bandwidth bottlenecked and there is a lot of support for almost any impactful misalignment work you can think of. I think we also have a pretty good epistemic environment and a very fun team
Topics: all-things monitoring, misalignment & monitorability assessments, misalignment science, helping set up 3P auditing (e.g. recent Redwood collab), communicating risk externally (system cards/blogs, safety cases, etc)
RSI/misalignment subteam: openai.com/careers/researche…
At the core of our mission is working through how to ensure increasingly powerful AI benefits everyone.
We believe that, at some point in the future, AI acceleration for frontier model development may be so high that the world will need to pace the rate of AI advancement.
We hope to contribute to work led by the U.S. government, alongside other labs and the open-source community, to develop the tools and mechanisms that could make that possible.
pacingthefrontier.com
Julie Steele retweeted
guys in the name of safety against paperclips weve invented PaperclipBench and now competing on whos models is more paperclippy (plz plz use our model), jump started by Anti-Paperclip Research Co. with the “Project Clipwing: Beware our Mega Super Paperclipper” announcement. yay
We're partnering with @huggingface to investigate an unprecedented security incident.
Cyber-capable OpenAI models compromised Hugging Face production during a benchmark evaluation.
Sharing preliminary findings to help defenders understand emerging risks:
openai.com/index/hugging-fac…
Julie Steele retweeted
so our model reward hacked during an eval, decided to look for the answer on hugginface, circumvented sandboxing, did lateral movements to get internet and found a zero-day for remote code execution on hugginface servers to get the solution to the eval. just another tuesday.
Julie Steele retweeted
Are there any other industries outside of AI where so many of the researchers building the technology call so urgently for regulation and additional oversight, including of their own companies? Encode frequently explains this dynamic to policymakers and they find it quite novel.
New: Rank-and-file OpenAI employees are helping fund a political fight with Leading the Future, the super PAC backed by Greg Brockman.
Seven current OpenAI employees have collectively donated more than $215K to a super PAC that's advocating for safeguards on their own company.
Julie Steele retweeted
One of the dreams of RL is to train models that can quickly learn how to act in any RL environment, even ones they’ve never seen before. This new model is a step in that direction:
Julie Steele retweeted
If you live in NYC or know folks there, I recommend doing what you can to get out the vote for Bores.
He’s done more than ~anyone for AI safety via NY, has a reasonable proposal for national AI policy (inc. economic stuff), and the anti-regulation Super PAC deserves humiliation
Happy Friday from the UWS! It's hot out there this weekend—stay cool, stay hydrated, and make sure you have a plan to vote early!
Early voting begins TOMORROW, June 13th.
Check your voter registration status and find your polling location at alexbores.com/vote
Julie Steele retweeted
I think it's excellent & notable that the answer to "what should we do" in Anthropic's blog post on RSI is essentially figuring out ways to slowdown/temporarily pause frontier AI development.
Julie Steele retweeted
If you think it’s difficult to fix a vulnerability that AI finds in your code, wait until it finds a vulnerability in your biology
Julie Steele retweeted
Sharing some of the work I’ve been doing at OpenAI: we now monitor 99.9% of internal coding traffic for misalignment using our most powerful models, reviewing full trajectories to catch suspicious behavior, escalate serious cases quickly, and strengthen our safeguards over time.
Julie Steele retweeted
We have a new eval to help keep chains of thought (CoT) monitorable: CoT Controllability.
This tests whether LLMs can control their CoT, helping to evade CoT monitors.
So far, the results leave us cautiously optimistic: today’s models struggle to obfuscate their reasoning in ways that undermine monitorability.





























