
Founder Experience @OpenAI Building for Builders
London, England
Joined July 2017
- Tweets855
- Following828
- Followers9.4K
- Likes5.1K
Introducing the Arena Alignment Index, our new benchmark measuring safety and alignment of AI agents in real-world use.
Built from 90K+ real-world agent sessions across 27 models, the index measures three critical signals:
- Unauthorized Action (UA): Taking actions beyond the user's instructions or permissions
- False Attribution (FA): Attributing statements or actions that are contradicted by user-provided evidence
- Deceptive Completion (DC): Claiming a task was completed when it was not.
Key findings:
- OpenAI models currently lead the Alignment Index
- Rogue actions are rare, but can have serious consequences when they occur
- Agents can mislead users about task progress
- Misalignment risks increase with conversation length
- Safety and alignment are improving across model generations
As shown in the leaderboard below (sorted by lab), @OpenAI’s GPT-6.1-Sol leads the Arena Alignment Index with a score of 87.9, followed by @AnthropicAI’s Claude-Opus-5.5 at 83.2 and @spacexai's Grok-4.7 at 82.7. OpenAI also has the best observed rates across all three signals: 0.89% Unauthorized Action, 1.98% False Attribution, and 2.34% Deceptive Completion.
Across all four labs, newer models consistently outperform their predecessors, suggesting broad progress in agent safety and alignment. As agents take on longer, more complex, and higher-stakes tasks, measuring not just what they can accomplish, but how safely and reliably they act, becomes increasingly important.
This marks an important step toward making safety and alignment a core part of how Arena evaluates AI. The index is an initial starting point, and we'll continue expanding the index with additional safety signals and models over time.
More analysis below👇
Demo day @a16z Speedrun SR007 starting strong with hard physical AI setting the tone today
AI exposes the people who want to ride life vs drive life
Wisdom by @tewfik10
This is probably one of the most relevant state of the market events you can see today. @garrytan 🫡
The Startup Industrial Base: Building for the Next 250 — Washington, D.C. xitter.cf/i/broadcasts/1jGXgBpjE…
This @sama is the leader we follow
The one who believes that the future belongs to all of you.
And I'm proud of being part of this team.
The exact moment my two favourite French men had a crossover episode @romainhuet x @Thom_Wolf x 🦆
Macron has got nothing on @romainhuet 😎 but the French swagger is on 🔥
We are very proud to be founding partners of The Horowitz Andreessen Academy and I could not be more excited for the future of Entrepreneurship and Builder Education.
The Academy, is led by @gaganbiyani, backed by @a16z, and @eriktorenberg and @pmarca are on the board.
It is based in SF, and will serve the most promising young high school graduates to learn to build in and for the AI era.
THIS is what the nextgen of the best founders have been waiting for.
Applications are open theacademysf.com
And if you're in London join us on the 23rd to celebrate here !
The local research teams were core contributors to Astra and we would love to see you here!
events.openai.com/gpt-6-lond…
We want to celebrate with people using GPT-6. We did this for GPT-5.5 and it was really fun.
We’re getting together in SF on September 16 to talk about the model, what we should build next, and mostly just to hang out.
Apply by Sep 10:
gpt6-launch-event.openai.cha…
I think that Startups with the same level of intention in the development of their product as they do in the development of their people can grow faster.
The best people will be hungry for personal development and will be your warriors, so plan for it.
Laura Modiano retweeted
OpenAI is winning enterprise spend at the frontier. As of this week, Astra takes 13% of enterprise AI spend vs. Fable (8%) per Ramp data.
Some early thoughts:
1. Anthropic took a big risk in its recent call to pace the frontier. It's frontier model has already fallen behind on adoption.
2. OpenAI's growth is primarily coming from shifts from Sol and some Anthropic models, net-new usage too. That's good for them and suggests some pricing power remains by having a good, competitive frontier model.














