current: 👨👩👧👦, @scale_AI prev: @benchmark, @ubereats, @axon_us
SF
Joined December 2006
- Tweets1.1K
- Following649
- Followers7.6K
- Likes2K
Was a blast leading @scale_ai over the last year as interim CEO, and I’m excited to see where Francis takes the company next!
Big News: I’m joining @scale_AI as CEO, starting August 10. Scale sits at a rare intersection, working with the top AI labs to push the frontier while helping enterprises and governments actually deploy AI they can verify and trust. I’m excited to lead a company with a mission to develop reliable AI systems for the most important decisions. More to come.
Introducing the 6% Report.
Everyone is talking about enterprise AI adoption, yet very few are producing real outcomes. Our new research shows only 6% of organizations have successfully deployed AI at scale and achieved measurable business value.
Here's what we found they’re doing differently:
scale.com/six-percent
10 years of Scale.
The AI reliability race is on. No shortcuts.
This month we turn 10.
The hard work started in 2016, and it hasn’t stopped.
Shortcuts are for losers. Winners welcome.
scale.com/careers
AI pretenders vs. AI contenders. It's those who still haven’t realized reliability is the product vs. those who can deliver reliability and outcomes. That's what the enterprise AI race comes down to. Here's a note I sent the Scale team this week.
The best AI systems improve by capturing how experts actually think, not just how they use the tools.
The companies that build that feedback loops well will improve fastest. Simple as that.
Thanks for the convo @Semafor!
Jason Droege retweeted
Breaking: @AIatMeta just released Muse Spark — now live across @ScaleAILabs leaderboards.
Here’s how it stacks up:
Tied for 🥇on SWE-Bench Pro
Tied for 🥇on HLE
Tied for 🥇on MCP Atlas
Tied for 🥇on PR Bench - Legal
Tied for 🥈on SWE Atlas Test Writing
🥈on PR Bench - Finance
🥉on SWE Atlas QnA
AI agents are getting put to work on real tasks. Training them to do that well is harder than it looks.
For the past year at @scale_AI, we've been building environments where agents can practice real workflows - simulated worlds that mirror real software, real processes, and real decisions.
They can fail, try again, and get better before they touch production. This process is how these agents eventually become reliable for the world’s most important decisions.
Today we're officially launching Scale RL Environments. Nearly half of our new training projects already run through them. We're building more this year.
See what your agents can learn: scale.com/blog/rl-environmen…
2025 was a historic year for Scale - we closed with our best revenue quarter ever. This is a testament to the Scale team for continuously delivering the outcomes that our customers crave: Data that improves models + applications that actually work for enterprises and governments.
Jason Droege retweeted
Today, we are thrilled to introduce the TIME AI Agent, created by @TIME in partnership with @scale_AI. This new platform combines @TIME’s trusted journalism with generative technology, enabling readers to engage with @TIME’s reporting in new ways.
Use the TIME AI agent to summarize or analyze a story, generate an audio version or translate an article, search TIME’s 100+ year archives for answers, chat in real time, and more.
This first-of-its-kind AI technology is creating journalism that listens and responds responsibly, informed by TIME’s archives and bound by TIME’s editorial standards.
Thank you to the team behind the TIME AI Agent, including TIME Chief Operating Officer @markdhoward, TIME Editor in Chief @sampjacobs, and @scale_AI CEO @jdroege.
Find the story behind the TIME AI agent by @markdhoward here: time.com/7332572/the-story-b… and read more from @axios' @sarafischer and @kerrymflynn here:
axios.com/2025/11/10/time-ai…
Sat down with @lennysan to talk about where AI is headed and how we’re making it work for model builders, enterprises and governments. Also went down memory lane about my time at Uber Eats. 🙂
In his first in-depth interview since taking over as @scale_AI CEO, @jdroege shares:
🔸 What actually happened with Meta’s $14 billion investment
🔸 Where frontier labs are heading next
🔸 Why most enterprise data is useless for AI models
🔸 What it takes to keep making AI model smarter
🔸 What he learned scaling Uber Eats from zero to $80B
🔸 How to think independently when building new products and businesses
🔸 Much more
Listen now 👇
• YouTube: youtu.be/W99jdYZOlN0
• Spotify: open.spotify.com/episode/3WY…
• Apple: podcasts.apple.com/us/podcas…
Thank you to our wonderful sponsors for supporting the podcast:
🏆 @merge_api — The fastest way to ship 220+ integrations: merge.dev/lenny
🏆 @figma Make — A prompt-to-code tool for making ideas real: figma.com/lenny/
🏆 @mercury — The art of simplified finances: mercury.com/
We’re introducing SEAL Showdown, the AI leaderboard that actually captures real preferences, powered by a platform used by real people.
Public benchmarks today rely on contrived tasks or narrow user groups. That leaves us guessing which models are actually preferred by people.
SEAL Showdown changes that.
Model performance can now be segmented by demographics and domains. Rankings aren’t just a single global average, they can be broken down by region, profession, education level, age and more, giving a nuanced view of how models work for different people.
SEAL Showdown sets a new bar, because AI should be judged by how well it works for everyone.
Excited to chat with @m_ccuri at the Axios AI Summit later this afternoon
Catch @scale_AI CEO @jdroege in conversation with Axios’ @m_ccuri tomorrow, Sept. 17 at the #AxiosAISummit in D.C.:
Livestream starts at 2:00pm ET
Watch here: trib.al/HGODLWE
I will be going on @TBPN at 1pm PT to talk about Scale, our momentum, and how to make AI work for businesses and governments.
Morning. On today’s show:
– @TheStalwart (Odd Lots Podcast)
– @jdroege (Scale AI)
– @anothercohen (Hello Patient)
– @habbott (Augment)
– @david_marra (Rivet Industries)
– @tuhinone (Baseten)
See you all on the stream.
Proud of our continued work supporting the @USArmy!
Proud to share we’ve been awarded a $99M contract to support the acceleration of the @USArmy's adoption of AI.
This contract reflects our long-term commitment to ensuring America’s military remains prepared, resilient, and at the forefront of AI innovation.
We're just getting started.
Scale AI not 'winding down' following Meta deal, interim CEO tells employees and customers cnbc.com/2025/06/18/scale-ai…
