Edouard Leurent (@eleurent) header
Edouard Leurent (@eleurent) profile picture

Gemini Pretraining @GoogleDeepMind, RS. Birds, poetry, games, robots

London, England
Joined April 2009
Photo by Edouard Leurent (@eleurent)Photo by Edouard Leurent (@eleurent)Photo by Edouard Leurent (@eleurent)Photo by Edouard Leurent (@eleurent)Photo by Edouard Leurent (@eleurent)Photo by Edouard Leurent (@eleurent)Photo by Edouard Leurent (@eleurent)Photo by Edouard Leurent (@eleurent)Photo by Edouard Leurent (@eleurent)Photo by Edouard Leurent (@eleurent)
Google’s Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5, and second only to Claude Opus 5.5 on the Artificial Analysis Coding Agent Index Gemini 4 Carbon scores 59 on Intelligence Index v5, driven by leading performance in complex reasoning, knowledge, and scientific tasks. It also has large gains in coding and knowledge work, particularly when compared to other Gemini models, but it is not leading in all these areas. As with launch of Gemini 4 Argon, Gemini 4 Carbon is being rolled out to selected users and is not yet publicly available. Google is offering a 50% launch discount, with no confirmed end date. All our charts and figures use standard pricing for both Gemini 4 Carbon and Argon. Key results for Gemini 4 Carbon with high reasoning: ➤ Gemini 4 Carbon leads the Intelligence Index v5, with the #1 score in 4 of the 9 Index evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience, AutomationBench-AA. Carbon makes substantial gains elsewhere but is not leading in coding and knowledge work ➤ Behind only Claude Opus 5.5 on coding agents: With Antigravity CLI, Gemini 4 Carbon (high) scores 59 only 3 points behind Claude Code with Claude Opus 5.5 (max, 62) on the Artificial Analysis Coding Agent Index. Carbon ranks second on both Terminal-Bench 4.0 (64%) and FrontierCode v1.1 (51%), behind Claude Opus 5.5 (max) at 56%. Google has historically underperformed in this area and so this improvement stands out ➤ Improved agentic knowledge work, but not yet leading: On AA-Briefcase, Gemini 4 Carbon (high) scores 1609 Elo, a 126-point improvement over Gemini 4 Argon (high, 1483), but still behind models including Grok 4.7 (xhigh, 1638), Muse Wonder (max, 1659) and Kimi K3.1 Pro (1678). The largest gain comes from Presentation, up 293 Elo to 1598, alongside a 120-point improvement in Analytical Quality to 1671 ➤ Lower Cost per Task than Claude Opus 5.5 for comparable overall intelligence: Gemini 4 Carbon costs $7.76 per Intelligence Index task, ~23% less than Claude Opus 5.5 (max, $10.04) but ~1.2x GPT-6 Astra (max, $6.25). It uses 123k output tokens per task, 29% fewer than Claude Opus 5.5 (max, 173k). At the same $4/$20 standard pricing, its Cost per Task is in line with Gemini 4 Argon ($7.68), while scoring 9 points higher on the Intelligence Index ➤ Leading AA-Omniscience v1.1 score, with low hallucination: Gemini 4 Carbon scores 54 on our recently updated AA-Omniscience v1.1, 6 points ahead of Claude Opus 5.5 (max, 48) and 8 points ahead of Gemini 4 Argon (46). Accuracy (% correct) rises 10 points over Argon to 58%, while its hallucination rate rises from 4% to 11%. This is still the second lowest of any model, behind only Argon, compared with 50% for both Claude Opus 5.5 (max) and GPT-6 Astra (max) Key model details: ➤ Context Window: 1M tokens ➤ Multimodality: Text, image, video, and speech input, with text output ➤ Pricing: $4/$20 per 1M input/output tokens, the same as Gemini 4 Argon’s standard pricing, with a 50% discount. Cached input tokens receive a 95% discount ($0.20 per 1M) Congratulations to the @GoogleDeepMind team!
270
440
336
4,845
596,001
Edouard Leurent retweeted
I did say we'd be releasing our models periodically...introducing Gemini 4 Carbon, our next frontier model. Following Argon's release just two weeks ago, Carbon shows the pace at which we’re pushing the frontier, it ranks #1 on the recently updated v5.0 of @ArtificialAnlys Intelligence Index at 59. It also leads across key cybersecurity evaluations scoring 88.2% on SEC-bench Pro for finding vulnerabilities, 54.8% on ExploitGym for exploitation, and 71.0% on CWE-bench for patching. We’re seeing significant improvements in long-horizon tasks even compared to Argon, and we’ve strengthened frontier safeguards. As we did with Argon, we’re going to roll it out gradually + responsibly. Some trusted cyber defenders will get access starting this week. We'll be expanding it to more partners through our Fairwind Program, ahead of wider availability soon, so hang tight!
2,004
2,623
1,853
32,897
6,225,489
Edouard Leurent retweeted
The Gemini Large Scale Pretrain team is hiring a Research Engineer in London or MTV! The team works across the pretrain stack: research codebases, distributed training infra, data pipelines, tooling for training dynamics analysis, and most importantly using Gemini to accelerate our work! 🚀 If you're an engineer who has a strong "whatever it takes" attitude and is not afraid of spending tokens, apply here with some showcase work: google.com/about/careers/app… No particular qualifications needed, and we welcome early career applicants. Join if you want me to bug you with refactors to enable [new AGI compute multiplier]! 👀
14
61
4
565
58,733
Edouard Leurent retweeted
Introducing Gemini 4 Argon – our new frontier model. It’s built for complex workflows across coding, enterprise knowledge work, and cybersecurity defense – rolling out today to a set of trusted testers through our Fairwind Program.
1,986
4,630
4,527
42,815
9,031,463
Edouard Leurent retweeted
Very excited to share that an advanced version of Gemini Deep Think is the first to have achieved gold-medal level in the International Mathematical Olympiad! 🏆, solving five out of six problems perfectly, as verified by the IMO organizers! It’s been a wild run to lead this effort and I am grateful to everyone in the team for such an amazing achievement! Blog post in the thread and more to share soon!
Super thrilled to share that our AI has has now reached silver medalist level in Math at #imo2024 (1 point away from 🥇)! Since Jan, we now not only have a much stronger version of #AlphaGeometry, but also an entirely new system called #AlphaProof, capable of solving many more Olympiad problems. This is a large-scale project that I was fortunate to co-lead at @GoogleDeepMind! See our blog & NYT articel below! Blog: dpmd.ai/imo-silver NYT: nytimes.com/2024/07/25/scien…
79
219
71
1,888
654,979
Writing a STRONGLY WORDED LETTER with Gemini Diffusion and its Instant Edit tab
1
7
28
2,581
Edouard Leurent retweeted
The Future of Development: Gemini Diffusion
19
87
35
945
129,962
Edouard Leurent retweeted
Such a privilege to work on Gemini Diffusion with an amazing team! From a small research project to launching at I/O - we've got unstoppable aura 🚀 Welcome to the era of live vibe coding ⚡️
3
8
3
40
8,199
Our model is out there in the world! 🚀 It's been the highlight of my career to be part of this outstanding team. It's been incredible to see how fast Text Diffusion went from moonshot into reality. And speaking of fast... 1000+ tokens per second!
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model. Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
1
4
18
1,592
Edouard Leurent retweeted
As I was saying: it's happening
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model. Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
7
42
686
50,676
Excited to share what I've been up to: Gemini Diffusion is FAST! I'm convinced this will revolutionise iterative workflows: refine, get instant feedback, repeat! So proud of what our small team achieved here🪐
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model. Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
5
16
116
12,410
Edouard Leurent retweeted
It's been an incredible experience working on Gemini Diffusion. So much pride in what we've accomplished bringing this from a small research project to an I/O launch
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model. Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
2
11
102
12,921
Edouard Leurent retweeted
1000+ words per second! ⚡ We just unleashed Gemini Diffusion at #GoogleIO! 🚀 Awesome being part of the team that took this from a small research project all the way to I/O @GoogleDeepMind 🪐
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model. Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
5
30
2
132
9,297
It's been an incredible experience being part of the team that took this from a small research project all the way to I/O 🪐 Super proud of the team! @GoogleDeepMind
We’ve developed Gemini Diffusion: our state-of-the-art text diffusion model. Instead of predicting text directly, it learns to generate outputs by refining noise, step-by-step. This helps it excel at coding and math, where it can iterate over solutions quickly. #GoogleIO
1
7
15
681
Edouard Leurent retweeted
Steerability is the next frontier of generative models! Having knobs that control the behavior of AI systems will greatly improve their safety & usability. I’m very excited to present ✨Conditional Language Policy (CLP)✨, a multi-objective RL framework for steering language models, at #EMNLP2024 @emnlpmeeting! 🧵
1
33
1
166
20,079
Edouard Leurent retweeted
Thank you for participating in the Nate Silvers election simulation universe 6896. You have three hours to say goodbye to your loved ones before shutdown!
13
342
9
6,463
176,275
I have never seen the orange crown of an Orange-crowned Warbler. Have you?
14
341
19
3,040
162,101
Edouard Leurent retweeted
uhh guys I don’t want to be an alarmist or anything…
275
631
140
11,070
1,442,661
Edouard Leurent retweeted
Let me tell you my favorite story about counting! no, not gifts under the tree! By counting particles (colloids, cells, bacteria🦠, bubbles🫧… living things, gifts🎁) in observation boxes, we infer their dynamic properties! We call it *Countoscope*: arxiv.org/abs/2311.00647
1
6
2
43
6,436
Edouard Leurent retweeted
‘Infinite’ Lego domino ring 📹 JK Brickworks nitter.gq/visualfeastwang/status…
498
16,112
775
186,097
17,503,896