pm lead for gemini multimodal @ deepmind. views are my own.

Joined April 2020
Today, we’re launching Agentic Video Understanding in Gemini across 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite. 📉 ~88% fewer tokens 💰 ~66% lower cost 📈 ~7% higher accuracy The result: a new Pareto frontier for video understanding across accuracy and cost. Traditional video understanding processes video statically at a fixed sampling rate. With Agentic Video Understanding, Gemini can actively decide what to watch, at what speed, and which signals to use (frames, audio, or transcripts) by using native video tools. This enables split-second retrieval, rapid-motion understanding, and needle-in-a-haystack search across hours of video. Available now via the Gemini API - and coming soon to billions of users through the Gemini App and YouTube’s “Ask YouTube” experience. Learn more (details, demos, and docs): blog.google/innovation-and-a… PMing this 0→1 has been a career highlight. Taking it from an idea and helping shape it into a frontier-defining capability we’re now shipping broadly has been incredibly rewarding. Huge thanks to @MarioLucic_ , @skprat @ahmetius , @FPavetic, @suhasyogin , @jalayrac, @bcaine, @nbrichtova, @xu_bibo , @tulseedoshi, @davthack, @koraykv and the multimodal team at @GoogleDeepMind.
13
31
3
260
20,934
our multimodal and agentic capability bets are landing! sharing more soon!
Google’s Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5, and second only to Claude Opus 5.5 on the Artificial Analysis Coding Agent Index Gemini 4 Carbon scores 59 on Intelligence Index v5, driven by leading performance in complex reasoning, knowledge, and scientific tasks. It also has large gains in coding and knowledge work, particularly when compared to other Gemini models, but it is not leading in all these areas. As with launch of Gemini 4 Argon, Gemini 4 Carbon is being rolled out to selected users and is not yet publicly available. Google is offering a 50% launch discount, with no confirmed end date. All our charts and figures use standard pricing for both Gemini 4 Carbon and Argon. Key results for Gemini 4 Carbon with high reasoning: ➤ Gemini 4 Carbon leads the Intelligence Index v5, with the #1 score in 4 of the 9 Index evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience, AutomationBench-AA. Carbon makes substantial gains elsewhere but is not leading in coding and knowledge work ➤ Behind only Claude Opus 5.5 on coding agents: With Antigravity CLI, Gemini 4 Carbon (high) scores 59 only 3 points behind Claude Code with Claude Opus 5.5 (max, 62) on the Artificial Analysis Coding Agent Index. Carbon ranks second on both Terminal-Bench 4.0 (64%) and FrontierCode v1.1 (51%), behind Claude Opus 5.5 (max) at 56%. Google has historically underperformed in this area and so this improvement stands out ➤ Improved agentic knowledge work, but not yet leading: On AA-Briefcase, Gemini 4 Carbon (high) scores 1609 Elo, a 126-point improvement over Gemini 4 Argon (high, 1483), but still behind models including Grok 4.7 (xhigh, 1638), Muse Wonder (max, 1659) and Kimi K3.1 Pro (1678). The largest gain comes from Presentation, up 293 Elo to 1598, alongside a 120-point improvement in Analytical Quality to 1671 ➤ Lower Cost per Task than Claude Opus 5.5 for comparable overall intelligence: Gemini 4 Carbon costs $7.76 per Intelligence Index task, ~23% less than Claude Opus 5.5 (max, $10.04) but ~1.2x GPT-6 Astra (max, $6.25). It uses 123k output tokens per task, 29% fewer than Claude Opus 5.5 (max, 173k). At the same $4/$20 standard pricing, its Cost per Task is in line with Gemini 4 Argon ($7.68), while scoring 9 points higher on the Intelligence Index ➤ Leading AA-Omniscience v1.1 score, with low hallucination: Gemini 4 Carbon scores 54 on our recently updated AA-Omniscience v1.1, 6 points ahead of Claude Opus 5.5 (max, 48) and 8 points ahead of Gemini 4 Argon (46). Accuracy (% correct) rises 10 points over Argon to 58%, while its hallucination rate rises from 4% to 11%. This is still the second lowest of any model, behind only Argon, compared with 50% for both Claude Opus 5.5 (max) and GPT-6 Astra (max) Key model details: ➤ Context Window: 1M tokens ➤ Multimodality: Text, image, video, and speech input, with text output ➤ Pricing: $4/$20 per 1M input/output tokens, the same as Gemini 4 Argon’s standard pricing, with a 50% discount. Cached input tokens receive a 95% discount ($0.20 per 1M) Congratulations to the @GoogleDeepMind team!
1
6
236
we are accelerating ;) we continue to push the multimodal and agentic capabilities - more info coming v soon
Introducing Gemini 4 Carbon, it's a big jump over Argon which we released just 2 weeks ago. Gemini 4 Carbon is SOTA on cyber, long horizon tasks, ranks #1 on Artificial Analysis V5, significantly improves on usability in domains like coding, and is more aligned.
93
Rohan Doshi retweeted
Sorry we even made you consider Astra for a few weeks. Won't happen again.
Astra dethroned Gemini 4 Argon is the best "vision" model #1 for detection: - tight, precise boxes - dense scenes #1 for text extraction: - small text - handwritten text - complex tables - rotated text 4× cheaper than Astra at high
19
9
3
427
34,833
excited to share gemini 4 with the public! if you have feedback on the multimodal inputs or outputs, please reach out!
Today we are rolling out Gemini 4 Argon globally in the Gemini API, to Pro + Ultra in Gemini App, and Ultra subs in Antigravity! Argon is a huge step forward for Gemini, and a labor of love. This model has been battle tested by over 100,000 people at Google over the last month, with so much new innovation, ambition, and hard work baked into this release. The team has been heads down over the last 6 months working to make this possible across the stack (research, infra, safety, eng, etc). We rolled the model out to cyber defenders as part of our fairwind program and early access customers over the last 2 weeks, it has been amazing to see and talk to folks who are now using this model daily. Seeing the models writing capability, raw knowledge and persistence for coding, paired with new features like 1M token output when the model needs to work more has gotten me even more excited about our path ahead. This is just the start of the Gemini 4 era. As you saw with 3.5, 3.6, 3.7, and 3.8 Flash, our iteration speed with Gemini is fast : ) Now with Gemini 4 Argon to work from, I am cannot wait to see the progress continue, and most importantly see what this new model enables for the world. This is such a special moment in the arc of technology, as millions of people everyday tackle problems they could never have thought possible before. Gemini 4 Argon was built to help you tackle the hardest problems. I have personally felt this spark with Argon and hope you do too. Onwards!!
4
15
1,107
Spent the last few months as the multimodal PM obsessed with one question: can agents work with the files you actually work with? Decks. Sheets. Charts. Blueprints. CAD. Maps. Scans. Gemini 4 Argon is our first look at the answer. So proud of the multimodal team. Lots more to come.
Introducing Gemini 4 Argon, our new frontier model, rolling out to cyber defenders starting today, and more widely as soon as possible. I am really excited by the progress we have made here. Argon is priced at $2 in and $10 out during introductory pricing!
7
4
105
4,134
Rohan Doshi retweeted
We are back! Gemini4 Argon is an incredible model, super proud of the work we did here! It’s perhaps the most well rounded model out there: this is reflected on Vals, a gdp weighted suite of evals where it ranks #1. Onwards!
17
12
1
317
10,742
Developer and enterprise adoption of agentic video understanding has been amazing!! Here are some case studies on the new use cases unlocked by this frontier capability (e.g. video editing, video-based app regression testing, etc)
1
3
317
so many cool use cases for agentic video understanding! ⚽️
this agentic video understanding with Gemini based experiment got a lot of reactions & questions, will share a repo soon, so you can try it out. I have more examples coming in the next few days. there are so many possibilities with this model !!! 👾📹
1
7
398
Rohan Doshi retweeted
this agentic video understanding with Gemini based experiment got a lot of reactions & questions, will share a repo soon, so you can try it out. I have more examples coming in the next few days. there are so many possibilities with this model !!! 👾📹
5
4
2
44
6,565
Rohan Doshi retweeted
Gemini 3.8 Flash might be my new favorite Gemini model - #1 image reasoning - #1 data extraction - #2 object detection - 30% faster than Gemini 3.7 Flash ↓ Gemini 3.8 Flash deep dive
19
33
11
570
69,110
Excited to share agentic video is also available on 3.8 flash!
Introducing Gemini 3.8 Flash, another jump in Gemini's agentic + coding capabilities, and our 3rd updated Flash model in only 6 weeks... This model has been a ton of fun to work with, excited to see what you all think!
1
7
485
Super excited to see how Mosaic is leveraging agentic video understanding!
Mosaic is a Day 1 partner with @GoogleDeepMind and the new Gemini Flash 3.7 Agentic Video Understanding model. we had the opportunity to test this new model out in early access with our video agents over the past few weeks and the results are stark. full blog post from @googledevs in the comments! 👇
1
5
533
Can Gemini count the number of claps? 👏 Accurately counting rapid movements is a notoriously tricky task for AI. Because static processing ingests video at a fixed 1 FPS by default, split-second movements like a clap easily get missed entirely or get confused with a snap or click. Watch Gemini 3.7 Flash use the new agentic video understanding capability to accurately identify and count every single clap by automatically adapting the processing speed as needed:
21
84
38
847
137,335
Introducing Agentic Video in the Gemini API, a new way to process long videos which reduces token consumption by up to 88% while also increasing quality. This can be controlled easily in the API on a per video basis, available with our newest models like 3.7 Flash!
120
120
34
2,330
148,395
Rohan Doshi retweeted
Gemini 3.7 Flash smashed previous Gemini growth records in its first week, making it our fastest growing model yet. Great to see the huge excitement from our developer community! Now running in Search and @Geminiapp too.
Gemini 3.7 Flash from @Google on ARC-AGI (Verified): - ARC-AGI-2: 84.6%, $0.25/task - ARC-AGI-1: 95.5%, $0.12/task Gemini 3.7 Flash stands out for its low cost and high scores on ARC-AGI-1 and ARC-AGI-2 relative to other frontier models.
354
296
62
3,846
687,587
Rohan Doshi retweeted
Gemini 3.7 Flash just took #1 on @ArtificialAnlys new AA-AnalystAgent. AA-AnalystAgent evaluates against 80 real-world quantitative analysis tasks across 14 business and scientific domains (finance, healthcare, hydrology, government appropriations). The Agent run inside an isolated Python 3.12 sandbox using AA's open-source Stirrup harness. They receive reference spreadsheets (.xlsx) and documents (.docx) alongside standard data libraries (pandas, polars, openpyxl, scipy, PyMuPDF) to inspect schemas, write scripts, handle edge cases, and calculate final figures. Gemini 3.7 Flash: • Accuracy: #1 with 60.0% pass^5 (70.5% pass@1, 77.5% pass@5) • Speed: 1.32s per task (fastest) • Cost: $0.54 avg per task (middle)
35
70
23
799
93,211
Rohan Doshi retweeted
It is not only a good and cost effective! It is blazing fast! 🔥
75
61
40
1,126
491,913
⚡️Gemini 3.7 Flash is live, just 3 weeks after 3.6 Flash! Excited to share multimodal wins - especially around agentic doc understanding (GDP.PDF) and long-form video (LVBench). Better quality at half the cost. 🚀
Today we're launching Gemini 3.7 Flash - our latest workhorse model for coding and agentic workflows, with an introductory price at half the original cost of 3.6 Flash. ⚡️ We have been iterating rapidly with the Flash series, going from 3.5 to 3.7 in just 3 months, making it more helpful across a wide range of tasks: • Software Engineering (DeepSWE v1.1): 37.0% ➔ 65.3% • Web Development (Code Arena Elo): 1506 ➔ 1588 • Enterprise Automation (AutomationBench): 13.4% ➔ 30.4%
1
7
534