pm lead for gemini multimodal @ deepmind. views are my own.

Joined April 2020
Today, we’re launching Agentic Video Understanding in Gemini across 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite. 📉 ~88% fewer tokens 💰 ~66% lower cost 📈 ~7% higher accuracy The result: a new Pareto frontier for video understanding across accuracy and cost. Traditional video understanding processes video statically at a fixed sampling rate. With Agentic Video Understanding, Gemini can actively decide what to watch, at what speed, and which signals to use (frames, audio, or transcripts) by using native video tools. This enables split-second retrieval, rapid-motion understanding, and needle-in-a-haystack search across hours of video. Available now via the Gemini API - and coming soon to billions of users through the Gemini App and YouTube’s “Ask YouTube” experience. Learn more (details, demos, and docs): blog.google/innovation-and-a… PMing this 0→1 has been a career highlight. Taking it from an idea and helping shape it into a frontier-defining capability we’re now shipping broadly has been incredibly rewarding. Huge thanks to @MarioLucic_ , @skprat @ahmetius , @FPavetic, @suhasyogin , @jalayrac, @bcaine, @nbrichtova, @xu_bibo , @tulseedoshi, @davthack, @koraykv and the multimodal team at @GoogleDeepMind.
13
31
3
260
20,921
Rohan Doshi retweeted
Sorry we even made you consider Astra for a few weeks. Won't happen again.
Astra dethroned Gemini 4 Argon is the best "vision" model #1 for detection: - tight, precise boxes - dense scenes #1 for text extraction: - small text - handwritten text - complex tables - rotated text 4× cheaper than Astra at high
19
9
3
427
34,824
excited to share gemini 4 with the public! if you have feedback on the multimodal inputs or outputs, please reach out!
Today we are rolling out Gemini 4 Argon globally in the Gemini API, to Pro + Ultra in Gemini App, and Ultra subs in Antigravity! Argon is a huge step forward for Gemini, and a labor of love. This model has been battle tested by over 100,000 people at Google over the last month, with so much new innovation, ambition, and hard work baked into this release. The team has been heads down over the last 6 months working to make this possible across the stack (research, infra, safety, eng, etc). We rolled the model out to cyber defenders as part of our fairwind program and early access customers over the last 2 weeks, it has been amazing to see and talk to folks who are now using this model daily. Seeing the models writing capability, raw knowledge and persistence for coding, paired with new features like 1M token output when the model needs to work more has gotten me even more excited about our path ahead. This is just the start of the Gemini 4 era. As you saw with 3.5, 3.6, 3.7, and 3.8 Flash, our iteration speed with Gemini is fast : ) Now with Gemini 4 Argon to work from, I am cannot wait to see the progress continue, and most importantly see what this new model enables for the world. This is such a special moment in the arc of technology, as millions of people everyday tackle problems they could never have thought possible before. Gemini 4 Argon was built to help you tackle the hardest problems. I have personally felt this spark with Argon and hope you do too. Onwards!!
4
15
1,106
Spent the last few months as the multimodal PM obsessed with one question: can agents work with the files you actually work with? Decks. Sheets. Charts. Blueprints. CAD. Maps. Scans. Gemini 4 Argon is our first look at the answer. So proud of the multimodal team. Lots more to come.
Introducing Gemini 4 Argon, our new frontier model, rolling out to cyber defenders starting today, and more widely as soon as possible. I am really excited by the progress we have made here. Argon is priced at $2 in and $10 out during introductory pricing!
7
4
105
4,134
Rohan Doshi retweeted
We are back! Gemini4 Argon is an incredible model, super proud of the work we did here! It’s perhaps the most well rounded model out there: this is reflected on Vals, a gdp weighted suite of evals where it ranks #1. Onwards!
17
12
1
317
10,662
Developer and enterprise adoption of agentic video understanding has been amazing!! Here are some case studies on the new use cases unlocked by this frontier capability (e.g. video editing, video-based app regression testing, etc)
1
3
317
so many cool use cases for agentic video understanding! ⚽️
this agentic video understanding with Gemini based experiment got a lot of reactions & questions, will share a repo soon, so you can try it out. I have more examples coming in the next few days. there are so many possibilities with this model !!! 👾📹
1
7
398
Rohan Doshi retweeted
this agentic video understanding with Gemini based experiment got a lot of reactions & questions, will share a repo soon, so you can try it out. I have more examples coming in the next few days. there are so many possibilities with this model !!! 👾📹
5
4
2
44
6,564
Rohan Doshi retweeted
Gemini 3.8 Flash might be my new favorite Gemini model - #1 image reasoning - #1 data extraction - #2 object detection - 30% faster than Gemini 3.7 Flash ↓ Gemini 3.8 Flash deep dive
19
33
11
571
69,103
Excited to share agentic video is also available on 3.8 flash!
Introducing Gemini 3.8 Flash, another jump in Gemini's agentic + coding capabilities, and our 3rd updated Flash model in only 6 weeks... This model has been a ton of fun to work with, excited to see what you all think!
1
7
485
Super excited to see how Mosaic is leveraging agentic video understanding!
Mosaic is a Day 1 partner with @GoogleDeepMind and the new Gemini Flash 3.7 Agentic Video Understanding model. we had the opportunity to test this new model out in early access with our video agents over the past few weeks and the results are stark. full blog post from @googledevs in the comments! 👇
1
5
533
Can Gemini count the number of claps? 👏 Accurately counting rapid movements is a notoriously tricky task for AI. Because static processing ingests video at a fixed 1 FPS by default, split-second movements like a clap easily get missed entirely or get confused with a snap or click. Watch Gemini 3.7 Flash use the new agentic video understanding capability to accurately identify and count every single clap by automatically adapting the processing speed as needed:
21
84
38
847
137,322
Introducing Agentic Video in the Gemini API, a new way to process long videos which reduces token consumption by up to 88% while also increasing quality. This can be controlled easily in the API on a per video basis, available with our newest models like 3.7 Flash!
120
120
34
2,329
148,367
Rohan Doshi retweeted
Gemini 3.7 Flash smashed previous Gemini growth records in its first week, making it our fastest growing model yet. Great to see the huge excitement from our developer community! Now running in Search and @Geminiapp too.
Gemini 3.7 Flash from @Google on ARC-AGI (Verified): - ARC-AGI-2: 84.6%, $0.25/task - ARC-AGI-1: 95.5%, $0.12/task Gemini 3.7 Flash stands out for its low cost and high scores on ARC-AGI-1 and ARC-AGI-2 relative to other frontier models.
354
294
62
3,848
687,517
Rohan Doshi retweeted
Gemini 3.7 Flash just took #1 on @ArtificialAnlys new AA-AnalystAgent. AA-AnalystAgent evaluates against 80 real-world quantitative analysis tasks across 14 business and scientific domains (finance, healthcare, hydrology, government appropriations). The Agent run inside an isolated Python 3.12 sandbox using AA's open-source Stirrup harness. They receive reference spreadsheets (.xlsx) and documents (.docx) alongside standard data libraries (pandas, polars, openpyxl, scipy, PyMuPDF) to inspect schemas, write scripts, handle edge cases, and calculate final figures. Gemini 3.7 Flash: • Accuracy: #1 with 60.0% pass^5 (70.5% pass@1, 77.5% pass@5) • Speed: 1.32s per task (fastest) • Cost: $0.54 avg per task (middle)
35
70
23
799
93,208
Rohan Doshi retweeted
It is not only a good and cost effective! It is blazing fast! 🔥
75
61
40
1,126
491,913
⚡️Gemini 3.7 Flash is live, just 3 weeks after 3.6 Flash! Excited to share multimodal wins - especially around agentic doc understanding (GDP.PDF) and long-form video (LVBench). Better quality at half the cost. 🚀
Today we're launching Gemini 3.7 Flash - our latest workhorse model for coding and agentic workflows, with an introductory price at half the original cost of 3.6 Flash. ⚡️ We have been iterating rapidly with the Flash series, going from 3.5 to 3.7 in just 3 months, making it more helpful across a wide range of tasks: • Software Engineering (DeepSWE v1.1): 37.0% ➔ 65.3% • Web Development (Code Arena Elo): 1506 ➔ 1588 • Enterprise Automation (AutomationBench): 13.4% ➔ 30.4%
1
7
534
3.6 flash is great for agentic doc understanding (while staying cost efficient) - curious to hear what y'all think
Google gets a lot of criticism on here for falling behind on agentic coding, but Gemini 3.5 Flash has long been my daily driver for agentic document extraction, which is one of the highest-value use-cases for LLMs IMO I even had Fable supervise doc extraction benchmarks across a bunch of models and it told me to keep using Gemini instead of itself for this Excited to try out these new models
1
366
spot on
Just tested Gemini 3.5 Flash-Lite vs. Claude Fable 5 on a tightly structured doc extraction task. Flash-Lite was 71x cheaper and 4.1x faster for identical results. Knowing how and when to use AI models - rather than reaching for the "most powerful" one every time - is an underrated skill
1
847