Keenan Goodman (@k3goodman) header
Keenan Goodman (@k3goodman) profile picture

Working with scientists and clinicians to advance AI capabilities in medicine and science. Office Hours.

San Francisco, CA
Joined June 2017
Photo by Keenan Goodman (@k3goodman)Photo by Keenan Goodman (@k3goodman)Photo by Keenan Goodman (@k3goodman)Photo by Keenan Goodman (@k3goodman)Photo by Keenan Goodman (@k3goodman)Photo by Keenan Goodman (@k3goodman)Photo by Keenan Goodman (@k3goodman)Photo by Keenan Goodman (@k3goodman)Photo by Keenan Goodman (@k3goodman)Photo by Keenan Goodman (@k3goodman)
Keenan Goodman retweeted
Gemini is getting stronger and faster. I need to lift heavier and run more to say the same! Welcome, Gemini Neon!
3
5
68
1,467
Keenan Goodman retweeted
Love the frontier envelope!
Gemini 4 Neon is now available in Cursor! At its default effort, it sets a new cost-performance frontier on CursorBench 4.1, scoring 63.7%, up from 57.3% for Gemini 4 Hydrogen. Priced at $3/M input and $15/M output tokens.
1
9
285
Keenan Goodman retweeted
Today we’re introducing Gemini 4 Neon — bringing frontier-level intelligence with fast end-to-end task completion across complex software engineering, knowledge work, and science workflows. We focused on making Neon better to work with: much improved steerability (#2 on Agent Arena Steering), strong multi-step instruction following, and our lowest fabrication rate yet in internal Google @Antigravity testing. Neon ranks #3 (61 at xhigh) on the Artificial Analysis Intelligence Index — landing just behind larger, slower models — and #2 on the Vals Index on the Pareto frontier.
40
54
21
735
41,359
Keenan Goodman retweeted
We’ve raised $110M to bring AI-powered biomolecular design to every scientist! Boltz’s Series A is led by @BessemerVP, following 50-fold growth in molecular token usage from our users since June and partnerships with 6 of the world’s 20 largest pharma companies.
68
65
30
581
56,894
Keenan Goodman retweeted
Noetik is expanding the scale and diversity of data behind our cancer biology world models. We’re excited to announce a collaboration with @MSKCancerCenter, providing access to proprietary data from tens of thousands of patients, collected during routine clinical care. By enabling a more diverse and comprehensive view of cancer development, the new data will help us train and advance our models’ ability to predict therapeutic response for patient impact. Read more here: businesswire.com/news/home/2…
5
29
4
233
17,747
Keenan Goodman retweeted
The newest frontier models are advancing but all still struggle with interpretation in biology when given complex challenging science questions that have input data that biologists use and ask for multiple things just like experts ask while running experiments, doing analysis, troubleshooting, trying to extrapolate what everything means 🙂. We are working on many such projects with our scientists and happy to send questions, let us know :) scientific taste is earned through years of expert research (and “failure” aka things not working in lab) 🙏. More exciting work coming soon… horizon.officehours.com/rese…
GPT Astra 6.2 is a very capable model for long-horizon Life Sciences and Biology work. Incredible work and congrats to @joyjiao12, @yunyunash and the @OpenAI team. OpenAI enters the top 5 on BioResearchBench. horizon.officehours.com/rese…
1
6
34
2,159
GPT Astra 6.2 is a very capable model for long-horizon Life Sciences and Biology work. Incredible work and congrats to @joyjiao12, @yunyunash and the @OpenAI team. OpenAI enters the top 5 on BioResearchBench. horizon.officehours.com/rese…
1
3
2
17
2,872
With Astra 6.2 on the scene, here's a deeper look at what's driving the overall score for each of the top models. Carbon edges out competition and is very well rounded. The model excels in biochem and biophysics applications, is strong in neuroscience and genetics, and puts the only passing task on the board in immunology. Trails most in cancer biology and and physiology.
1
3
141
Keenan Goodman retweeted
Since Google launched Carbon and Hydrogen last week.. my feed has literally turned around.. The whole "Gemini isn't good" narrative has almost disappeared I agree Carbon is slow.. it's good but pretty slow. Hydrogen on the other hand surprised me a lot.. after my past experience with Flash models I didn't expect to like it, but it's so proactive, which previous Flash models really lacked Hallucinations aren't fully gone either.. Carbon can be a bit untrustworthy, but it's pretty low if you're careful with your prompts and keep an eye on it. Hydrogen feels much better than Carbon here tbh.. it's fast and smart I think their successors (Krypton and Oxygen) will be the moment people stop complaining and start switching to Gemini in masses.. save this for when those drop And Google is THIS close to a batch of models that feel like Opus 5.5.. where you can confidently hand it any task and be sure it'll figure out the best way to do it None of this is just opinion.. it's based on the tests I've been running, and I'm already working on review threads for both. It's pretty interesting tbh and they'll back up every word above!! And parallely the Antigravity team has been updating the app and adding features like crazy.. and i hope this doesn't stop happening as there's a lot of improvements to be made.. Congrats to GDM and Agy teams for the amazing releases last week!
46
19
7
647
29,495
Keenan Goodman retweeted
Time to first token (TTFT) for Carbon is now 1.5x faster on Antigravity. Will follow soon with Argon too. Lots of work went into this so you all could have a faster experience. More to come 👀
164
82
35
2,313
142,117
Keenan Goodman retweeted
We’re continuously adding new models to the BioResearchBench leaderboard! Results for more cost effective models, including Gemini 4 Hydrogen and Muse Ember, are now available!
In the last week, @GoogleDeepMind and @Meta each released workhorse models that have set the cost-performance frontier for long-horizon biology work. Hydrogen's performance is especially surprising and great to see! It was very close to Opus 5.5 on most tasks but (unsurprisingly) had some challenges handling the very long-horizon tasks leading to time-bound failures. Read more: horizon.officehours.com/rese…
2
3
150
Keenan Goodman retweeted
Hydrogen on the cost-performance frontier and is the only flash model in top 5. The current science meta: Carbon orchestrates and Hydrogen executes.
In the last week, @GoogleDeepMind and @Meta each released workhorse models that have set the cost-performance frontier for long-horizon biology work. Hydrogen's performance is especially surprising and great to see! It was very close to Opus 5.5 on most tasks but (unsurprisingly) had some challenges handling the very long-horizon tasks leading to time-bound failures. Read more: horizon.officehours.com/rese…
2
16
503
In the last week, @GoogleDeepMind and @Meta each released workhorse models that have set the cost-performance frontier for long-horizon biology work. Hydrogen's performance is especially surprising and great to see! It was very close to Opus 5.5 on most tasks but (unsurprisingly) had some challenges handling the very long-horizon tasks leading to time-bound failures. Read more: horizon.officehours.com/rese…
1
4
2
22
2,003
My overall read is that this shows a monster performance by hydrogen to handle real-world complex biology work. Scientists should use hydrogen for most things and use Carbon for the heavy lifting, long-horizon work (cheaper and significantly better than Fable 5.2)
1
1
2
78
Gemini 4 Hydrogen is better than Argon on these tasks at ~half the cost per task
41
This is why we built an eval that has expert-verified flexible grading. In order to test and capture real scientific reasoning capabilities you have to go beyond testing just tool use and reasoning over data. In BioResearchBench we test tool use and computational capabilities but we also attempt to capture more true scientific reasoning like knowing when a signal is an assay artifact rather than biology, whether the controls rule out other explanations, when a “candidate” can honestly be called “validated,” and which experiment to run next. horizon.officehours.com/rese…
Maybe a hot take: comp bio evals are not biology evals, that’s just coding. We don’t need models to do comp bio.
2
3
259
Keenan Goodman retweeted
We’ve closed our $5 Billion funding round co-led by Greenoaks and Sequoia Capital to build the future of medicine and bioengineering with AI. isomorphiclabs.com/articles/…
50
96
91
1,014
144,267
Keenan Goodman retweeted
We’ve been cooking! 🔥 Check out the latest in how our frontier technology can help our partners and customers advance the way healthcare is delivered!
Healthcare is fragmented, and care teams do much of the work of holding it together. They track down records, re-enter information in various systems, and follow up so patients can get care. Today we’re sharing improvements to ChatGPT to help move care forward. 🧵
6
2
32
2,080
Keenan Goodman retweeted
Maybe a hot take: comp bio evals are not biology evals, that’s just coding. We don’t need models to do comp bio.
15
3
2
107
7,913