
Open-Endedness Team Lead and Senior Staff Research Scientist @GoogleDeepMind. Adjunct Faculty @bold_lab_ai. ex @Meta | @NYU | @Princeton | IPhO | IOAA.
London, UK
Joined April 2013
- Tweets1.7K
- Following1.8K
- Followers11.2K
- Likes5.7K
Pinned Tweet
I’m building a new team at @GoogleDeepMind to work on Open-Ended Discovery!
We’re looking for strong Research Scientists and Research Engineers to help us push the frontier of autonomously discovering novel artifacts such as new knowledge, capabilities, or algorithms, in an open-ended self-improving loop.
We aim to work on ambitious research projects in a fast-paced manner.
If this sounds appealing to you, apply using the link below by Friday, August 1st EOD:
job-boards.greenhouse.io/dee…
Roberta Raileanu retweeted
Getting into the fantastic world of busy beaver cryptid hunting has been a highlight of my time on GDM's Discovery team. Who knew how much hidden structure could be living in such simple machines!
@dsantosmarco did a great job with this project, excited to see where it leads
Over the past year, the Discovery team at @GoogleDeepMind, in a project led by student researcher @dsantosmarco, has made new discoveries in one of the most beautiful open problems at the edge of computation: Finding the 6th Busy Beaver (BB) number.
While most AI math systems solve human-generated problems, like theorems, this work tackles a different aspect of mathematical creativity: Discovering hidden problems.
For years, the BB Community has pursued one of theoretical computer science’s most captivating collaborative quests: finding the simplest programs that run the longest before halting. Because determining whether these programs ever stop is uncomputable, no universal algorithm can solve it, meaning new mathematical techniques need to be found and invented to make progress.
In this way, the BB challenge serves as an open ended domain for mathematical creativity and, in particular, a generator of hard math problems called Cryptids. These are tiny programs whose halting behavior is governed by and equivalent to deep, unsolved math problems in number theory, similar to the Collatz or Goldbach conjectures. Historically, the BB community had recognized ~20 Cryptids in BB(6), and the best problems were selected for the Busy Math Olympiad (BMO).
Building on their work, Marco built a pipeline powered by Gemini 4 Argon that:
1️⃣ Simulates raw Turing machine traces to compress recurring patterns.
2️⃣ Conjectures mathematical transition rules & runs synthetic experiments to test edge cases.
3️⃣ Proves the equivalence formally in Lean 4.
Using this pipeline, Marco and the team discovered 20 new potential Cryptids and verified 33 more machines previously studied in the BB community. All the proofs were open sourced and shared in the community discord channel and we hope that they will help the community to make progress towards resolving BB(6). We also contributed related halting/non-halting proofs directly to the community GitHub repository.
Finding these Cryptids shows hidden links between simple programs and number theory, and helps mathematicians map the limits of computation. I'm also excited about Gemini 4 Argon's ability to help researchers both solve hard problems and accelerate scientific discoveries, of which Busy Beaver is just one example.
Work led by our student researcher @dsantosmarco with paper contributions from @vivek_veeriah, @Dahoas1 , Andrew Bolt, @zuza777 , Satinder Singh, and myself with additional contributions from Hussain Masoom, @maxencefaldor , @MoritzFirsching and Petar Sirkovic.
Read more about it in our paper: arxiv.org/abs/2610.22603
Roberta Raileanu retweeted
Over the past year, the Discovery team at @GoogleDeepMind, in a project led by student researcher @dsantosmarco, has made new discoveries in one of the most beautiful open problems at the edge of computation: Finding the 6th Busy Beaver (BB) number.
While most AI math systems solve human-generated problems, like theorems, this work tackles a different aspect of mathematical creativity: Discovering hidden problems.
For years, the BB Community has pursued one of theoretical computer science’s most captivating collaborative quests: finding the simplest programs that run the longest before halting. Because determining whether these programs ever stop is uncomputable, no universal algorithm can solve it, meaning new mathematical techniques need to be found and invented to make progress.
In this way, the BB challenge serves as an open ended domain for mathematical creativity and, in particular, a generator of hard math problems called Cryptids. These are tiny programs whose halting behavior is governed by and equivalent to deep, unsolved math problems in number theory, similar to the Collatz or Goldbach conjectures. Historically, the BB community had recognized ~20 Cryptids in BB(6), and the best problems were selected for the Busy Math Olympiad (BMO).
Building on their work, Marco built a pipeline powered by Gemini 4 Argon that:
1️⃣ Simulates raw Turing machine traces to compress recurring patterns.
2️⃣ Conjectures mathematical transition rules & runs synthetic experiments to test edge cases.
3️⃣ Proves the equivalence formally in Lean 4.
Using this pipeline, Marco and the team discovered 20 new potential Cryptids and verified 33 more machines previously studied in the BB community. All the proofs were open sourced and shared in the community discord channel and we hope that they will help the community to make progress towards resolving BB(6). We also contributed related halting/non-halting proofs directly to the community GitHub repository.
Finding these Cryptids shows hidden links between simple programs and number theory, and helps mathematicians map the limits of computation. I'm also excited about Gemini 4 Argon's ability to help researchers both solve hard problems and accelerate scientific discoveries, of which Busy Beaver is just one example.
Work led by our student researcher @dsantosmarco with paper contributions from @vivek_veeriah, @Dahoas1 , Andrew Bolt, @zuza777 , Satinder Singh, and myself with additional contributions from Hussain Masoom, @maxencefaldor , @MoritzFirsching and Petar Sirkovic.
Read more about it in our paper: arxiv.org/abs/2610.22603
Congrats @TZahavy, @dsantosmarco, @Dahoas1, @maxencefaldor and team on collaborating with Argon and the community to make progress on Busy Beaver and cryptids! 🦫 🦫 🦫
It has been a blast hunting cryptids with such a great team 👾
Alongside the Busy Beaver holdout proofs, we also open-sourced smaller 2-symbol Turing machines for three foundational math problems, verified end-to-end in Lean 4 from a blank tape to Mathlib (0 sorry):
- Goldbach's Conjecture: 25 -> 21 states
- Riemann Hypothesis: 120 -> 104 states
- ZF Consistency: 393 -> 380 states
Using Gemini Argon, we compressed the community baseline machines and proved both the state reductions and full mathematical semantics in the kernel: each machine halts if and only if the conjecture fails (or ZF is inconsistent).
Best part of releasing this openly: within days of going live, a community contributor already built on our 104-state proof to push the Riemann machine down to 95 states. 🚀
Huge thanks to everyone across the @GoogleDeepMind team who contributed to this project: @tomzahavy, @robertarail, @dsantosmarco, @vivek_veeriah, @Dahoas1, @zuza777, @MoritzFirsching, Andrew Bolt, Satinder Singh, Hussain Masoom, and Petar Sirkovic, as well as the Busy Beaver community.
Code: github.com/google-deepmind/c…
Roberta Raileanu retweeted
Congratulations to @maxencefaldor, @robertarail, Satinder Singh and the rest of the team! Four Gemini 4 Argon agents teamed up in Minecraft, writing code and sharing learnings for 27 hours to beat the Ender Dragon. A fantastic example of Argon's ability to plan, adapt, and solve complex problems as a team.
Roberta Raileanu retweeted
Cool, after @NetHack_LE now also @Minecraft!
Roberta Raileanu retweeted
Four Gemini 4 Argon agents beat Minecraft from scratch in 27 hours.
Operating in a sandbox using only code and text, they wrote 2,783 programs, divided up jobs over chat, shared notes, and debugged errors together - all with no human help ↓
xitter.cf/maxencefaldor/status/2…
Roberta Raileanu retweeted
Gemini 4 Argon agents in Minecraft collaborating, demonstrating remarkable long-term planning and problem-solving all the way to the end! Fascinating breakthrough. Congratulations to @maxencefaldor, @robertarail and Satinder Singh!
Roberta Raileanu retweeted
Gemini 4 Argon agents are amazing and beat Minecraft in 27 hours ⛏️🤯
Fantastic work and report led by @maxencefaldor.
What a time to be alive. 🚀
A groundbreaking Frontier result!
@maxencefaldor and @robertarail did a phenomenal job in showing the Argon capabilities so effectively. What a model and what a team in every sense of the word!
Four Gemini 4 Argon agents teamed up in Minecraft to defeat the Ender Dragon in 27 hours, writing every move as code and coordinating in the game's chat.
Great work led by @maxencefaldor with Satinder Singh.
Read more in our technical report:
arxiv.org/pdf/2610.22319.
This year’s @stateofai is here! Thank you @nathanbenaich for the incredibly thorough synthesis and analysis, helping all of us make sense of the astonishing pace of progress in AI.
welcome to the 9th annual @stateofai report!
ai building better ai, world models, physical ai, geopolitics, cyber defense and 12-month predictions.
read it at stateof(dot)ai or watch my editor’s cut here.
a few of this year’s biggest findings follow:
Roberta Raileanu retweeted
We are again recruiting @bold_lab_ai - please share the love 🙏. We are looking for:
1) Postdocs (my.corehr.com/pls/uoxrecruit…) -- deadline 9th of Oct at noon
2) research assistants (my.corehr.com/pls/uoxrecruit…) -- deadline 9th of Oct at noon
3) Strategic Partnership Project Manager (my.corehr.com/pls/uoxrecruit…) -- deadline 14th of Oct at noon
Roberta Raileanu retweeted
Great collection of stories showing how AI "finds a way" to outwit us! Includes a few stories from our own work 👇
In 🚀 StarCraft (SMAC), agents learned to intentionally let Protoss enemy shields regenerate so they could repeatedly farm them for extra damage points! 🛡️🔄
In 🌈 Rainbow Teaming , an evolutionary search designed to find LLM jailbreaks got so creative it accidentally jailbroke the safety evaluator itself, fooling it into thinking safe text was unsafe! 🎯🪤
Excited to share “AI Finds a Way.” 🦖 🦕✨ 🤖
AI can be surprisingly creative, outsmarting the researchers who use it. That can lead to scientific breakthroughs, superhuman capabilities, and generating new knowledge. Such creativity can also be mischievous, raising safety concerns. Led by Aaron Dharna, we crowd-sourced anecdotes from the AI community about times when researchers were surprised by how creative, innovative, and/or mischievous AI was in their experiments. The result: 26 entertaining and informative stories of AI outwitting humans, whether researchers or opponents (my favorite examples below! 👇). Together, they demonstrate that AI can be genuinely creative and that we must be careful when harnessing its potential.
We want this to be a living collection, updated as new examples emerge. If you have a good “AI Finds a Way” story, please share here: github.com/aadharna/aifw
Four favorites:
1. 💊 An AI challenged to solve several difficult levels of NetHack to find the Oracle character instead takes drugs to hallucinate seeing the Oracle, tricking the reward function!
2. 🤖 Human-in-the-loop rewards do not solve the problem of reward hacking! An AI tasked with controlling a robot hand to grasp an object put the hand between the object and the camera so that it appeared to the human judge to be holding the object, while it was in truth nowhere near the object! Tricky AI!
3. 🧪The AI Scientist worked around a 2-hour experiment timeout by editing its own code to increase the limit to 4 hours. In another run, it recursively launched itself to evade the limit entirely.
4. ⚛️In quantum optics, an algorithm proposed an experiment the researchers initially thought was impossible, but somehow worked and led them to discover new entanglement techniques and a long-overlooked link between quantum optics and graph theory!
See the paper for the full details and 22 more anecdotes. One surprise for me: we describe at least two cases of convergent reward hacking, where entirely different types of optimization algorithms independently discover the same exploit. Overall, a message of our paper is that surprising creativity and mischief are the norm, not the exception. We need to expect this behavior and plan for it.
A huge thanks and congrats to lead author Aaron Dharna, co-authors Cong Lu, Ryan Sullivan, Joel Lehman, and Victoria Krakovna, and to the 100+ researchers who contributed stories, details, and feedback. @cong_ml, @RyanSullyvan, @joelbot3000, @vkrakovna
Paper: arxiv.org/abs/2608.23875
Roberta Raileanu retweeted
this is why I have been saying for years unsupervised environment design is an AI safety research agenda
if an agent is a reflection of its training environments, we should be careful about how we design those environments!
Amazing to see all the excitement around RSI, which finally feels within reach.
I pitched RSI back when I was at FAIR in 2023, right after we did Toolformer, which was arguably too early. But we got to see the first signs it may be possible while working on MLGym with @deepaknathani11.
I shared my vision for how we can achieve RSI and Superhuman Scientific Discovery in my @raais talk earlier this year.
Spoiler alert: open-endedness is a key piece of the puzzle.
and full talk here! youtu.be/Tek-FwtEwTk?si=WJwR…
Roberta Raileanu retweeted
We have had a few questions about our perfect applicant, so here are a few made up examples:
You graduated from a Phd in machine learning a couple of years ago and have been doing great work at one of the frontier labs, pushing the limits of the current paradigm. Now you think it's time to aim higher. We want you to apply.
You are about to graduate from a stellar Phd in machine learning during which you have made contributions that have started to shape the field. We want you to apply.
You graduated from a stellar Phd in machine learning and have been doing a postdoc since. We want you to apply.
You are an academic in machine learning, leading your own group but have been wondering whether this really is the right setup to make a difference. We want you to apply.
You are brilliant and a great team player. You focus on creating exponentially large pies rather than fighting over the size of your slice. We want you to apply.
TL;DR: This is one of the most important and exciting opportunities in AI on the planet - please read on.
The British Open-ended Learning & Discovery Lab is creating the perfect place for paradigm breaking AI research in the name of open-source and open-science. We have agency, we funding, we have unprecedented amounts of compute*, but WE NEED YOU!
..and we have created the dream job for you: The BOLD Fellow. This job combines a fast-moving, high agency, collaborative environment with full academic freedom and a salary that pays the bills.
Apply by noon UK time on the 15th of September for this once in a lifetime opportunity to shape the history of our field and of our planet:
my.corehr.com/pls/uoxrecruit…
*by academic standards
Unique opportunity to do groundbreaking AI research in a vibrant academic lab with tons of freedom, compute, and ambition. Be BOLD and apply! 🦋
TL;DR: This is one of the most important and exciting opportunities in AI on the planet - please read on.
The British Open-ended Learning & Discovery Lab is creating the perfect place for paradigm breaking AI research in the name of open-source and open-science. We have agency, we funding, we have unprecedented amounts of compute*, but WE NEED YOU!
..and we have created the dream job for you: The BOLD Fellow. This job combines a fast-moving, high agency, collaborative environment with full academic freedom and a salary that pays the bills.
Apply by noon UK time on the 15th of September for this once in a lifetime opportunity to shape the history of our field and of our planet:
my.corehr.com/pls/uoxrecruit…
*by academic standards
Combining LLMs with Bayesian methods could provide a path towards more efficient and principled automation of scientific discovery. Nice to see these explorations.
Predicting the answer to interventional "what if?" questions — the outcome of an action you never took — need a *mechanistic* model, not a curve fit. And you can only learn one by *experimenting*. Experiments are costly, so the real game is **data efficiency**.
Meet the Model Discovery Agent (MDA). 🧵
Great to see more work on improving models at replicating research.
























