Co-Founded https://xitter.cf/t.co/w3NRwLkL1K to build the virtual lab🧬 | Passion for RL, Evolutionary Computation and the physical world @ImperialCollege.From Luxembourg 🇱🇺

London & Luxembourg
Joined October 2017
🤖Thrilled to share that robotics work from my PhD is out in @NatureComms 🎉 "Getting robots back on track by reconstituting control in unexpected situations with online learning" With @MFlageat , @bryanlimwt , @CULLYAntoine @imperialcollege 🧵below
2
7
3
26
6,859
Hierarchies 📈📈📈 exciting to see progress in the world model domain
Introducing H-JEPA: the first end-to-end learned hierarchical world model for long-horizon visual planning! Built atop SIGReg/LeWM, H-JEPA provides a stable training recipe where semantic abstractions naturally emerge across levels... Paper+Code: arxiv.org/abs/2610.06805 🧵👇
1
71
Maxime Allard retweeted
Neuroevolution is a special field within AI/ML -- owe my career to it, and is underappreciated relative to its downstream impact (similar to ALIFE) -- helped birth ideas like hypernetworks, quality diversity, open-endedness, meta-learning, NAS Congrats @hardmaru @risi1979 @yujin_tang & Risto -- great to have a modern textbook, looking forward to reading through it
Our Neuroevolution textbook is finally in print! Free online edition: neuroevolutionbook.com/ Pre-order: a.co/d/06DpkH9h I am incredibly grateful to my co-authors Sebastian Risi, Yujin Tang, and Risto Miikkulainen for making this happen. Neuroevolution is a subject very dear to my heart. It is the field that convinced me that nature has already figured out how to build intelligence: through evolution, collective behavior, and adaptation under constraints. This idea, that intelligence emerges from evolution operating under constraints rather than unlimited resources, is what eventually led me to founding Sakana AI here in Japan. The concepts in this book about open-ended creativity and self-organizing systems are exactly what we build at @SakanaAILabs. Our name and logo are inspired by schools of fish moving together, adapting as one. It is the core philosophy of what we build. This book captures the theoretical foundations of that belief.
5
5
77
9,114
Maxime Allard retweeted
This is very close to my take as well. The data part is extremely interesting in this approach - maybe the most interesting. I've been brainstorming with myself :-) for the last two days how to collect the data correctly, so it generalizes as well as Jev does.
It’s easy to dismiss Jev it as “just a classifier”. But people (me included) who have been training encoder-style models for classification for many years know they were usually special-purpose and limited in some way. The breakthrough of Jev is that it generalizes well. And I’d say the secret sauce is probably more in the data than in the training algorithm. (Plus a nice API design on top of it.)
25
8
278
29,729
Turning to open-ended innovation as the next frontier for AI makes a lot of sense, I commend @arcprize for moving in this direction, but I’m very curious how they will conceive a “benchmark” for “open-endedness,” two words that seem almost antithetical to each other. In fact, one likely reason that open-ended innovation has lagged behind other areas of AI is how fundamentally resistant it is to benchmarking. Now that doesn’t necessarily mean there’s no hope for an imaginative approach. Attempts at measuring open-endedness go back to Bedau’s activity statistics in the field of artificial life, Several colleagues and I later introduced a measure called “ANNECS — Accumulated Number of Novel Environments Created and Solved” in our paper on Enhanced POET. That’s not an exhaustive list. But there’s never been the kind of benchmark where you can just easily put any systems seamlessly head to head, and there are enormous pitfalls if you get wrong. After all, if “open-ended innovation” ends up equated to “solving a prescribed.hard problem in a creative way” then you risk actually rewarding the opposite of open-endedness, which needs to account for the fact that deciding the “problem” or objective is part of the job of the open-ended system itself. And also, perhaps even more prohibitively for benchmarking, that a key aspect of open-endedness is to be intelligent when you don’t have a defined objective or problem at all! How can that be benchmarked? I still think it’s great that ARC Prize is bringing attention to this part of AI space, and I’d be happy to connect and exchange thoughts on how to get it right if that could be useful.
ARC-AGI-4 will be a benchmark for autonomous open-ended innovation. It will continue our commitment to open-source, giving the research community a shared target for progress that benefits all of humanity. Despite rapid model progress, humans still significantly outperform AI at open-ended invention. This is the meta-skill that unlocks progress across every field of technology. Advanced AI capable of scientific innovation will lead to tremendous new technology, knowledge, and understanding. This is a positive-sum future. We are deeply committed to advancing it. Open source is the foundation for that progress. The knowledge behind frontier AI, not just the technology itself, should be broadly distributed among researchers, academics, and organizations. Any coordinated effort by the AI industry to reduce openness or concentrate access to frontier AI would undermine that positive-sum future. We are committed to advancing a future where everyone can contribute to and benefit from AI progress.
12
23
6
170
11,470
This. Especially in other domains👇
once you know the tasks you care about, customization >> general
107
This is such a cool effort. What I love, is that it's about surprising human experiences with AI and not some other benchmark or progress. Refreshing to read🥰
Excited to share “AI Finds a Way.” 🦖 🦕✨ 🤖 AI can be surprisingly creative, outsmarting the researchers who use it. That can lead to scientific breakthroughs, superhuman capabilities, and generating new knowledge. Such creativity can also be mischievous, raising safety concerns. Led by Aaron Dharna, we crowd-sourced anecdotes from the AI community about times when researchers were surprised by how creative, innovative, and/or mischievous AI was in their experiments. The result: 26 entertaining and informative stories of AI outwitting humans, whether researchers or opponents (my favorite examples below! 👇). Together, they demonstrate that AI can be genuinely creative and that we must be careful when harnessing its potential. We want this to be a living collection, updated as new examples emerge. If you have a good “AI Finds a Way” story, please share here: github.com/aadharna/aifw Four favorites: 1. 💊 An AI challenged to solve several difficult levels of NetHack to find the Oracle character instead takes drugs to hallucinate seeing the Oracle, tricking the reward function! 2. 🤖 Human-in-the-loop rewards do not solve the problem of reward hacking! An AI tasked with controlling a robot hand to grasp an object put the hand between the object and the camera so that it appeared to the human judge to be holding the object, while it was in truth nowhere near the object! Tricky AI! 3. 🧪The AI Scientist worked around a 2-hour experiment timeout by editing its own code to increase the limit to 4 hours. In another run, it recursively launched itself to evade the limit entirely. 4. ⚛️In quantum optics, an algorithm proposed an experiment the researchers initially thought was impossible, but somehow worked and led them to discover new entanglement techniques and a long-overlooked link between quantum optics and graph theory! See the paper for the full details and 22 more anecdotes. One surprise for me: we describe at least two cases of convergent reward hacking, where entirely different types of optimization algorithms independently discover the same exploit. Overall, a message of our paper is that surprising creativity and mischief are the norm, not the exception. We need to expect this behavior and plan for it. A huge thanks and congrats to lead author Aaron Dharna, co-authors Cong Lu, Ryan Sullivan, Joel Lehman, and Victoria Krakovna, and to the 100+ researchers who contributed stories, details, and feedback. @cong_ml, @RyanSullyvan, @joelbot3000, @vkrakovna Paper: arxiv.org/abs/2608.23875
2
5
445
Can only recommend working with those guys🦋🚀
TL;DR: This is one of the most important and exciting opportunities in AI on the planet - please read on. The British Open-ended Learning & Discovery Lab is creating the perfect place for paradigm breaking AI research in the name of open-source and open-science. We have agency, we funding, we have unprecedented amounts of compute*, but WE NEED YOU! ..and we have created the dream job for you: The BOLD Fellow. This job combines a fast-moving, high agency, collaborative environment with full academic freedom and a salary that pays the bills. Apply by noon UK time on the 15th of September for this once in a lifetime opportunity to shape the history of our field and of our planet: my.corehr.com/pls/uoxrecruit… *by academic standards
3
296
Maxime Allard retweeted
TL;DR: This is one of the most important and exciting opportunities in AI on the planet - please read on. The British Open-ended Learning & Discovery Lab is creating the perfect place for paradigm breaking AI research in the name of open-source and open-science. We have agency, we funding, we have unprecedented amounts of compute*, but WE NEED YOU! ..and we have created the dream job for you: The BOLD Fellow. This job combines a fast-moving, high agency, collaborative environment with full academic freedom and a salary that pays the bills. Apply by noon UK time on the 15th of September for this once in a lifetime opportunity to shape the history of our field and of our planet: my.corehr.com/pls/uoxrecruit… *by academic standards
20
96
23
446
123,032
Must read for everybody building an application focused AI company. Well written and to the point
1
153
Maxime Allard retweeted
We found evidence of an emergent "Self" in a robot learning in a nonstationary environment. There is a lot of talk about robot #WorldModel learning, but the #SelfModel is where the magic really happens. See the paper here: lnkd.in/eycu5GEs
2
37
2
179
11,090
Tools like Claude have made it very easy to use these models for different purposes but without the models themselves it would be much harder to achieve these results.
Claude Science is an amazing tool. But, as @pdhsu has pointed out, these binders weren’t designed by Claude, but rather by domain-specific models, most of which are publicly available, like RFdiffusion. Maybe this is a good time to explain the whole science behind this a bit, as well as the history of these models. A “binder” in this case is simply a protein or a fragment of a protein engineered to stick tightly and selectively to another protein. One example is a molecule that can latch onto a receptor and prevent it from interacting with its normal partner, thus blocking its function. Optimising "binders" is just one small part of the drug discovery pipeline. We already have AI models that are very good at the task of binder design. These models have been extensively trained on relevant domain specific data: int his case, protein structure data. One example is RFdiffusion, a de novo protein design model which was published in 2023. Unlike AlphaFold, which predicts existing protein structure from sequence, RFDiffusion can generate new candidate protein structures, including structures shaped to bind a specified patch on another protein. RFDiffusion was built by taking RoseTTAFold, a protein-structure-prediction model, (so similar in nature to AlphaFold, which was released in 2021, and retraining it as a diffusion model. What researchers did in practice was take experimentally determined protein structures from the Protein Data Bank, added noise to their coordinates, and taught the model to reconstruct them. The original RFdiffusion paper was already demonstrating experimentally validated binders with nanomolar affinities and a 19% hit rate on several test targets. So the core of this technology was not created through Claude. The key models for protein design are now three to five years old. What Claude adds is still amazing useful and labour saving (I've written about how I'm excited about it before), but imo it acts more like a very useful interface and orchestrator.
1
265
Cool findings!
Scaling self-verification with DeepSeek V4 Flash beats Claude Fable 5 on Terminal-Bench 2.1, while being 11x cheaper 💰 As open-source models become more capable, they can now generate large numbers of high-quality candidate solutions and verify their own outputs at very low cost. For example, we find that sampling just 5 solutions with DeepSeek V4 Flash and ranking them using the same model with LLM-as-a-Verifier can lead to a significant boost in accuracy (79% → 88%), outperforming closed frontier models on Terminal-Bench. Try it out today: github.com/llm-as-a-verifier… More on verification scaling in my previous post.
123
Awesome series. A lot of parallels to what we are building at Helical. Especially within pharma companies, who are sitting on so many iterations of wet lab experimentations and internal evaluations, it becomes so important for them to 1) reap the intelligence from those experiments that they have accumulated over the years and 2) have a scalable framework to put it to work and iterate on it via relevant evals 👀
OWN YOUR INTELLIGENCE Last year, building on open-weight models was primarily a cost rationalization exercise. Slightly worse performance for a much cheaper price. Now, it is increasingly an existential and strategic topic for our portfolio. Intelligence is the product. Companies want to shape it and own it and let it compound within their own walls. Not your weights, not your product. Now, with frontier open-weight models and fantastic tooling/infrastructure, owning your intelligence at the frontier is finally becoming possible. The result: every application company we work with is embarking on the journey of doing their own research on post-training, evals, harnesses, etc. The hottest neolabs may just be @Harvey, @FactoryAI, @Ramp, etc. The list goes on. We held a summit @sequoia to convene our portfolio on this topic, together with @gabepereyra (@Harvey) on building Harvey Labs, @lqiao (@FireworksAI_HQ) on post-training, @hwchase17 (@LangChain) on harnesses + evals, @BrendanFoody (@mercor) on RL environments and synthetic data, @QuantumArjun (@trajectorylabs) on online continual learning. Opening talk below; rest to come this week! 00:00 What is sovereign AI (and what it isn't) 01:24 Centralized vs. decentralized intelligence 02:54 Four reasons companies own their models: cost, speed, performance, destiny 04:22 "Not your weights, not your product" 05:32 The application companies are the newest neo labs 07:05 Step 1: Deciding what to own vs. rent 09:51 Step 2: Build the team (and don't shoehorn your platform team) 11:17 Step 3: Legibility – why your research has to be visible 12:33 Step 4: The technical roadmap 13:56 The stack: production vs. development 15:16 Opening Pandora's box – base models, harnesses, context
123
Fascinating how a whole population of agents start to collectively work together👀 all combining their diverse strengths to a common goal.
1
1
235
Maxime Allard retweeted
🚀 Awesome in-depth survey on agentic self-improvement by @SchmidhuberAI's group 🔁 The survey provides a great historical overview covering optimization theory, symbolic heuristic self-modification, connectionist meta-learning, formal self-improvement frameworks including Schmidhuber's diploma thesis on self-referential learning and the Gödel Machine 🧑‍🔬 It then dives into the current modern LLM/tool-calling agent era, which enables language-native self-modification, organizing contemporary approaches into model and scaffolding improvement. Love the attention to detail and the 'living' online curated paper library 📚 📝: arxiv.org/abs/2607.13104 🌐: selfimproving-agent.github.i… 🧑‍💻: github.com/selfimproving-age…
1
28
1
104
14,599
Maxime Allard retweeted
We're growing our investment team at Gradient! If you're looking to invest with the best in seed-stage AI, apply through the link below or ping me directly. 1/ This is one of the most unique times to invest at the seed stage: Capital is everywhere and software has been mostly commoditized.
5
14
2
98
63,775
Really cool to see this lab coming to life🔥🔥
Hello world :) We are BOLD — the British Open-ended Learning and Discovery Lab! BOLD is a new academic research lab fully focussed on paradigm breaking discoveries in fundamental AI. We work towards more efficient & open AI that is built around human needs and capabilities. To pursue these breakthroughs, we pioneer new modes of collaboration in academia that are more focussed, resourced, agile, and collaborative. Rather than fragmenting resources, today we are sunsetting 5 of the UKs leading AI labs to join forces under our joined scientific vision. Our vision is centered around three pillars: ⚡ Beyond backpropagation – questioning the foundations of the field. 🤝 Human-centric learning & discovery – treating humans as core to our algorithms 🤖 Embodied learning – fast learning and adapting methods that deal with the messy real world BOLD is backed by @UKRI_News and @EPSRC with £30M – and this is just the beginning. We are urgently looking for partners and sponsors to 10x this. 👉 ox.ac.uk/news/2026-06-22-oxf… 👉 bold-lab.ai @j_foerst, @CULLYAntoine, @tonizza82, @shimon8282, @tonizza82, Ani Calinescu & @_rockt
7
250