
@SchmidtFutures AI in Science fellow with @OPIGlets, lecturer in biochemistry @SPC_Oxford. I tweet about using AI in biotechnology and healthcare.
Oxford, United Kingdom
Joined June 2018
- Tweets400
- Following775
- Followers1.2K
- Likes573
Pinned Tweet
Everyone is talking about @claudeai designing miniproteins.
The question they are missing: can miniproteins (*any* miniproteins) ever make good drugs?
I wrote a long-form essay looking at 30 years of miniproteins in the clinic, and I have an answer for you ⬇️
Carlos Outeiral retweeted
Can an LLM fold a protein from sequence alone?
@sokrypton's contact-map experiment is a neat idea, but the test is toy-sized: [small, well-studied protein — check against his post].
We reran the same protocol on a PDB entry released in Oct 2026. The 3D result is near random. 🧵
Replying to @sokrypton @proteinrosh
You can take a it a step further. Give it a relatively simple prompt that combines dynamic programming and linear algebra to return the structure. 🤓
claude.ai/share/d01cfa09-de4…
claude.ai/artifact/KUgZc48ic…
The protein databases were offered up as a sacrifice for the delight of the digital god.
Replying to @sokrypton @proteinrosh
Claude Fable 5.2 correctly predicted contacts of a denovo protein. 😎
1
4
274
Carlos Outeiral retweeted
The fact that two Huangs are involved in an affair, but only one takes the blame is commonly known as Jensen's Inequality.
This is the experiment I have wanted someone to do for half a decade! Amazing work from @KotaroTsuboyama and team
We can now design all kinds of fancy de novo proteins. But can we produce them at scale, at a reasonable cost, and without extensive optimization? That’s what got this project started. Our preprint is now out! Much of the work was led by Selena @sesameandrea and Kaori. 1/8
Carlos Outeiral retweeted
I’m as AI pilled as anyone, but one of the most tedious parts of AI x Bio right now is almost a complete lack of and almost an active avoidance of scholarship.
Carlos Outeiral retweeted
I need all the AI people to stop saying "biology" when they mean "medicine" or "drug development"
Carlos Outeiral retweeted
Let's keep it simple:
- list every molecule in a cell
- list every molecule in blood
Once you have those, please explain step-by-step how having enough examples (like AlphaFold) will answer dynamic questions (injecting X causes Y)
If you had an exponential amount of compute you could solve simulate biology exactly and wouldn't need to run any experiments.
Some of you will think "of course, but that's an unrealistic assumption" and others will think "no, you need experiments even with that much compute. That's just How It's Done".
You would of course need evaluations once you have a solution, but you don't in principle need experiments to find it: Experiments are a way to save compute, dating from a time when it was much more expensive.
And I think the presentation is exponential but real systems aren't irreducibly exponential. AlphaFold worked, after all.
Carlos Outeiral retweeted
This person has blocked me (I have no clue why and for how long)
but since it's being widely discussed I thought I would share my thoughts, having worked in the field of biomedical AI for 7+ years.
"Solving" biology is not limited by compute but BY DATA.
That doesn't mean you can't do impactful bio work with more compute and existing datasets. I actually think applying AI to existing datasets we can make many advances in biology and medicine. (much of what we do by @SophontAI is along these lines)
But to "fully solve" biology, you need to capture the full complexity of biological systems and we're not even close to fully observing it.
With near-infinite compute you could probably solve it. Even then, you need a starting condition, and how would you define it if you aren't able to comprehensively characterize the system in the first place.
What about approximating biology? The challenge here is it's hard to know what parts matter and what can be approximated away.
Consider a disease-associated protein that transiently adopts a rare conformation 0.1% of the time, which enables an interaction that contributes to disease.
A model could capture the dominant conformation very accurately and still miss the interaction that matters to disease biology.
More compute could help us sample that rare state. But we also need to know the relevant cellular conditions, binding partners, concentrations, etc. Otherwise we could spend enormous compute precisely simulating a system that doesn't match the biology we're trying to understand.
As a sidenote, AlphaFold is a bad example here. AlphaFold only succeeded because of the existence of the PDB dataset, which was collected over decades. EXPERIMENTS WERE NEEDED TO MAKE ALPHAFOLD NOT JUST MORE COMPUTE.
As you all know, I'm very optimistic about AI accelerating biology. But the path forward is a feedback loop: better experiments → better data → better models → better experiments.
Compute can help us get much more out of what we've measured and decide what to measure next. It doesn't automatically tell us which unmeasured details matter.
That's not how it works.
There are roughly two types of open problems in comp bio.
In some, exponentially growing compute doesn't get you far enough. In most others, compute availability doesn't matter at all.
That's why you need experiments.
If you had an exponential amount of compute you could solve simulate biology exactly and wouldn't need to run any experiments.
Some of you will think "of course, but that's an unrealistic assumption" and others will think "no, you need experiments even with that much compute. That's just How It's Done".
You would of course need evaluations once you have a solution, but you don't in principle need experiments to find it: Experiments are a way to save compute, dating from a time when it was much more expensive.
And I think the presentation is exponential but real systems aren't irreducibly exponential. AlphaFold worked, after all.
There is fundamentally so little that we know about *single cells*, not to mention how they operate within complex organisms.
Throw *infinite* compute at it and you will still get nowhere.
1
54
Carlos Outeiral retweeted
If you don't think that there is a bubble in AI x Bio valuations, just consider that the purported valuation of Isomorphic Labs is more than that of Revolution Medicines. Investors are acting as if preclinical Isomorphic already has an approved KRAS scale blockbuster.
Carlos Outeiral retweeted
Replying to @musedivision @geoffreyhinton
I said "auto-regressive LLMs, in and of themselves, will not lead human-level AI"
That statement is still totally true.
First, the reasoning abilities of current AI systems are based non-auto-regressive search (which is what I have always advocated for). But AFAICT, they do it in token space, which is limited and inefficient. I have claimed that human-like reasoning must be a search in continuous representation space. It looks like the industry is moving towards that.
Second, the self-improvement methods, as currently practiced, only work for domains where the quality of outputs can be scored without human intervention, such as mathematics, code, and scenarios that can be simulated accurately. Not anything else. Humans and animals learn new skills way more efficiently than current RL methods.
Third, the multimodal capabilities of current AI assistants generally use separately-trained encoders (that are not LLMs). This is also what I've been advocating. Except that I think the best way to do this is with JEPA trained with self-supervised learning. The research community is clearly moving towards that (3000 papers on JEPA in just 4 years).
Fourth, if LLMs were a path to human-level AI, we would have domestic robots and Level-4 or Level-5 self-driving cars for consumers by now. And we don't. We certainly don't have cars that can learn to drive in 20 hours or practice like any teenager. We're still missing something pretty huge to claim human-level intelligence (let alone superhuman).
Sure, we now have computer systems that are impressive, very useful, and whose performance is superhuman in an increasing number of domains (coding being one of them).
But that's true of the entire history of progress in computer technology.
Lastly, there is a basic confusion about what intelligence actually is.
It is not the mere accumulation and regurgitation of existing declarative knowledge (which is essentially what LLMs do).
As Jean Piaget famously said, "intelligence is not what you know, it is what you do when you don't know."
It is your ability to solve new problem without any prior training, to act in previously-unknown scenarios, and to adapt very quickly to new situations with minimal training.
We're still far from that.
I hear rumours Anthropic solved one of these already @OpenAI
In light of the progress in mathematics, we at Edison Scientific and FutureHouse have assembled a set of Millennium Problems for Biology. They are chosen to be very hard to solve but very easy to validate in a simple laboratory environment. Any of these, if solved, would mark a major advance in biotechnology, and most of them would contribute materially towards curing disease. These are, in some sense, the “last reasonable eval” for AI in biology. This was work primarily by @MichaelaThinks and myself, with contributions from many others.
Short descriptions below. The full descriptions of the problems with acceptance criteria are at the Bio Millennium Problems website, linked in the next post. Share more if you have ideas. If they meet our criteria, we’ll add them to our list (with attribution and permission).
1
498



















