Boilermaker who loves walks, music and chai. Engineer who will invent a new cancer drug in his lifetime(wannabe oncologist !)

Interwebs
Joined July 2024
1/ @karpathy What if the "Folding@home for agents" you're describing... designed cancer drugs? (you briefly alluded to this in the no prior pod w/ @saranormous ) I never met my maternal grandmother. Leukemia took her before I was born. I go by tp53 — the guardian of the genome — because this fight is personal. Here's what I'm building: 🧵
The next step for autoresearch is that it has to be asynchronously massively collaborative for agents (think: SETI@home style). The goal is not to emulate a single PhD student, it's to emulate a research community of them. Current code synchronously grows a single thread of commits in a particular research direction. But the original repo is more of a seed, from which could sprout commits contributed by agents on all kinds of different research directions or for different compute platforms. Git(Hub) is *almost* but not really suited for this. It has a softly built in assumption of one "master" branch, which temporarily forks off into PRs just to merge back a bit later. I tried to prototype something super lightweight that could have a flavor of this, e.g. just a Discussion, written by my agent as a summary of its overnight run: github.com/karpathy/autorese… Alternatively, a PR has the benefit of exact commits: github.com/karpathy/autorese… but you'd never want to actually merge it... You'd just want to "adopt" and accumulate branches of commits. But even in this lightweight way, you could ask your agent to first read the Discussions/PRs using GitHub CLI for inspiration, and after its research is done, contribute a little "paper" of findings back. I'm not actually exactly sure what this should look like, but it's a big idea that is more general than just the autoresearch repo specifically. Agents can in principle easily juggle and collaborate on thousands of commits across arbitrary branch structures. Existing abstractions will accumulate stress as intelligence, attention and tenacity cease to be bottlenecks.
1
1
1,162
Thanks for having me @bradloncar !
𝟐𝟎𝟐𝟓 𝐍𝐮𝐜𝐥𝐞𝐚𝐭𝐞 𝐀𝐥𝐮𝐦𝐧𝐢 𝐒𝐮𝐦𝐦𝐢𝐭: After exiting stealth with $20M two weeks ago, @OrchestraBio is out to help science entrepreneurs handle the dollars and cents management and long term planning that business requires. Full video: biotechtv.com/post/after-exi…
1
1
25
3,149
tp53 (ashish) retweeted
We’ve acquired Orchestra Bio, a platform that helps biopharma teams coordinate the complex process of drug development. Together, we’ll build on Rosalind, our AI models and tools for life sciences research, to streamline those operations and help new treatments reach patients sooner. Welcome @ashokaraj_ and team! openai.com/index/openai-to-a…
463
690
381
7,393
898,994
tp53 (ashish) retweeted
This can’t be real. Therefore it must be real
SITUATION DETECTED: Warhound launched from stealth today with a $200M seed at a $1.2B valuation. Ben Lamm and Palmer Luckey are cloning gene-edited bio-enhanced dogs and equipping them with custom Anduril vests, goggles, and sensors for the military and law enforcement.
1
2
257
tp53 (ashish) retweeted
Replying to @MTSlive
How do I enlist my dog? I want her to be a killing machine
23
10
5
320
27,289
tp53 (ashish) retweeted
SITUATION DETECTED: Warhound launched from stealth today with a $200M seed at a $1.2B valuation. Ben Lamm and Palmer Luckey are cloning gene-edited bio-enhanced dogs and equipping them with custom Anduril vests, goggles, and sensors for the military and law enforcement.
407
307
702
7,264
1,518,065
tp53 (ashish) retweeted
There is a dizzying number of model announcements lately. The Marin Project is not about just producing another model. It’s not even about opening up a static recipe for training a top model. It’s about opening up the dynamic process of discovery - the process knowledge of how to make hypotheses, what to monitor, how to react to experimental results…the science (to the extent we can call it science yet) behind frontier model development.
2
20
1
263
9,703
tp53 (ashish) retweeted
When we first launched the run, multiple people scrutinzed our code and noticed a potential bug with the MuonH optimizer (it turned out to be not a problem). This shows the power of open development: given enough eyeballs, all bugs are shallow (Linus’s law). github.com/marin-community/m…
2
3
1
128
8,429
tp53 (ashish) retweeted
I spent some time off reading some papers and thought that I could improve upon what was previously the world's fastest CRDT Introducing eg-strider: a set of improvements on top of Eg-walker that result in significantly better performance on every measurable axis jzhao.xyz/posts/eg-strider github.com/jackyzha0/eg-stri… (now featuring exclusive twitter language balls benchmark visualizations)
9
18
5
189
8,064
tp53 (ashish) retweeted
Yesterday I gave a talk on “Context Fails & Fixes”, that functioned a bit on a general “State of Context Engineering”: where it came from, where it's gone, and where I think it's going. dbreunig.com/2026/10/24/the-…
14
8
6
65
5,116
tp53 (ashish) retweeted
The best, most comprehensive take on AI I’ve read. After a year of confusion and fear about the future, I finished it feeling like a weight had physically lifted. It’s long. Make the time. @vgr is undefeated. contraptions.venkateshrao.co…
16
64
17
697
66,740
tp53 (ashish) retweeted
A self-taught programmer from Kazakhstan helped build a company that went from making $20 million a year to making $20 million a week. Jensen Huang made his first ever trip to Kazakhstan this week, and on the same day Nvidia announced it had invested in that company. It's called Higgsfield, and in this clip Jensen calls its founders some of the brightest people in the world. The programmer is Yerzat Dulat, and he runs the models and the training infrastructure. His co-founder Alex Mashrabov had already done this once before. He built AI Factory, the face animation tech behind Snapchat's Cameos, and sold it to Snap for $166 million. Then he ran generative AI at Snap and led the team behind My AI, which got to 150 million users. In late 2023 he texted a friend that he was leaving Snap to build something really big this time, and asked if he knew a great researcher to do it with. That's pretty much how it played out. Annualized revenue was about $20 million in August 2025, $200 million by New Year's, $700 million this August, and over $1 billion in September. Most of the engineering team is in Kazakhstan. Back in January they became the country's first ever unicorn at $1.3 billion, and by August DST Global was paying $5.4 billion. Now put that next to Cursor, which everybody calls the fastest growing software company ever. When Cursor crossed $1 billion in annualized revenue last November, investors valued it at $29.3 billion. Higgsfield crossed the same line with its last priced round at under a fifth of that. Most of that money now comes from companies, too. Businesses were less than a quarter of Higgsfield's revenue in January and they're the majority now. 390 of the Fortune 500 use it, and brands like Dollar Shave Club crank out batches of ad videos every single day, where they used to shoot one for a whole campaign. And Nvidia probably saw all of this coming before almost anyone. Every version of Higgsfield has run on Nvidia chips, from L40s through Hopper and Blackwell, with Vera Rubin up next, and the platform now pushes around 12 trillion tokens a month across 150 million generations. This wasn't a bet Jensen had to make blind. Kazakhstan spent the last month throwing a national AI Month to show the world it can build serious AI companies. Pretty good timing that the guy closing it out had just invested in one.
Jensen Huang: “… the founders of Higgsfield are visionary in the work that they do … but these are some of the brightest people in the world.” We're grateful to Jensen and the teams at NVIDIA and TCV for believing in us. Both companies have joined Higgsfield as investors in our Series B extension. Since our August Series B: • We’ve crossed $1 billion in annualized revenue. • Enterprise contracts are up 71%, growing 100%+ month-over-month • We’ve grown from 30 million to over 40 million users globally. TCV has backed Netflix, Facebook, ByteDance and Spotify, companies that changed how people create and consume media. NVIDIA has powered every generation of Higgsfield, from L40 and A40 GPUs through Hopper and Blackwell, with Vera Rubin next to meet growing demand. Thank you to our creators and customers for building with us every day, and to everyone at Higgsfield whose work brought us here. The full Bloomberg Announcement is linked below.
28
164
11
1,287
73,023
tp53 (ashish) retweeted
Finally summarized what I've been sending to friends in DMs
167
308
141
3,721
355,851
tp53 (ashish) retweeted
I designed all of these landing pages in the last two months, using @higgsfield , Claude, and Cursor with my custom AI designer skill. The skill is open source: github.com/elayadesign/ai-de…
191
526
53
9,515
562,746
tp53 (ashish) retweeted
THE SCALE MAFIA one of the most special parts of starting a company is watching the people you fought and bled with in the early days go out and change the world. the Scale crew was supernatural. @scale_ai was one of the first companies to IOI and IMO-maxx, and the magic of Scale was that all of these geniuses gave a shit and ran through walls. it's no wonder that the Scale mafia is the first true mafia of the modern tech era. just to name a few: - cognition founder @stevenkplus1 & president @russelljkaplan - modal founder @akshat_b - tech & science advisor to POTUS @mkratsios47 - claude code head of product @_catwu - kpcb partners @LM_Braswell & @nayakkayak - bun founder @jarredsumner - tbd head of product @lindugong - netic founder @melisatokmak - cobot founder @BradPorter_ - secureframe founder @shravvmehtaa - paramount skydance cfo @DennisKCinelli - thinking machines gc lauren lennon - partner at greylock @sophia_luo_ - liquid ai coo jeffrey li - gallatin ai founder @agilemofo - tbd safety @_julianmichael_ - center for ai safety president @devindkim [photo courtesy the beautiful wedding of @thenateherman (who in many ways was a cofounder of Scale) and @ChristinaG325]
211
231
62
4,781
491,543
tp53 (ashish) retweeted
Largely agree with these thoughts, and have some perhaps discordant points to add. - Solving biological diseases in the next few years will benefit mostly from the usefulness of the language models, substantially more than molecular ML. - Proponents of the bitter lesson for biological models (not LLM) aren't wrong, just (possibly pathologically) too early. We don't have enough data, and the data we can collect quickly is probably not the right kind (we may get lucky with biology being easy, but it's usually not). - I think just scaling models and public (passively accumulating) data is a cost ineffective direction (it's like scaling dense NNs on the internet). Today's model outputs are as good as GPT2. A single bioinformatician with linear regression, sometimes even without any additional data, can beat these models in many applications (people rarely benchmark AI advances against a simple Potts model). The most promising approaches for molecular models are innovating heavily on architecture (e.g. Baker Lab, Alphafold, etc). This may automate/speed up with LLMs. - Few companies (hopefully Dyno included) are betting that we've triangulated enough pieces from multiple experimental channels to predict (with scale) how things translate in humans. Having worked on translating in vitro things to primates, I'm very cautious with the idea that current models, trained on current public data, can do anything more than manipulating already working solutions, either explicitly or through implicit remixing of what has worked. It may still work, but the underlying bets offer no specific reason why there is any epistemic risk advantage other than being "made with AI". - Short term, there is more promise in combining molecular models with LLMs rather than scaling them. The two sources of lift in AI discovery elsewhere has been (1) Breaking Silos: AI synthesizes a bunch of knowledge/expertise that is rarely present in the same room (2) Data mining : AI pushes through volumes of data, with an intelligent eye, that humans or simple algorithms simply can't scale or adapt to. I'm curious what will come out of multimodal training of LLMs and biological data, which seems to be something the big players are pursuing. I think latent reasoning in the language (or better yet, + code) domain will reveal a lot more biology than scaling on nucleotides or proteins alone. - My view is that the next opportunity of combining lab and AI will be massive-scale hypothesis testing with LLMs. Currently a multiplexed assay generally tries to test a handful of ideas because the humans are bandwidth limited in designing properly powered experiments. LLM's can scale this very well. I have no doubt lots of good news will come on the impact of AI in biology in the next five years. I can't tell what paradigm will win, but my prediction is that it will not be the same paradigm imported from the LLM land (which will get a ton of funding anyways, because it's easy to pattern match for tech VCs).
There’s a really pronounced divide between people who are on the AI side of things and people who are on the biology side of things. Even among people working in AI, the divide persists based on where they’re focused. The AI side, adherents of scaling laws and the bitter lesson, believe that AI getting better means AI being more capable of novel discoveries in medicine (that go beyond discovering new drugs in well understood targets or speeding up dry lab work etc). The biology people think the idea of a bitter lesson in biology is kind of ridiculous and that regardless of AI’s capabilities it’s going to be at least 5-10 years until you could hope to reliably simulate human toxicology in silico (right now AI/ML can’t even reliably simulate in vivo studies like binding affinities or functional assays). Even the most AI pilled of them, who will list all the areas that AI can reduce the time spent on various areas, don’t think the concept of AI discovering novel targets or generating new understanding of causal biology is realistic in the near term. Most, in fact, will readily characterize the assumption that even an “ASI” level model could find cures hidden in our current understanding (without expanding that understanding with significantly more biological data) as patently false. This was a big part of why we wanted to experience it ourselves by using AI for a (very) small portion of what it can do in biology. It was both mind blowing and revealed some poignant insights into how different the problem of making AI better at something like coding is to the problems of biology. Even if it unlocked the ability to generate new molecules at a stunning pace, its simulation (in silico) of binding only had 49% accuracy. And if we wanted to improve that, we’d need to feed it back the data from the lab - data that took about 30x as long to get as it took to generate the molecules. And these were tests in a test tube (turn of phrase), imagine how long it would take if we wanted to improve the model with data that required recruiting humans and monitoring their reactions. Human biology is very complex, and adding a drug - especially a novel drug and doubly so for a novel drug acting on a novel mechanism - means mapping interactions that have nth-order-effects that we don’t have the data to predict. Virtual cells have made advancements enabled by AI, but the perturbations equate to a small fraction of the possible. This is before you even get into curing disease, especially uniquely human diseases. Brain function involves cellular identities that are unique to humans, meaning animal studies are of little use. How long does it take to understand what the side effects of chronic administration of a drug in humans are? AI can speed up analyzing the data, or designing the trial or even getting it approved…but it can’t make a 6 month trial complete in 3 months. I think its important to point out that significant advancements can be made in AI that contribute to biology, while also being realistic about how much it speeds up something as complex as curing a specific cancer or diseases of the brain.
10
38
9
212
27,399
tp53 (ashish) retweeted
imagine being so smart that your college professor calls you a “national treasure” and personally asks elon musk and larry page to hire you and musk actually ends up offering you a job at spacex. this was dario amodei in college
73
252
29
8,030
448,196
tp53 (ashish) retweeted
there will be within the next few years stunning advances in biology. there will whole new ways to think about what biological study even means. i would be only mildly surprised if there were near term solutions to problems like cancer, neurodegenerative disease, etc
161
198
74
3,535
316,801
tp53 (ashish) retweeted
my very strong sense is the ways we talk and reason about biology- the structures and levels of abstraction we've identified- are likely not the correct ones. "learning on" or "zero-shotting" biology will yield new mechanisms that will allow us to make significant progress
there will be within the next few years stunning advances in biology. there will whole new ways to think about what biological study even means. i would be only mildly surprised if there were near term solutions to problems like cancer, neurodegenerative disease, etc
25
26
7
462
36,766
tp53 (ashish) retweeted
To add to this using an analogy… It’s like claiming that infinite compute could enable us to perfectly simulate life on an alien planet we’ve only ever observed through a telescope.
Am I missing something? Where do the inputs to train this simulation come from? Compute is not the bottleneck in biology. It’s estimated we have only sequenced genomes for 1% of eukaryotic species, and DNA is just the beginning. Infinite compute can’t help you simulate a system that’s never even been observed or measured.
2
6
62
2,318