... | prev undergrad @miteecs and @mitbiology, @cartesia @janestreetgroup | usa imo 2019

california
Joined April 2021
happy to announce that we've gotten rid of tokenizers! especially excited with what we've replaced them with: end-to-end trainable modules that not only learn to group characters into (sub)words, but can iterate to group words into phrases and further higher-order concepts see @sukjun_hwang's thread for more details 👇
Tokenization has been the final barrier to truly end-to-end language models. We developed the H-Net: a hierarchical network that replaces tokenization with a dynamic chunking process directly inside the model, automatically discovering and operating over meaningful units of data
13
50
4
756
82,701
fwiw if you are on the "ai side" and you think blind scaling will solve biology you probably have a very inaccurate view of ai progress... basically only "pretrain on the internet" and "self play rl" scale, everything else is careful engineering or data curation/cleaning
There’s a really pronounced divide between people who are on the AI side of things and people who are on the biology side of things. Even among people working in AI, the divide persists based on where they’re focused. The AI side, adherents of scaling laws and the bitter lesson, believe that AI getting better means AI being more capable of novel discoveries in medicine (that go beyond discovering new drugs in well understood targets or speeding up dry lab work etc). The biology people think the idea of a bitter lesson in biology is kind of ridiculous and that regardless of AI’s capabilities it’s going to be at least 5-10 years until you could hope to reliably simulate human toxicology in silico (right now AI/ML can’t even reliably simulate in vivo studies like binding affinities or functional assays). Even the most AI pilled of them, who will list all the areas that AI can reduce the time spent on various areas, don’t think the concept of AI discovering novel targets or generating new understanding of causal biology is realistic in the near term. Most, in fact, will readily characterize the assumption that even an “ASI” level model could find cures hidden in our current understanding (without expanding that understanding with significantly more biological data) as patently false. This was a big part of why we wanted to experience it ourselves by using AI for a (very) small portion of what it can do in biology. It was both mind blowing and revealed some poignant insights into how different the problem of making AI better at something like coding is to the problems of biology. Even if it unlocked the ability to generate new molecules at a stunning pace, its simulation (in silico) of binding only had 49% accuracy. And if we wanted to improve that, we’d need to feed it back the data from the lab - data that took about 30x as long to get as it took to generate the molecules. And these were tests in a test tube (turn of phrase), imagine how long it would take if we wanted to improve the model with data that required recruiting humans and monitoring their reactions. Human biology is very complex, and adding a drug - especially a novel drug and doubly so for a novel drug acting on a novel mechanism - means mapping interactions that have nth-order-effects that we don’t have the data to predict. Virtual cells have made advancements enabled by AI, but the perturbations equate to a small fraction of the possible. This is before you even get into curing disease, especially uniquely human diseases. Brain function involves cellular identities that are unique to humans, meaning animal studies are of little use. How long does it take to understand what the side effects of chronic administration of a drug in humans are? AI can speed up analyzing the data, or designing the trial or even getting it approved…but it can’t make a 6 month trial complete in 3 months. I think its important to point out that significant advancements can be made in AI that contribute to biology, while also being realistic about how much it speeds up something as complex as curing a specific cancer or diseases of the brain.
3
36
1,449
brandon wang retweeted
Introducing Kimi K3.1 Pro: our most capable 3T-class open-weight model. 🔹 1M-token context, 2.8T total / 104B active params (MoE), Multimodal. 🔹 Full-project coding: games in Unreal, Unity & Godot. 🔹 Excels at parametric 3D modeling in Blender & CAD. 🔹 More reliable at finance work: Accurate modeling with hallucination down by 65%. 🔹 Matching the strongest proprietary models across coding, agentic and knowledge benchmarks. Kimi K3.1 Pro and K3.1 Pro Highspeed (2–3× faster) are now live on Kimi.ai, Kimi Work, Kimi Code, and the Kimi API. Open weights by Nov 4, 2026. 🔗 API: platform.kimi.ai 🔗 Tech blog: kimi.ai/blog/kimi-k3-1-pro
1,226
3,210
2,344
29,986
3,942,318
one interesting failure mode in startup land is when people fixate on the current bottleneck instead of thinking about what the world will look like 2-3 years
2
2
1
50
1,882
brandon wang retweeted
Replying to @bilaltwovec
hm yeah my p(doom) is low but my p(vast swathes of the internet go down for a few days-weeks) is like 10-20%
1
4
7
447
"So you can sell the west a medicine, just not the platform that makes the next 100 of them"
My theory is biotech is about to turn into a national security thing and the west doesn't really get a vote Beijing just floated blocking foreign buyouts of china's cell and gene therapy and siRNA platforms And what's interesting is what they're NOT blocking. Licensing individual drugs is still totally fine So you can sell the west a medicine, just not the platform that makes the next 100 of them And the west has been buying like crazy lol. Foreign deals for chinese biotech assets are at $120B through august, up 36% Astrazeneca's $1B gracell deal, that CAR-T platform, probably doesn't happen under this draft Same update hits AI tech too btw we spent years fighting over who gets the chips. Feels like the next fight is over who owns the platforms that spit out the next generation of medicines Once biology is programmable it's not really a healthcare business anymore, it's infrastructure Still just a draft tho, comments open till nov 15 bio/acc.
1
1
8
915
brandon wang retweeted
IMO you can make a strong argument that the middle and esp upper-middle class today are very BORING with their money and their patronage. But waiting for the Central Committee For Approved Art to make things exciting is like waiting for bread to become less stale. Go make.
4
6
117
2,104
Replying to @BachFrancis
(1/7) I'd like to provide some additional context for the remarks that can be found in this interview. (2/7) My discomfort with the attention being paid to existential risk---and with the ongoing dominance of the public discussion of such risks by a few so-called thought leaders---is that there's an elephant in the room that is being missed. That elephant is the effect of all of this discussion on young people, and indeed the effect---beginning with social media a decade ago---of information technology on young lives broadly speaking. (3/7) I recently read an interview by Jill Lepore in which she reports on discussions that she had recently with a group of college students: "They had just three things to say. One, social media completely destroyed their childhoods. Two, AI is destroying their college education and their likely prospects for employment. And three, what the hell are we all doing?" To add a fourth bullet that I've heard in similar discussions: "I'm not going to have children, because the existential risk is just too high." (4/7) Please contemplate such a statement, those of you who think that it's OK that the public, widely diffused, discussion coming from seemingly authoritative figures is so adamant about existential risk. (5/7) Let me add that I have little interest in a debate about what "superintelligence" might mean, or whether we're currently seeing the emergence of superintelligence. For what it's worth, I would certainly agree that the solution of extremely challenging math problems (for example) exhibits a very impressive form of intelligence, although I would want to argue that such intelligence is impossible to dissociate from the collective of humans that provided data to the machine learning system (which itself has become a kind of collective). (6/7) Such philosophical debates are entertaining and even important, but when they then head in the direction of "when such superintelligence emerges, there's a good chance that it will want to kill all humans", I say "science fiction". Again, I don't think that it's bad to consider such thoughts, but I strongly believe that it's bad for society, and especially young people, for such thoughts, unaccompanied by any serious real-world analysis, to become a dominant form of discourse of the era. (7/7) We are damaging human lives, and the consequences of that damage will no doubt be a major theme of the next several decades.
49
234
61
1,200
151,867
brandon wang retweeted
I don't think you should be mean to Claude but I don't think you should be mean to an alarm clock either How you treat every thing in the world matters, becomes reflected in your own mood
Most people are afraid of AI because they are mean to machines. The alarm clock only rings because he wants to be helpful.
13
28
5
557
20,920
brandon wang retweeted
"I spent thousands of hours on that problem. I really enjoyed it. Hearing that it is solved somehow makes me sad in a far-off way, like hearing an ex-girlfriend died suddenly in a car crash." re Barnette's Conjecture on HN news.ycombinator.com/item?id…
7
3
2
45
4,184
brandon wang retweeted
We’re releasing a broad range of new mathematical results produced by an internal frontier model. We’ve been consulting with the independent Advisory Group on Mathematics and Artificial Intelligence at the Institute for Advanced Study, and we have drawn on their advice and public recommendations to inform how we release these results. github.com/openai/math
1,902
6,306
4,769
40,716
22,723,036
one day they will write posts like this about claude opus 5.5
11 years ago today, Apple over-engineered the iPhone 6s so thoroughly that millions of users simply refused to upgrade for the next six years. Panicked by the iPhone 6 "Bendgate" backlash, Apple didn’t just iterate in 2015. They accidentally over-engineered an immortal tank: • 7000-series aerospace alloy that flat-out refused to bend • MacBook-grade NVMe storage that smoked speed benchmarks for years • 3D Touch & the Taptic Engine, embedding 96 capacitive sensors under glass to give flat software actual physical depth • The A9 chip, which held on through 7 full generations of iOS (iOS 9 through iOS 15) Apple sold 13 million units in the opening weekend, and then customers simply refused to upgrade for half a decade. Do you remember the kind of hype Rose Gold color created back then?
10
19
1
1,731
59,967
brandon wang retweeted
Altman, Olah, and Amodei all rely on this American Ted Talk-HR executive speak, eg "I am uncomfortable" "safety issue." Whereas Pope Leo and Rabbi Mois Navan (the one who told them if they believe it is conscious they are massive slavers) spoke with real clarity and candor.
I am very uncomfortable about people trying to ascribe religious force or a surrender of human judgment to AI models, and think it is a real safety issue.
13
353
8
4,037
57,432
taking bets on whether this was iran, russia, china, misc hackers, or another rogue openai model
7
701
i have been a pilot g2 user for over a decade but the xiaomi mijia gel ink pen might be my new favorite. between the sleekness/thinness and the ink quality it is really incredible, highly recommend
4
13
1,235
hm i was already pretty bullish gdm but this is quite impressive
Introducing Gemini 4 Argon – our new frontier model. It’s built for complex workflows across coding, enterprise knowledge work, and cybersecurity defense – rolling out today to a set of trusted testers through our Fairwind Program.
20
868
unlucky day for rednote's ai chatbot
2
272
absolutely incredible
Green hydrogen currently runs on iridium — one of Earth's rarest metals, a few tonnes mined per year. Our AI-directed lab screened 2,942 catalysts in 3 months and surfaced a palladium-based lead the field had written off, now past 1,000 hours of testing in acid. lila.ai/news/how-an-ai-run-l…
3
192
14,802
brandon wang retweeted
Without a mechanism, I’m struggling to understand the importance of this. Host-pathogen interactions have been a rich source of biological tools for decades; it’s where CRISPR and restriction enzymes and Agrobacterium came from. But the way we get these tools to be great, and useful, is by understanding their mechanism such that we can begin engineering and improving them. I’m sure AI tools will be helpful for molecular characterization and engineering; so why not wait to announce until you actually do that?
We’ve set up a molecular biology lab at Anthropic and we’re announcing our first discovery! Claude discovered a new CRISPR-like enzyme. 950 agents spent 21 hours searching through a database of DNA sequences until one of the agents found something striking: “[The DNA next to the RT] is spectacular: I can see by eye a tandem repeat array … that's a CRISPR-like … repeat array?!”. After analysis and testing in our lab, we found that the sequence is a previously uncharacterized enzyme system. We don’t know what it does yet, but it has features reminiscent of CRISPR. Our lab looks like a typical molecular biology lab. Our research only involves the lower-levels of biosafety risk level; we don’t handle pathogens that can infect humans, and all the lab work is performed by human scientists. We’re sharing these early findings with the community to show how Claude can be used to accelerate fundamental research in biology.
14
33
5
319
18,940
i dont get why people are reading so much into muse downloads/comparing it to chat etc. threads did similar numbers meta gets inf downloads on anything they make since they can just put ads that show up whenever you open ig
5
324