Rishi Mehta (@rishicomplex) header
Rishi Mehta (@rishicomplex) profile picture

Solve i̶n̶t̶e̶l̶l̶i̶g̶e̶n̶c̶e̶ ̶ coding, use it to solve everything else | Research @AnthropicAI | Past: RL @GoogleDeepmind: AlphaProof co-lead, Gemini.

San Francisco, CA
Joined July 2009
Rishi Mehta retweeted
Anthropic has been warning about AI-enabled cyberattacks at least since 2022, with @logangraham at the forefront of that work. Back then, no VC was taking it seriously. The paradox is that risks only feel real once they’re legible, but waiting for incidents is too late. Anthropic also built sycophancy evals (@EthanJPerez et al.) a couple years before real-world incidents with ChatGPT made the risks of models excessively agreeing with users legible at scale. The lesson is to take early evidence of AI risks seriously before harm at scale makes them impossible to ignore.
9
8
2
154
12,033
sonnet 5.5 is a huge upgrade for sonnet users
Replying to @claudeai
Sonnet 5.5 improves on Sonnet 5 across benchmarks, in some cases dramatically. It’s a faster, lower-cost complement to Claude Opus 5.5, strongest at well-scoped everyday tasks, fixing bugs, and creating polished documents, slides, and spreadsheets.
8
488
Opus 5.5 tops RoastBench
Made a little benchmark called RoastBench - it compares frontier models on their roast jokes. The models roast 10 personalities from comedy central roasts I enjoyed, and I manually rank their jokes. I also mark the ones that made me laugh. LLMs are way worse than top humans.
2
12
1,390
i love this model. it's cracked at pretty much everything and talks like a smart human
Replying to @claudeai
Opus 5.5 is a major step up from Opus 5, leading on agentic coding, computer use, and knowledge work.
2
147
4,173
RoastBench results for Fable 5.1 and GPT-6. They're tied on the main set, but fable does a lot better on the second set. Neither felt like a major step up though.
Made a little benchmark called RoastBench - it compares frontier models on their roast jokes. The models roast 10 personalities from comedy central roasts I enjoyed, and I manually rank their jokes. I also mark the ones that made me laugh. LLMs are way worse than top humans.
1
1
6
2,060
Couple bangers from them
1
1
320
i would've said "nw, i'm waiting with the table!" and then bailed
Single girlfriend in NYC's text exchange with a Raya match. This is tough... In her defense, 15 minutes isn't crazy late for NYC. The guy's texts also invite drama. You're already at the table, why not wait and see how she reacts in-person, then decide whether you're still interested? In his defense, she should've at least been in the car by 7:15 for a 7:15 date. An apology for being late feels 100% appropriate. IMO they both could've done better. It's also clearly not a match, so at least they figured that part out 🥲
2
29
4,896
claude formalized flt
Checking that a major mathematical proof is correct can take years. Formalization—converting the mathematical reasoning into a form computer proof assistants like Lean can verify—can help. Last month, Claude completed the first formalized proof of Fermat’s Last Theorem, one of the most famous theorems of all time. This was a project experts thought would take many years. It is the largest Lean proof ever written. Fermat’s Last Theorem was first proven in 1995 by Sir Andrew Wiles, more than 350 years after it was conjectured. Our proof, which totals over 13 million lines of code, provides machine verification. More importantly, it proves over 29,000 other theorems that the proof requires, across many areas of math which had never before been formalized. We see this as a major step in the long process of firming up the core of mathematical knowledge, building on work from three centuries of mathematicians and hundreds of contributors to Lean and Mathlib. We are optimistic that AI-assisted verification of mathematical proofs will help reduce the burden of refereeing mathematics in an era where more proofs are being produced than ever before. You can read about the process on our Science Blog: anthropic.com/research/forma… And see the complete proof on GitHub: github.com/anthropics/fermat…
1
15
1,585
Rishi Mehta retweeted
Claude Fable 5.1 is now available in Cursor! It's the most capable model we’ve run on CursorBench 3.2, scoring 73.4% at max effort. We found it especially skilled at verifying its own work, allowing it to take on difficult coding tasks from start to finish.
280
362
93
7,659
569,748
if you've been holding out on fable due to price or zdr you really should try fable 5.1
We’re introducing Claude Fable 5.1 and Claude Mythos 5.1. They're the world’s most advanced models for coding and knowledge work.
2
8
101
10,902
fable 5.1 is here! smarter & cheaper
2
1
48
3,270
Rishi Mehta retweeted
wake up babe, new neurosymbolic harness just dropped
50
217
25
4,068
193,188
curious to hear from mathematician friends re how impressive this is
We asked an unreleased research version of Claude to take a stab at the Riemann hypothesis. It didn’t solve it, but it did make strides on a related problem: it increased the lower bound for the fraction of zeros of the Riemann zeta function that satisfy the hypothesis from 41.6% to 67.2%. anthropic.com/research/riema…
4
735
Added Opus 5, GPT 5.6 Sol and Kimi K3 to RoastBench. Opus 5 narrowly edges out Fable at the top
Made a little benchmark called RoastBench - it compares frontier models on their roast jokes. The models roast 10 personalities from comedy central roasts I enjoyed, and I manually rank their jokes. I also mark the ones that made me laugh. LLMs are way worse than top humans.
1
2
860
this one made me laugh
1
2
329
also lol'd at this from kimi
3
252
Rishi Mehta retweeted
Claude Opus 5 is now available in Devin. On FrontierCode 1.1, Opus 5 approaches Fable-level performance at half the cost.
30
40
15
776
104,243