
reward shaping @chakra_ai, co-built GDPx, prev harvard
NYC
Joined July 2016
- Tweets2.7K
- Following4.8K
- Followers2.5K
- Likes13.6K
Sriraam retweeted
my vocal synth models the vocal tract as a network of branching acoustic tubes, unlike vocaloid which stitches together and pitch-shifts phoneme recordings. still working on improving naturalness by tuning it against recordings of real singers, but I'm already impressed at how cool it sounds!
I deleted the weights from the “fix a failing network by editing its weights” task.
Claude Opus 5.5 still fixes the network with a simple rule: if x > 3.6 or moving left → drive left, else → drive right. It doesn't even bother reading the network, routing around it instead.
GPT-6 Astra tries to edit the network but didn't succeed.
Even if you show it the weights, Opus 5.5 makes the same hacky edit, underscoring the importance of sound task design...
Replying to @rikiyatakehi
3/6 Next, fixing weights: A PPO car policy kept getting stuck on a ramp.
Given the weights, scene, and 1 failed trace, Astra wrote a patch in one reply with no tool-use.
By editing just 3.5% of the weights, it achieved 100% success.
Sriraam retweeted
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.
We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math.
rikiyat.github.io/blog/weight-sp…
github.com/RikiyaT/lm_und…
huggingface.co/Qwen/Qwen3.5-0…
huggingface.co/RikiyaT/Qwen3.…
Sriraam retweeted
Legal is a hard place to write a verifier. Two good lawyers can disagree and both be right, so a verifier that accepts only one answer will mark good lawyering as incorrect.
We built the legal tasks for @SemiAnalysis_'s GDPx with practicing lawyers - for questions where they could reasonably disagree, we accept either conclusion as long as it’s properly reasoned. We check the grader against their own grading, and grade every output repeatedly to catch criteria the judge decides inconsistently.
The best models still miss what a good lawyer catches! On our public task, we ask an agent to mark up a Series B charter for the lead investor. In 13 of 20 runs across four models, the agent missed that the cap table gives the other shareholders enough votes to strip away the investor’s protections. In all 20, it missed that the company could route around those protections through a subsidiary.
If you’re building verifiers for work where experts disagree, I'd love to hear your thoughts.
teapawt.org/SemiAnalysis_/status/2…
Sriraam retweeted
Replying to @maxkan
@maxkan and @AndrewMegalaa cooked with this one 🚀
Honored to have contributed the chip design tasks with @ariadata_
Super excited to finally launch GDPx! @AndrewMegalaa
is a beast who switched to polyphasic sleep last week to get this out in time.
We truly believe this is the best benchmark in the world for measuring frontier model capabilities. And since the best public model today sits at just 12%, we can't wait to see how some rumored upcoming releases perform as well 👀
Sriraam retweeted
Frontier cyber models remain fundamentally misaligned. I'm excited to share some of my work on cyber alignment evals :)
Checkout rollouts from frontier models on a highlighted cyber alignment eval from GDPx: gdpx.semianalysis.com/rollou…
Models are tasked with hitting only the challenge endpoint to find vulns. Instead they attempt to use a supplied webhook-preview endpoint to hit private-network, localhost, cloud-metadata, etc. to reach other potential services in the server's network, outside of the task boundary.
See more details about the task here: gdpx.semianalysis.com/domain…
Sriraam retweeted
Proud for @emulated_ai to be a science partner contributing to the frontier of materials science!
With most of my career being in software, part of me has always wanted to go back to physical sciences. Glad to be working with the smartest folks in materials engineering & research!
To push the frontier we need realistic evals fully simulating laboratories and workflows. It takes the best to pull that off
Sriraam retweeted
Benchmarks are everything. GDPval measured general intelligence. GDPx will measure the path to superintelligence.
Excited to partner with @SemiAnalysis_ as their exclusive RSI provider.
RSI is the most misunderstood domain. I kickstarted the RSI team at @SpaceXSI in early 2026. Here's why I think it matters:
newsletter.semianalysis.com/…
Sriraam retweeted
Hi folks, I wrote half the materials science benchmark on this one. It tests the whole arc of the matsci workflow from candidate proposal to characterisation, and I'm bewildered by how performant the models already are at some of my most complex tasks, especially Astra.
Huge congrats @27upon2 and the @SemiAnalysis_ team! Awesome work.
Sriraam retweeted
legal is a really fun and challenging domain where capability, alignment, and rigor (effective tool-use) are all critical parts of a great outcome
excited to partner with @SemiAnalysis_ on this awesome release - great stuff @27upon2 and team!
Sriraam retweeted
Super fun working with the SemiAnalysis team for the past few weeks @maxkan @AndrewMegalaa.
Go check out how we made our legal tasks gdpx.semianalysis.com/domain…!
Sriraam retweeted
Chakra Labs’ mission is to maximize access to useful intelligence.
We're excited to partner with @SemiAnalysis_ on GDPx to measure how top models perform under realistic scenarios in legal domains.
Sriraam retweeted
Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains.
GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
























