samin (@saminkhan1) header
samin (@saminkhan1) profile picture

Day job: agents, evals, rl @ukginc

NYC
Joined July 2025
Nice argument, but I’ve already released a 12M-line lean formalization that you are the soyjack and I am the chad.
17
168
2
2,587
56,064
Pangram detects the AI-generated portion of a real photo of my laptop displaying an AI-generated image of a living room into which I inserted a real photo of a real car using Photoshop:
49
65
14
1,959
71,854
AirPods フルトラッキング VRChat実機テスト
81
1,223
335
11,081
789,215
Japan techtwt is not for the weak
1
31
Never underestimate how much time and effort you can waste by trying to automate a process you do not understand manually.
121
1,067
88
10,439
213,316
my bet: we will have these functionally working capable of attacking data centers for frontier model weights in less then 5 years
🤖 Made with AI
imagining this with flipper zero type ecosystem for cyber attacks, with local models capable of analyzing firmware, protocols and attack surfaces
2
71
I think it’s time to revisit the accredited investor laws in the US. Companies are staying private longer, where only accredited investors (aka rich people!) can invest. Retail investors can only come in after IPO, when much of the upside has already been captured. These rules were created with the best of intentions, to protect regular people from scams - a noble idea. Unfortunately, in practice they've often made it illegal to get richer, unless you're already rich. A regressive tax! We have to judge policies based on their outcomes, not on their intentions. These are two possible routes I see: 1) Replace the rule with something merit-based, like a financial literacy test. Pass it and you're accredited. Having a qualification based on competency rather than your bank balance or income seems far more fair. 2) Remove the rule entirely. Let consenting adults assess their own risk. Disclosure requirements stay and fraud enforcement stays to punish bad actors.
952
1,308
401
12,008
2,109,515
imagining this with flipper zero type ecosystem for cyber attacks, with local models capable of analyzing firmware, protocols and attack surfaces
We had the best demo at sglang conference. No competition ☝️
1
3
161
Of course that's your contention. You're a first-year RL engineer. You just read Prime Intellect's prime-rl writeup and saw rollout workers streaming trajectories into a trainer that never waits on them, so naturally you believe decoupling generation from training is free throughput and staleness is a rounding error. Next month, when you get your hands on an RL cookbook, the Unsloth GRPO handbook, probably, you'll be singing from the treetops about colocating vLLM inside the training process, and the 400 milliseconds you save on every weight sync by waking and sleeping the optimizer like you have not just moved the idle GPU somewhere else. That'll last until sometime next year, when you watch a livestream of Will Brown talking about verifiers and become convinced that none of the systems work matters, because an environment is just a Python function and the reward figures itself out. "Well, as a matter of fact, I won't, because a verifier..." "A verifier is exactly the thing your policy learns to game first. It finds the one branch you forgot to test and farms it for maximum reward in fifty steps, and your async sampler is already three policy versions stale while it does it, so the importance ratio is fiction by the time the update lands." Yeah, I read that too. Every training-inference mismatch thread since the sampler's logprobs and the trainer's logprobs first disagreed in BF16 and nobody noticed for 200 steps. Do you have any thoughts of your own on the subject, or should I just point my agent at the prime-rl repo, set group size to 64, and let it pay an H100 to argue with itself for me?
27
70
23
1,167
63,646
every company needs to start making emulators for rl
We just shipped AWS Emulator, which gives coding agents a local copy of AWS to test against. Early in my career, we built test environments like this by hand, one system at a time. Now, agents are writing code far faster than any team can check it in production. Matt Goldberg, a Senior Principal Engineer on our Developer Tools team, wanted to know whether agents could build and test those environments themselves. He gave @kirodotdev a single prompt, and about 15 minutes later it came back with a first version of an SQS emulator. Turing that into a robust solution took much more work Here’s what I think this means for engineers today: allthingsdistributed.com/202…
1
60
🧠 Most AI bug-catching tools review your code the way a human reviewer would, only faster. What if the AI wrote a test that proved the bug instead? That’s Catching Just-in-Time Tests (JiTTests) — a novel approach where LLMs generate executable tests designed to fail, surfacing behavioral changes in a code change before it lands. After a year of research, it’s now part of Meta’s infrastructure. ✅ 589 engineers have engaged with it, reporting a 60% true-positive rate 📈 In the first half of 2026, it helped catch 74 privacy SEVs at the diff stage, lowering overall privacy SEV occurrence by 20% 🔗 Read how it works: engineering.fb.com/2026/10/2… 📄 Read our FSE 2026 paper, “Just-in-Time Catching Test Generation at Meta”: arxiv.org/pdf/2601.22832 #AI #SoftwareEngineering #SoftwareTesting #DeveloperTools #Engineering
35
79
15
771
44,981
samin retweeted
Muse Spark Open: 517 → 1,109 tokens/s on 8× GB300 with SGLang megakernels. One kernel launch per layer, overlapping compute, memory loads and communication. Total launches per decode step drop from 1,450 to 97. lmsys.org/blog/2026-11-05-mu… In our new technical post, Pranjal Shankhdhar explains what makes this work: - Prefetching weights into shared memory and L2 before they’re needed. - Warming the instruction cache so large kernels don’t stall fetching their own code. - Using data itself as a readiness signal for cross-GPU communication. - Fusing the draft model to make drafting 2.6× faster. The post also includes measured timelines, CUDA/PTX examples, and the tradeoffs behind stopping at one megakernel per layer.
9
10
9
101
30,636
Announcing a major milestone achieved by my team @GoogleDeepMind: we have proven key security properties of the machine code underlying the Signal messaging protocol. This is the first time the actual production code of a widely deployed protocol has been formally verified – by any method, with or without AI – and at this depth. More than a research breakthrough, it’s a prime example of how frontier AI can be a force multiplier to counter the speed and scale of modern cyber threats. Formal verification offers a higher standard of security; however, it’s extremely complex and time consuming, which is why in many cases it’s considered to be impractical. Similar efforts could take teams decades of combined effort. We did it in a month’s time. Using AlphaProof Code, Google DeepMind's new agentic framework for formal verification that runs on LLMs including Gemini Carbon, we verified the Signal protocol down to the actual code running on devices.  This milestone lays the groundwork for a future in which vital systems, from medical device firmware to power grid software, ship with mathematical proof that their protections work. Reaching that future will take continued research from our community. In that spirit, we're open-sourcing our formal specifications and verification artifacts so others can build on this work. On a personal note, this moment is of deep significance to me. I started my own research journey more than two decades ago as an intern working on checking the consistency of complex software systems. Seeing this grand challenge made practical with modern AI is extraordinary. I'm extremely proud of my team members: Swarat Chaudhuri, Andrew Ferraiuolo, Anton Kovsharov, Tej Chajed, Sam Schlesinger,  Karn Seth, Jonathan Katz, and Charles Sutton for taking on this grand challenge and delivering, and grateful to the Signal team for their partnership. deepmind.google/blog/formal-…
232
699
236
5,842
604,956
samin retweeted
We cut through the mystery around interpretability in training. A single, mathematically rigorous framework transforms model internals into training feedback and works across domains, problems, and modalities. We call this *mechanistic shaping*, and we’ve used it to mitigate reward hacking, remove shortcuts in chest x-rays, and reduce sycophancy and harmfulness. We believe this is a big step forward for technical alignment. But it carries a known risk: training against a model’s internals can make it harder to monitor. We explore both the technique and this concern below. 🧵
43
205
54
1,993
195,669
Got fable to hand-write weights of a 100k param model to recognize real versus fake legal citations. Basically one-shotted a full NN that’s better than training it
258
372
235
7,771
910,209
BREAKING: Europe is under a massive cyber attack, with supermarket fridges and freezers in Belgium, Sweden, Luxembourg, Ireland, the Netherlands, Finland and Estonia all hacked today by raising temperatures to up to 50°C, destroying huge quantities of food, per Reuters. "Everything is destroyed," a sales manager in Sweden said, adding that "there has been a cyberattack and all our freezers reached 50 degrees." More than 40 supermarkets in Belgium and Luxembourg were affected. "I only have two words for them: wake up, please, because there's something going on," a store manager in Belgium said. This follows a similar cyberattack last month that hit hundreds of supermarkets in France, raising freezers as high as 80°C and causing major food losses. It also comes after freezers at 6 US military bases mysteriously malfunctioned, spoiling large quantities of food, which the Pentagon is investigating as a suspected cyberattack.
827
4,108
1,276
24,086
3,059,020
There are now 10 sandbox companies claiming to be the cheapest. The cheapest: @Hetzner_Online
27
3
7
147
20,274
In just 5 days of post-training on 64 NVIDIA B300 GPUs, we built FireFlash🔥, a GLM-based long-horizon coding agent that pushes the performance–cost Pareto frontier. 🚀 46.2% on Terminal-Bench 4.0, outperforming Fable 5 Max at 30× lower cost per task.
44
66
10
723
223,865
🐝 How to Train a Swarm In our first blog post, we explain how latency pressure can incentivise parallel work, the communication primitives agents need to co-ordinate, and outstanding challenges in training large agent collectives. gr.inc/blog/how-to-train-a-s…
17
93
14
840
59,361