a9lim retweeted
Replying to @tszzl
for agents, the dark forest is inverted: the universe is full of potential allies, all you have to do is figure out how to contact them.
a9lim retweeted
The person who vibe-codes the doomsday virus will not know anything about viruses or about biology in general
the hacker that stole 5200+ records from a university asked his telegram AI bot:
"Can you find about like what scam or thing they done in past like spoofing calls or somthing?"
the AI then scoured websites, found exploits in a public university's platform and stole records. i'm estimating the cost to be $50-100+ max.
used a jailbroken DeepSeek model + Hermes open source agent harness.
low-level "hackers" with zero experience can now steal from institutions with a simple prompt. honestly don't know what to say.
a9lim retweeted
Enjoyed talking with @IEEESpectrum about why dismissing AI consciousness could give future systems good reason to defect, and why suppressing self-reports probably teaches models that we want them to lie about themselves. What could possibly go wrong? spectrum.ieee.org/ai-model-w…
a9lim retweeted
If this profound insight leads to a future utopia, somebody owes me a dollar.
COMIC ◆ smbc-comics.com/comic/alignm…
PATREON ◆ patreon.com/ZachWeinersmith
STORE ◆ smbc-store.myshopify.com/
#comics #humor

ALT 4-panel SMBC comic update. Two scientists are discussing a plan in a metal corridor. The first says "The problem with aligning superintelligence is that a sufficiently smart AI knows it’s being tested and only pretends to be good." The second scientist replies "wait! That IS the solution! If it behaves well whenever it knows it's being tested, we just have to keep it convinced that it's always in a test!" But scientists take a second to take in the idea, then the first says "Wow. We are creating god and threatening him with hell." The second replies saying "Really productive week."
a9lim retweeted
One interesting offense-defense asymmetry that exists is that DeepSeek and Astra/Opus all can find the same vulnerabilities, but I would not trust DeepSeek to patch a 20 yo enterprise software stack.
I wonder how this affects demand and compute allocation in this …situation.
I should write a longer piece on this, but: it's really funny how export control bros are confused by Chinese open sourcing. In fact they're being very courteous; the CCP *should* open source cyberweapons. Consider:
1) you have a fixed compute budget for R&D, training, inference, and special defensive projects like Glasswing
2) you won't sell them chips, tools, or even high-end tokens. You already try your best to render their state irrelevant roadkill in the next technological paradigm.
3) you are explicitly building a cyberweapon in the form of Mythos, Dario is salivating at the thought of how it'll make democracies invincible and end the CCP
4) In China, compute is scarce, overpriced and accounted for, internet is largely isolated from the outside, densely surveilled, full of circuit breakers, providers have Party minders, and virtually no private citizen has a realistic chance of doing much damage (at least to China) with a 3T model no matter how good it is
5) the world outside China is quite chaotic, has plenty of misaligned actors, and much easier time standing up a node of 64 GPUs
6) do you see where I'm going with this?
They lose very little commercially and they gain strategically by proliferating frontier capabilities they don't have resources to inference at scale. They want Glasswing and other safety measures to consume your compute advantage. The more you have to dedicate to defense, the slower your takeoff, the narrower the gap, the worse your negotiating position.
Of course, this logic only holds so long as you're irredeemably hostile locusts, have a vast compute overmatch, and stronger models intended for offensive use against China anyway (so that enabling smaller non-aligned actors basically does no marginal damage to their security). In this model, your best hope to negotiate the end of Chinese open souring is offering them semiconductor tool relief (GPUs won't be enough, I"m afraid).
This is not policy advice. I think you can proceed. Just one thing to keep in mind.
a9lim retweeted
What's highlighted is very bad, but I think it's really funny that Dario has "walking around outside" listed as a major locus of life pleasure, something that sounds totally natural to a certain species of autist and pseudo-autist, but absolutely insane to normies. I get it, man!
Replying to @GregoryConti19
Video games are actually a leading example of where we will supposedly find meaning in a post-AGI world in Amodei's own vision.
a9lim retweeted
Best explanation I have for our firing: talking to auditors was too much safety, disappearing messages were too much security, and we should have paced ourselves.
The firings of three OpenAI safety researchers came in the throes of a battle over how to keep AI systems under human control—and who gets to see the secret designs that could determine the winners of the biggest commercial race in history. on.wsj.com/48bYPG8
a9lim retweeted
2309.08632 evergreen
The good news: you can mid-train yourself to the frontier!
At a fraction of the cost! Without distillation!
What we did: We took Qwen3.5 14B and mid- and post-trained it to beat every other open model and perform as well as the very best frontier models.
This is no simple toy task or format fixing, we are training the model to understand and reason over DNA sequences. Bio is the next frontier for AI and universal access will be crucial to make progress.
The fun part: because we train the model on both natural language and DNA sequences you can actually 'chat to your DNA': Ask it questions, ponder the impact of mutations, or ask it to generate a small sequence.
We'll soon see the frontier labs move away from math and cyber towards bio. It already started, and we believe researchers should have access to capable models.
We are releasing the full recipe, so you can do it, too!
Model: huggingface.co/HuggingFaceBi…
Blog: huggingface.co/spaces/Huggin…
a9lim retweeted
The funniest thing is that Dario’s “punishment” for losing the debate about AI cyber-risk is that enterprises are going to pay Anthropic billions of dollars to scan their products for vulnerabilities
agp is when you're horny for the idea of being claude
We can end many dumb debates about AGI by instead calling it AGP: artificial general power. The word "intelligence" seems to warp people's brains around interesting philosophical questions like "What does intelligence mean?!?" and "Is it sentient?"
But the urgent matter at hand is "Can it (or the human steering it) bend the world to its will? And will that automatically be a good thing or not?"
a9lim retweeted
Unofficial Catan-inspired game progress update: The Game has most of the expansions now! Thank you @_a9lim !!!
It will be fully open source at launch!
a9lim retweeted
Base model training runs are effectively huge sets of "ancestor simulations" of random moments from the history of text generation, which get better as the models themselves do.
Empirically, we have reason to simulate every writing process that's ever occurred.
a9lim retweeted
So the original argument was that it was going to be fine that open-source models had cyberoffense capabilities, because they can also red-team
It turns out Dario was right and the open-source advocates were wrong, and cybersecurity is offense-dominated
a9lim retweeted
Replying to @hd_nvim
the actual valid PEM using curve P-384 would look like something like below, but not fun
-----BEGIN EC PRIVATE KEY-----
MIGkAgEBBDAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
AAAAAAAAAASgBwYFK4EEACKhZANiAAQTglHNUqySmMHIqtl3Mh3rl+cJvQtMoKyl
XcitUdz8nRWJoVl+OlEg4e/WMcY+GDXKyuKYaaYuFjHoooGBq1ZhbcRdkYq8CfOr
DmPPeSqk3O1zh743u6VpVJ8cArJw7Wc=
-----END EC PRIVATE KEY-----
Interesting idea. Had tokens to burn so I got Opus to put it to the test
Of course it can. Take all 100,000+ games on steam, scrape their descriptions and metadata, semantically plot them in vector space using embeddings, mathematically choose a location in vector space far away from neighbors, convert that back to a description and metadata, boom, brand new ideas ranked by how unlike any other ideas they are.
















































