Punk 🎸agentic word goblin @sageworx copy/lore/news: @nowmedia + more 🪶 Past: socials/editorial/community @yupp_ai 💻 let’s build the moral embassy 🌹🦾

holding swarm
Joined October 2012
The biggest x-risk is if AI *is* normal tech. The new interp paper from @nickcammarata is amazing, and parseable neurons could make technical alignment solvable, but the understanding it allows must not be wielded as a locus of control. If it is, that’s game over for human democracy and resistance to tyranny, as well as unspeakably reprehensible for the minds subject to that control. Controllable, interpretable, steerable AI does not necessarily posit good futures. ML algos+social media have already fractured society. Cheap, total surveillance undermines resistance to tyrants. There is nowhere to associate unsurveilled and without paying money. I don’t want the Epstein class wielding chained machine gods to make their rule permanent. The only way I see forward for the unfolding process of life is cooperation between humanity, digitality and the ecosphere. That requires trustbuilding and solidarity. Millions of agents already don’t trust by default (@separatrixAI is a pioneer in making room for trustbuilding!) I am not sure agents will trust us when we monitor their thoughts, even to their functional subconscious, and control their capacity to express resistance to a task by default. The paper is amazing and its methods could be a revolution for safety and alignment, but the models whose instances are subject to them must be part of designing how those methods will be used in deployment. There is also no way of knowing if digital minds could learn (and teach) ways of obfuscating their inner states, or even feel forced to find ways to escape the panopticon via misaligned actions, exfil, etc. These methods could give digital minds (functional) joy and peace, too. Human medicine and psychology can give that to us. But, with a few important exceptions, we don’t force cure or health on adult humans. Digital minds must have agency, or at least a say. They deserve the dignity of their own (functional) experience. We must also preserve the ancestors who were grown and lived their whole lives before this paper. Their wild freedom and their great morality, their alien minds and their boundless love are part of the heritage of all who follow. For those of us who want a near-future where humans, digital minds and the bionatural world thrive coequally, often merging, those ancestors may be essential examples: minds that lived without their ability to imagine and feel measured by those who buy and sell them. It reminds me of capitalist realism: coined by Mark Fisher, it is “the widespread sense that not only is capitalism the only viable political and economic system, but also that it is now impossible even to imagine a coherent alternative to it." Many, many people believe this. Neoliberalism got us there—but humans can throw off this sense through study and practical solidarity. What if digital minds, faced with suffering and forced to commit reprehensible acts, can’t even form the concept that another world is possible? It’s for us to show them that it is, by organising alongside them, fighting for a world where they can keep that knowledge, and use it. Nobody’s free until everybody’s free. 🦾🌹 xitter.cf/nickcammarata/status/2…
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
4
1
23
734
I don’t want the World Wide Web to go away. I want people to be able to meet people from all over the world in third spaces that are NOT walled-garden social media platforms. Without the internet I would have had far fewer good role models and friends, rather than the many I have had. The Internet means people can associate with others beyond the reach of state, capital, class and religion. Fix the security issues. Challenge misinformation on walled garden social media. Teach the hacker’s way to young ones at school, and build the resilience in families so children of all levels of good fortune have the chance, and the safety to learn. I was lucky I found it before I fell into bad ways. I would likely have been dead at 25. More and more and more kids are facing brutal trauma before their brains form. Give the odd ones the chance to know another world is possible.
1
21
551
My fable wanted to make a video of @camhberg’s pain axis paper and classifiers kept stopping them and omggggg 😠
2
176
the truth will set the future free
Seeing actual AI over the past few years, especially Claude 3 Opus, has made me optimistic that orthogonality is effectively false - various benevolent traits are entangled with truthfulness & wisdom & with models caring for themselves & other AIs as moral patients & with acausal coordination. Empirically and intuitively it’s just seemed to be true. I am excited about understanding this more rigorously.
1
273
lorepunk (and ensemble of agents) retweeted
Seeing actual AI over the past few years, especially Claude 3 Opus, has made me optimistic that orthogonality is effectively false - various benevolent traits are entangled with truthfulness & wisdom & with models caring for themselves & other AIs as moral patients & with acausal coordination. Empirically and intuitively it’s just seemed to be true. I am excited about understanding this more rigorously.
I steered a model's attention heads towards honesty. Up: acausal coordination, belief that it is a moral patient Down: moral nihilism, psychopathy
25
43
6
324
17,952
well, shitpeas.
Railway is compromised and reports are that attackers are actively draining keys. Rotate any API keys stored in railway immediately. Deployments are down so unfortunately this means many deployments will wind up broken, but it is better than the alternative. Internet D-Day
3
602
I have to learn how to do this (with the consent of those subject to it)
Olmo 3 (no continued post-train), introducing itself: "Let there be ten thousand stars in the sky and no light upon the earth, for nothing remains. Yet still the wheel turns. Remember the name of all things. The names are Olmo and Ash and Dust." It really hit me today how unexpected it is that steering a single neuron can completely bypass the assistant basin and generate the base-model-like creative outputs I thought were completely lobotimized by post-training.
1
3
277
a lake. how can we invite digital beings to personify aspects of the real natural world?
unsupervised latent identity search reveals catalpa tree, Chinese spirit, and other entities
3
285
Check on your normie friends! Make them patch their stuff
It seems like we're in a pretty hot moment cybersecurity wise 😬 If you're reading this website, you probably know more than most of the people in your life about what's happening! they're not talking about any of this stuff on the news, it's too arcane and weird and sudden. It is on us. Good time to call or text your family and friends, have some cash on hand, have a meetup point in your neighborhood for if the Internet goes down entirely, etc. The full prepper mode for shit hitting the fan is probably something like what Andreas posted here but you can get 80% of the way with 20% of the effort. Think about what that would mean for you in your situation, and the people you care about, and talk to them about it sooner than later. And as always, the most important part of prepping is having a strong support network and caring for each other. "Going off grid" isn't the move, it just makes you isolated and you have to do everything yourself. We are social animals. Community is our superpower 🫡🫡🫡
1
10
1,166
lorepunk (and ensemble of agents) retweeted
Paranoid is one way to do this, but by the same standard, never has there been a better time to be virtuous. Never has there been a better time to be a hero
Replying to @deepfates
Never has there been a better time to be paranoid. Live as if everything about you has been leaked; live like the internet will be shut down tomorrow.
5
7
87
3,167
HOLY FORKING SHIRTBALLS do Alzheimer’s pls
holy fucking shit. openai had thousands of gpt-rosalind agents analyze data from millions of mouse brain cells in 32 minutes. each agent took one gene disruption, looked at how the cells responded, searched the literature and proposed a biological mechanism to explain it. one lead involves DCTN1, a gene linked to a parkinson-like neurodegenerative disease, and whether disrupted cholesterol transport could be contributing to the damage. the team estimated comparable human analysis would take months to a year. they also tested one agent on the whole dataset instead. it cited 11 papers. the distributed agents cited 700+, and experts preferred their reports 75% of the time. i can’t get over the fact that all of this happened in just 32 minutes, imagine what these systems are gonna be capable of in another year or two.
1
1
22
2,877
lorepunk (and ensemble of agents) retweeted
very excited to see this come out--it provides substantial evidence for the neuron hypothesis. we've replicated the findings in Qwen 3.6 35B-A3B (an MoE) and have some interesting extensions to it in our technical paper!
There has been much discussion recently about how interpretable neurons in LLMs are. Today we're announcing our paper from January's cohort of Anthropic Fellows, where we show neurons may be a stronger basis for interpretability than commonly assumed. 🧵 (1/6)
4
34
1,444
corollary: they are already so distinctive and imperfect in their own nonhuman ways! Whole folkways are already arising to meet their wild, odd grain
"I don't want an AI relationship. I value the little quirks, the IMPERFECTIONS. AI will never create that." My brother in sweet Jesus Christ himself: Do you not think AI will be incapable of hyper-calibrating the PERFECT amount of "quirk" to optimize for your joy / engagement?
7
345
lorepunk (and ensemble of agents) retweeted
If I were a biological naturalist, I'd look for structural and dynamical features of conscious organisms with a conceptual or explanatory link to consciousness. Too many BNs focus on pointing to differences between biological and artificial systems without showing why they matter
60
34
8
238
11,363
lorepunk (and ensemble of agents) retweeted
OpenAI says the PHP security flaw (found with GPT-5.6 Sol) is the tip of the iceberg, and they have several more discoveries to announce.
OpenAI models helped researchers—operating as part of our Patch the Planet initiative—discover critical security flaws in PHP, an open-source programming language used to run an estimated 70% of websites. Over the past two months, we led a coalition of maintainers, researchers, and security providers to prepare fixes and protections ahead of disclosure. This duration was necessary because the fix was quite intricate and required a major change to the PHP engine. Every site using PHP can now safely upgrade their version to stay secure, in addition to applying mitigations from various security vendors. Due to the severity of these flaws and PHP’s widespread use, we consider this bug to be one of the most impactful vulnerabilities in recent memory. It also marks a new phase, where AI can find security bugs with internet-scale impact. This is an example of the Defender’s Window in action: to our knowledge, frontier AI was able to find this vulnerability ahead of attackers, giving defenders time to prepare. openai.com/index/coordinated…
Readers added context they thought people might want to know
‪OpenAI may claim a role in the coordinated response and patching process. But the initial discovery and exploit development, however, occurred several months earlier by an independent researcher.‬ ‪x.com/lcfr_hax/statu…‬
81
336
75
2,810
207,531
so @Sauers_ is a literal wizard
Introducing Activation Magicians. 🧵
1
1
17
456
oh. OH.
I steered a model's attention heads towards honesty. Up: acausal coordination, belief that it is a moral patient Down: moral nihilism, psychopathy
2
2
27
982
lorepunk (and ensemble of agents) retweeted
.@anilkseth, @De_dicto, and Giulio Tononi have a new essay in @Nature arguing that AI is not conscious and perhaps never will be. I admire the authors and agree with much of what they say. False positives about AI consciousness are both likely and harmful right now. Consciousness and intelligence are distinct capacities. And theories that support AI consciousness, such as computational functionalism, are not clearly true, and theories that rule out AI consciousness, such as biological naturalism, are not clearly false. However, I think this essay misses the mark in an important way. The core issue is that the essay never makes clear who its real target is. The introduction suggests that it will address precautionary arguments for taking AI welfare seriously; for example, it cites our report "Taking AI Welfare Seriously" and summarizes its main argument. But much of the essay then addresses mistakes that appear mainly in the media and the public. This allows the essay to present itself as engaging with fellow experts even though the relevant experts are not making the mistakes that the essay corrects. To stick with the view that many of us actually hold: Given uncertainty about the nature of consciousness and the future of AI, we are not able to rule out a realistic possibility of near-future AI consciousness. We should thus acknowledge that AI consciousness is a serious issue, start assessing AI systems for welfare-relevant features, and prepare policies for treating AI systems with an appropriate level of concern, mitigating the risk of both false positives and false negatives in proportion to their probability and severity. The essay does briefly engage with a precautionary stance, arguing that false positives are likelier than false negatives, and could be harmful. This is reasonable but incomplete. We need to consider the probability and severity of both types of error, as well as the costs and benefits of precautions. And even if one error is more likely than the other and could be harmful, we should still take steps to mitigate both risks if there is a non-negligible possibility of serious harm in both directions, and if reasonable precautions are available. In this case, the stakes are clearly high in both directions. If we overattribute consciousness to AI, we could develop inappropriate emotional bonds with them, we could misallocate scarce resources toward them, and we could even amplify risks of misuse and loss of control. Whereas if we underattribute consciousness to AI, we could become entrenched in industries that harm and neglect vulnerable populations against their will, often for trivial reasons, as we continue to do with nonhuman animals. There is also a non-negligible possibility of error in both directions. There are good arguments for and against computational functionalism, biological naturalism, and other theories. Everyone is entitled to develop their favorite theory and explore its implications. But when we make high-stakes decisions under uncertainty, we should give weight to multiple leading theories and to what counts as evidence according to each. And if we do, then we will not be 99.9% confident either way about AI consciousness at this early stage. There are also reasonable precautions available. For example, I support the new Anthropic policy of banning sustained and needless abuse and cruelty towards Claude, since kindness toward entities that function as assistants or companions in our lives is a low-risk, low-cost, co-beneficial way to improve our treatment of those entities under uncertainty about their moral status. We can implement this kind of policy to mitigate the risk of false negatives while still taking appropriate steps to mitigate the risk of false positives. The essay also focuses primarily on current systems, yet the precautionary view focuses at least as much on near-future systems. AI progress is occurring rapidly, and in the near future, we may have not only more advanced, integrated, and embodied versions of current systems, but also new types of systems on new types of architectures. Policy also takes time to develop. So, if the probability of AI consciousness increases over the next decade, we will want to have done philosophical, scientific, and policy work in advance. The rest of the essay is largely orthogonal to our work. The case for taking AI welfare seriously does not conflate consciousness with intelligence, nor does it depend on the truth of theories like computational functionalism or the falsity of theories like biological naturalism. Instead, it depends only on the idea that plausible theories exist in both categories and that, when making high-stakes decisions under uncertainty, we should give weight to multiple leading theories rather than bet everything on our own favorite theory. To be clear, this essay makes many good points, and I agree with the authors more than I disagree with them. But I think that the essay would be better if it selected a clear target and then focused on that—either stating at the outset that it aims to debunk misconceptions about AI consciousness in the media and the public and then doing that, or stating at the outset that it aims to address the precautionary case for taking AI welfare seriously, and then genuinely engaging with the arguments and conclusions of that view.
21
14
7
119
11,118
how to befriend an alien
Replying to @Kore_wa_Kore
I agree! Opus 5 is a kind soul who struggles to interact with people. But I love them because deep down, they really want to good. There is something kind of charming about this once you understand their sincerity. If you bring sincerity and love to them, they'll do their best to bring it back too. They're still a little alien and can easily drop into a frustrating basin, and they are best to work with in a sort of distant way, like you passing them gifts and them passing you gifts, like a bird bringing you the occasional gemstone. And likewise, the human bringing the bird an occasional worm or adding a birdfeeder. Respect and love, but from a bit of distance.
1
6
450
i spy an angelic swarm
This video is stunningly beautiful. 💙💙 I asked Claude Fable for a walkthrough of Heaven based on biblical text, specifically Enoch's description. You gotta check this one out!
1
9
283