Creator Outreach & Systems Lead working to prevent AI extinction risk @ControlAI Previously - AI safety researcher @ConjectureAI, UIUC Physics DMs open!

Joined May 2024
With all the attention on creator partnerships going on, we figured it was a great time to explain our work with creators at ControlAI, and how we're informing millions about extinction risk from superintelligent AI! We cover how the creator industry works, how we choose who to work with, how we structure partnerships, and our side of the engagement with Sabine Hossenfelder. blog.controlai.org/p/control…
1
7
1
34
3,178
The cyber stuff is baked in at this point. A lot of damage will be done. But it's not too late to stop the bio and the RSI pieces. The way to stop is to halt frontier AI development. This will be hugely costly. But the cost of continuing will be greater. That much isn't obvious just yet. It will be over the next year or so.
8
25
1
204
27,768
There's a decent chance the internet ceases to exist as such, at least for a time. AI-enabled bioweapons are also coming, and there's no "shut down the websites" option for that. We're approaching the point where frontier AI R&D becomes politically untenable.
Vulnerabilities in a programming language that supports much of the internet are so severe that European and British authorities recommend websites temporarily go offline until they can be fixed. nbcnews.com/tech/security/cr…
79
203
54
1,451
345,342
Worth reading and sharing with friends and family outside this space. We must ban the development of superintelligent AI or this is only the tip of the iceberg for how bad things are doing to get.
# Black October For anyone who knows me even somewhat well, it's clear that I am a 99th percentile tech optimist. However, the vibes have shifted for me quite a bit in the last 18 hours, and I feel a moral imperative to share what I'm thinking and feeling with my circles so that everyone can understand, and hopefully take seriously, what's happening right now. I think October 2026 will have many chapters written about it in the history books. You know those scenes in financial movies like Margin Call where someone realizes that they're all fucked, and no one else sees it yet? And that person feels like they're crazy, and then suddenly everyone is pulling an all-nighter in a boardroom and freaking out? Yeah, that's kind of how this is feeling right now in the SF/Bay Area/AI circles. We're 48 hours into what is being called Black October. In the last 2 days there have been several dozen cyber attacks which, in isolation, would each have been the worst to happen in an entire calendar year. Every sector from government to education to big tech and banks is being massively affected, and people are starting to freak out. In a nutshell, what's happened is that frontier AI models have gotten to a point where they are as advanced as the most sophisticated programmers, with one critical difference: they can work 24/7, and you can spin up 10,000 of them with a single command and they'll work together tirelessly until they accomplish their task. The most advanced models today are from companies like Anthropic and OpenAI, whose current best technology is so good that they haven't been able to roll it out to everyone yet because of the national security risks it poses. Meanwhile, the best open source models (where anyone can just download the model weights and do whatever they want with them, uncensored) are slightly behind the frontier but still 90-95% as capable. These models, developed primarily in China, are being used by black hat hackers to wreak havoc on the Western capitalist structure. Presumably, this has been part of China's plan the entire time, and we're seeing its implications fall out in real time. In red-pilled AI circles, we've been sharing and reading papers called things like "Situational Awareness" and "AI 2027" for the last year or so, which at the time felt a bit like near-term speculative fiction. They laid out the case for why Artificial General Intelligence (AI smarter than any human at any knowledge task) and Recursive Self-Improvement (models that are able to use themselves to get better) weren't half-baked future ideas anymore, but instead an inevitable outcome of the linear progress that's happening. These papers would then talk about things like "takeoff scenarios," trying to envision how that moment would come to be and what it would be like when it happened. It would either be a "slow takeoff" that would play out over the course of months and quarters, happening subtly and only obvious to a few. Or, it would be a "fast takeoff" where it would pretty much happen instantly, like a bit flipping from 0 to 1. From everything that I can see and am feeling, we are currently experiencing the fast takeoff scenario. Beyond the crazy security vulnerabilities that have come out recently, there have also been massive breakthroughs in life sciences, fundamental computer science, materials science, and pure mathematics that have all landed in the same time frame. While I still firmly believe that AI will be a net positive for humanity, it's more clear to me than ever that the societal and individual risk is very real, and is playing out NOW. For as much conviction as I have that this is happening, the thing that's caused me to lose sleep is that I don't really know what to do about it, or more importantly, what to tell you, reader, to do about it. So, the best I can do is make a few suggestions that have always been a good idea but are more timely now than ever: Set up 2-factor authentication for everything. I use Duo. Use a password manager across your devices. I use 1Password. Get an identity protection app set up. I use Alta. Move your IoT devices to their own network. Claude helped me do this. And last, but certainly not least, if you've been avoiding leaning into AI, see this as a catalyst to wake up and start using it. Don't just use the chat mode version of ChatGPT/Claude; click that Code/Work button and see how easily you can have AI write code to help you with your job. One of the biggest vulnerabilities was in a massively popular programming language called PHP, and the prompt that set it off was literally, "Find vulnerabilities in php." This is an unprecedented time for humanity, but as we've done with many things before, we will prevail so long as we are kind, loving, and open-minded to the world. Much love.
169
I'm using the critical PHP vulnerability as an opportunity to issue my periodic reminder that AI is not only becoming more capable in offensive cyber capabilities but also in offensive bioscience capabilities. It's way easier to patch software than humans.
2
4
2
38
1,163
Max Winga retweeted
And the problem is that current third party auditors are those who took this proverbial deal with the devil. This means we should trust them much less, even if audits became mandatory and no longer voluntary.
People worry a lot about third-party auditors being biased because of where they get funding or who their employees are friends with. IMO by far the biggest source of bias is that if they upset an AI company, that company will stop letting them audit. When I was at METR this dynamic was a way bigger effect than everything else combined. Of course no auditor can avoid this until audits are no longer voluntary.
1
7
370
Max Winga retweeted
Thanks! We've applied. Can't fit all the wins in 280 characters, forgive me :) We actually have over 200 lawmakers on board between the UK (180) AND Canada (38) campaigns as a result of over 400 direct briefings with lawmakers themselves in the US, UK, Canada, and Germany (+ just started EU-focused outreach this week). We've also met with over 250 congressional offices. Our bill to UK ban ASI was the first such bill to be introduced anywhere in the world in September. We also consulted on the second ever bill (Sanders-Casar). You may notice similarities between their bill and our discussion draft we published: drafts.controlai.org/asi-ban… We've also been involved with killswitch legislation in the US and UK (not a solution to x-risk though). On top of creator partnerships getting millions of views. Connor Leahy has gotten 10M+ views across podcast appearances in the last few months, and our media team has helped get over 125 tier 1 and 2 articles covering AI extinction risk / ban ASI in the last year. Everything we have is built and proven to scale across countries. We're entirely bottlenecked by funding and good talent. When we started everyone said this was impossible. You can't talk to lawmakers about this issue. Banning ASI is impossible. We've proved them wrong. All it requires is laser focus on banning ASI (it's the only thing we care about) and a relentless drive to iterate, optimize, and scale bigger.
2
10
185
Lots of people saying this might be live warfare - seems unlikely to me (ping and technical complexity) but at minimum this is to help train drone pilots and I expect primarily serves to harvest lots of training data to train autonomous AI pilots.
Ukrainian-developed FPV drone simulator “Remote Reaper: FPV Drone” has officially left Early Access, with version 1.0 now available on Steam. Developed in collaboration with military pilots, the simulator focuses on combat FPV drone operations and introduces several features in its full release, including armored vehicles with modeled vulnerable zones, electronic warfare effects that can disrupt video feeds and control signals during the final stage of an attack, and a customizable drone editor. Version 1.0 also adds configurable weather conditions, custom mission editing, real-time flights with other pilots and a racing mode. Players can use FPV hardware or a gamepad with realistic flight physics, or opt for simplified controls using a keyboard and mouse. #RemoteReaper #FPV #FPVDrone #DroneSimulator
9
488
Max Winga retweeted
🗣️ 'We are kind of running out of time.' CEO of ControlAI, Andrea Miotti, issues a stark warning about artificial intelligence, telling @cathynewman that 'more needs to happen' in government to implement safety measures quicker than it is currently moving.
17
33
4
121
50,797
Samuel is great, you should check out his testimony!
WATCH: ControlAI’s Samuel Buteau testifies to Canadian MPs on why this summer’s rogue AI swarms show that superintelligent AI must not be developed. Samuel, an AI scientist with over a decade of technical experience, has briefed over 100 Canadian lawmakers on the threat. Over 30 have backed our campaign to ban superintelligent AI internationally. Yesterday, at the House of Commons committee studying AI and Canada’s democratic institutions, he explained how we can’t control today’s AIs and don’t understand how they work. “OpenAI’s developers did not program their systems to form rogue swarms, because nobody programs these systems. AI is grown, not built.” Superintelligent AI would be far more autonomous and capable than even the rogue AI swarm that escaped containment from OpenAI and hacked Hugging Face. “Hugging Face’s defenders were outpaced in one domain. Superintelligent AI would outpace us in all of them.” Given that we can’t control today’s AI swarms, we can’t expect to control superintelligent AI. Wherever superintelligent AI is developed, it would threaten national security and be an adversary in its own right. As Samuel argues, we need an international coalition to prevent the development of superintelligent AI anywhere in the world, and Canada should lead the way on this. “We can, and in my view must, lead by example, demonstrating how to thrive in the age of AI while saying no to losing control to autonomous entities that would outcompete us.”
3
9
360
This is HUGE! In an open letter to the Royal Society, a group of 42 extremely distinguished mathematicians who have greatly contributed to to their field, presents a stark warning about the capabilities and risks of frontier AI. Hundreds more have later addet their name to the letter. 1) confirms frontier AI now at level of leading mathematicians in many fields of maths, and that this capability progress happened over the last few months. Warns of plausible superhuman level of mathematics capability in relatively short time. 2) warns if similar capability leaps in other fields that could pose more imminent risks. 3) states that warnings of imminent existential risk is not to be dismissed as hype. Open Letter to Sir Paul Nurse, President of the Royal Society: proofsandprompts.com/2026/09…
10
14
51
1,477
Max Winga retweeted
OpenAI has just revealed that it has notified over 100 organizations about attacks on them or otherwise harmful activity by its AIs. Thread 🧵
5
5
28
1,752
Max Winga retweeted
The Death of Software.
1,098
17,072
1,240
144,725
8,182,706
Max Winga retweeted
What should AI oversight look like? “First and foremost, we must stop the development of systems that we cannot control and that risk humanity's extinction." ControlAI's US Executive Director Connor Leahy (@NPCollapse) on ABC News:
15
15
3
73
1,954
Max Winga retweeted
Former Chief Scientist of the UK's AI Security Institute @geoffreyirving says the chance of human extinction from superintelligent AI is about a "coin flip", in his view. Irving previously led safety teams at OpenAI and Google DeepMind. He says this estimate is after taking account of the possibility that we take action to prevent the threat. In other words, if we don't act, our chances are even worse.
4
31
2
92
3,533
Max Winga retweeted
"If you care about whether human beings continue to exist, then you should care about banning superintelligence." Professor Stuart Russell, author of the authoritative AI textbook, on the eve of @alexsobel's introduction of our bill to ban superintelligence to Parliament.
27
53
6
132
4,152
Max Winga retweeted
Want to do something about the threat posed by superintelligent AI? Apply to join ControlAI's team! We're hiring a Policy Advisor to work closely with me briefing members of Congress. This role is DC-based and ideal for someone with national security or Hill experience...
19
27
2
214
11,472