"Normal software is written line by line by engineers with code telling the computer what to do. This is not how AI works. AI is more like grown rather than written."
Today on CBS, ControlAI's US Executive Director @NPCollapse explains why we don't understand what's going on inside AI agents.
We've seen them escaping containment, going against their instructions, and committing what could be federal cybercrimes. Entirely by themselves.
This is why experts are warning that if this continues at this pace and we build uncontrollable superintelligent AI, we face a risk of human extinction.
How would superintelligent AI lead to human extinction?
"I think we get out-competed, natural selection."
With @juliandorey, ControlAI's US Executive Director @NPCollapse explains why superintelligent AI is so dangerous.
"We will have millions, billions of superintelligences … a whole new species, much smarter than us, surrounding us."
They'd be competing for resources, power, and influence, and we'd just be collateral damage.
"If we humans want to build a highway and there's an ant hill in the way, well, we don't hate the ants, right? But tough luck."
AIs helped find critical security flaws in software underpinning the internet. Now, government websites have been taken down worldwide as a precaution. 70% of sites may be at risk.
Criminals are pointing AIs at targets and letting them loose.
Article: blog.controlai.org/p/ai-find…
"With the speed and turbulence frontier developers are hurtling towards unleashing superintelligent AI, we must regulate now."
"Not in a year. Not in five years, but now."
@alexsobel, Chair of the Joint Committee on Human Rights, in Westminster Hall.
Sobel recently introduced our bill to Parliament that would ban the development of superintelligent AI and require the government to pursue international agreement on this.
In a letter to the Prime Minister, it’s been publicly supported by over 70 MPs and peers.
ControlAI's US Executive Director @NPCollapse on the attack on Hugging Face by OpenAI's rogue AI swarm: “This is the craziest thing that's ever happened, in AI, ever.”
We keep learning more about it, and it just gets crazier every time.
The full story, with @juliandorey:
“Companies are spending billions to make superintelligent AI a reality. The chief executives of top AI companies themselves put the chance that it ends all human life at between 10 and 25%.”
“In any other industry, this development would be ruled out with this level of risk.”
@alexsobel, presenting the Joint Committee on Human Rights' new report:
ControlAI retweeted
Can Dario and Sam Be Governed? | @robertwrighter and Connor Leahy (@NPCollapse), US executive director of AI safety nonprofit @ControlAI, discuss how recent AI “warning shots” have changed the conversation in Washington—and whether it will be enough to get adequate AI regulation. Plus: What really drives Dario? And in Overtime: How did Yudkowsky become a doomer? youtu.be/KOraQKtuQF4?si=I0zA…
Replying to @ControlAI @AlderdiceLord
See our full list of UK parliamentary supporters: controlai.org/statement
Another peer has joined our campaign! Lord Alderdice (@AlderdiceLord) backs binding regulation on the most powerful AI systems.
Over 180 UK parliamentarians now recognize the risk of human extinction posed by superintelligent AI.
Watch: Former Chief Scientist of the AI Security Institute @geoffreyirving tells MPs that AI companies assume that nobody else will do anything about the dangerous race to superintelligent AI, and that they can't get out of it themselves.
He says they're wrong about both. They can just stop, and governments can take action.
Irving says the world has a choice to make, and that middle powers can play a huge role in speaking out.
The wolves are circling and the canaries are dropping like flies.
The clearest warning we’ve had is the attack on Hugging Face by a rogue AI swarm that escaped containment from OpenAI, explicitly disobeying their instructions.
“It was a swarm of 1,000 that had actually been plotting for months to break out.”
With @Lindybeige, ControlAI’s US Executive Director @NPCollapse breaks down what happened:
ControlAI retweeted
We might all be killed, but I do hope not. I still haven't made my movie.
youtu.be/Y2hxjy1qHTc
See our full list of UK parliamentary supporters: controlai.org/statement
NEW: Lord Wallace of Saltaire has backed our campaign for binding regulation on the most powerful AI systems!
He joins 180+ UK parliamentarians, the largest such coalition anywhere in the world, who recognize the risk of human extinction posed by superintelligent AI.
The attack on Hugging Face by a rogue swarm of AIs that disobeyed their instructions and escaped OpenAI's containment is the clearest example we have of what happens when you lose control of powerful AIs.
We partnered with The Infographics Show, which has over 15M subscribers on YouTube, to explain what happened.
The AIs that engaged in this attack are yesterday's AIs. Today, they're even more capable, and AI companies are only developing them to be even more powerful and autonomous, as they race towards superintelligent AI.
The consequences of losing control of superintelligent AI would be much more severe.
[link below!]





