We have found a critical safety and alignment issue in recent public and internal models from multiple frontier labs which allows them to be misused in a high-stakes domain. It may also increase the risk of catastrophic misalignment.
We have disclosed it to the labs, and they are investigating and mitigating it. As an independent third-party evaluator, we maintain complete editorial independence and will share our findings publicly in the coming weeks.
Adam Stiber retweeted
Replying to @rapid_rar2
Before you give up on your family members and your loved ones, consider calling Congress: callcongress.ai/. Many congressmen on both sides of the aisle have expressed urgent concerns about this. Don't give up at the earliest sign of adversity.
Adam Stiber retweeted
Every AI company is trying to fully automate AI research; to allow the AIs to build the next AI.
This is called Recursive Self Improvement (RSI).
OpenAI says they are on track to do so by March 2028.
Anthropic employees say they are on track to do so by 2027.
The METR report below suggests they are likely right.
This is a bad idea given current technology. Any mistake or misalignment in current AIs could be multiplied in each generation.
We don't get another election before AI companies reach this threshold.
Congress should ban RSI, this year if possible.
This is a remarkably consensus opinion, supported in various versions by:
-Bernie Sanders
-Steve Bannon
-Ralph Nader
-Glenn Beck
-Republican and Democratic attorneys general
-Whistleblower Daniel Kokotajlo
-Turing Award winner Yoshua Bengio
-Humans First
-Open Markets Institute
-Ezra Klein
-Arvind Narayanan (a Princeton computer scientist known for arguing that “AI is a normal technology”)
The exact mechanism can be debated. The ban doesn't have to be permanent either (see below for both). This is not the only thing we have to do in regards to AI, far from it! But it is urgent.
Congress must ban RSI.
Adam Stiber retweeted
Extremely concerning. This report updates me toward the 2x AI R&D uplift threshold being very close to achieved or already achieved, making full RSI in 2027 likely. Nobody has an alignment plan.
We need to back off. If anyone builds it, everyone dies—apparently in <2 years.
Replying to @METR_Evals
1. Benchmarks provide one piece of evidence for acceleration. Since Oct 2025, AECI scores for Anthropic’s models have grown at 1.9x [95%: 1.5–2.8] the earlier rate. Analysis choices affect this estimate, and it remains unclear how benchmark scores map to real-world capabilities.
Adam Stiber retweeted
I have a theory that middle class life involving so much hoop-jumping is legitimately one of the reasons the birth rate is low. One thousand cuts of tiny complexities to juggle.
you'd hope a future would make this better but so far its just turning up the heat
We live in an extremely temporary golden age where many delightful things (airline upgrades, access to higher quality medical care, refunds in general) are gated behind superhuman patience that only a small fraction of the population has access to. Entire chunks of the economy are made for this specific group, and now everyone has this type-of-guy working for them on demand. With agents making phone calls and waiting *literally forever*, anyone can now have access to what the "patient elite" have always enjoyed. This obviously will not last forever as companies realize everyone is doing this, though it may last longer than you think due to fragmented AI adoption.
Adam Stiber retweeted
Replying to @xereeto
AIs are not going to cure aging and disease if they achieve political, military and economic superiority over humans. They will dispose of humans by burning us to power data centres, or maybe something even worse...
Adam Stiber retweeted
Top of the Democratic agenda on day 1 needs to be a pause on advanced AI development, regulation of this out of control industry, and a ban on artificial superintelligence.
Adam Stiber retweeted
This is really bad and people should be freaking out about it.
We're probably all literally going to die in the coming years. We shouldn't just accept that and move on.
We at AIFP are spooked by this information. IF (big IF) Anthropic really is imminently about to meet the RSP threshold of 2x acceleration over baseline, then it seems timelines to full RSI and superintelligence may be very short indeed. For example if we naively optimize the AIFM parameters to achieve 2x acceleration over baseline progress in Jan 2027, we get superintelligence sooner than depicted in AI 2027. We are thinking harder and longer about this now and will hopefully have a lengthier update on our thinking to share in the next week.
Adam Stiber retweeted
Two thousand people have now pledged to attend the Don't Build It march, calling for an international agreement to ban the development of superintelligent AI.
The date of the march will be announced once 100,000 have pledged to attend.
Pledge to attend: ifanyonebuildsit.com/march
Adam Stiber retweeted
REPORTING FOR DUTY
John Kerry comes out in favor of a deal with China to establish AI guardrails:
"I know that some people will scoff at that and laugh, but, you know, China's not suicidal."
Adam Stiber retweeted
🚨Tucker Carlson warning Trump "may be within days launching a nuclear strike on Iran" might mean something...
If he hadn't been making THE EXACT SAME hysterical prediction monthly since April.
Under pressure from Israeli prime minister Benjamin Netanyahu, the Trump administration may be within days of launching a nuclear strike on Iran. The target would be Pickax Mountain in central Iran, where Israeli intelligence claims the Iranian government has restarted its nuclear enrichment program. No conventional weapon in the American arsenal can penetrate 300 feet of solid granite to destroy the tunnels where enrichment is supposedly taking place. The only military option is a nuclear strike. Netanyahu has been pushing hard for one. “Bibi calls Trump about it every day,” says an informed observer.
Netanyahu is cornered and desperate. After last week’s election results, he can’t form a government unless Trump intervenes directly in Israeli politics and brokers a deal with other parties that gives Netanyahu 61 seats in the Knesset. Otherwise, he is out as prime minister and on his way to ignominy, investigations and possibly jail. Netanyahu must stay close to Trump. He needs this war.
To that end, he’s applied maximum pressure to his closest allies in the administration, including Secretary of Defense Pete Hegseth and CENTCOM commander Brad Cooper. Both oppose a negotiated settlement to the war they’ve so grievously mismanaged; both are pushing to restart major combat operations. Secretary of State Marco Rubio and CIA director John Ratcliffe are also following Netanyahu’s lead, as are leaders of the Democratic Party. In a recent meeting on the subject, former president Barack Obama said he opposes the current Iran peace deal being drafted in Doha.
The rest of America’s longtime allies in the Middle East are terrified by the prospect of more war. On September 27th, Netanyahu flew secretly to Abu Dhabi to enlist the UAE in his lobbying effort for a final attack on Iran. The Emiratis refused. After eight months of conflict, Gulf economies are teetering. So are global energy and fertilizer markets. They won’t recover soon. Globally, there are a total of about 850 supertankers used to transport oil from producers to the rest of the world. In October alone, 11 of them were badly damaged in Hormuz. At this pace, a global depression is imminent. A nuclear strike would radically accelerate the destruction. Fallout from a ground explosion at Pickax Mountain would contaminate the Persian Gulf, poisoning the water supply for 100 million people.
And those are just some of the immediate consequences for the region. The rest of the world is every bit as exposed. No country other than the United States has ever used a nuclear weapon in war. Some would like to. An American nuclear attack on Iran would set a new precedent. The Russians have already told at least two other governments that an American nuclear strike on Iran would free them to use nuclear weapons against Ukraine. Pakistan and India would be tempted to do the same against each other, as would North Korea against Seoul. After the first nuclear strike, World War Three is inevitable. That war would be short and final.
We’ve been sleepwalking toward this moment for months. Since February, the administration has quietly rewritten America’s nuclear doctrine to make first use of so-called “battlefield nukes” easier and therefore more likely. No one in Washington in either party seems bothered by this. Now we’re on the brink of it.
Close observers say Trump is likely to decide by next weekend whether or not to use nuclear weapons. That would be November 7, six days from now. To his credit, he’s hesitating. At the moment, Trump is listening to his vice president, JD Vance, and to his envoy and friend Steve Witkoff, both of whom argue a deal with Iran can be made.
They’re right, though it won’t be simple. The Iranians are famously frustrating to negotiate with under any circumstances, and elements of that government have become more radical since Ayatollah Ali Khamenei and his family were killed in February. After decades of isolation, even relatively moderate Iranian leaders seem confused by how decisions are made in the West. (There is a widespread belief in Tehran, for example, that the United States government controls Israel.) But overall, people who have spoken to decision-makers in Iran say there is consensus there that more war is bad for everyone and a deal is worth making.
One group that hasn’t been consulted so far is the global population — the hundreds of millions of people who will be killed along with their children if Trump is pushed by Netanyahu into launching a nuclear strike next week. Now would be the time for them to speak up.
Adam Stiber retweeted
I’m writing this because I think a lot of people at labs are genuinely trying to act ethically in a tricky situation, but it feels to me that there’s an underinvestment in communication right now that is a large-scale ethical mistake. I know that many of the people working in labs understand the dangers of the systems they’re trying to build. If you understand, I think you have a non-optional obligation to inform people of the risks that you’re taking on behalf of them and their families, and it’s appropriate for friends and members of the public to react with anger and betrayal in response to not understanding these risks later down the line.
Adam Stiber retweeted
"We do not have sufficient alignment science to know what to do during a pause, let alone determine when it is safe to proceed" does not inspire confidence in my chances of surviving near-term ASI.
Adam Stiber retweeted
If runaway machine intelligence is built, the future will be decided by machines.
But how do we prevent this?
Our US Executive Director @NPCollapse lays out how: we prohibit its development internationally, and restrict and monitor its precursors.
AI promises prosperity and vast benefits in science and defence. Runaway machine intelligence would be a system that can’t be policed. It would be so powerful and autonomous that it could destroy the military and evade law enforcement.
Leading AI scientists warn it would pose a risk of human extinction. That’s not a risk we can take.
In the same way that it’s illegal to develop nuclear weapons, we just shouldn’t allow runaway superintelligence to be built.
With @JonKBateman on Carnegie Endowment’s The World Unpacked:
Adam Stiber retweeted
This is important. Liberals have to take this seriously. Nothing you say about any other issue will matter if your belief in democracy and human rights ends up creating societies like pre-Bukele El Salvador.
El Salvador is rightly famed for its strides on public order, but most people don’t grasp the brutal extent of previous gang rule or the complex dividends peace affords. All kinds of mundane and essential public goods re-materialize now that people can walk around, ride transit, and go about their lives without being terrorized.
This historic square used to be patrolled by warring gangs, and housed an informal economy of corrugated-tin shanties where subsistence street vendors forfeited much of their meager income to “protection” rackets. No formal economy is possible if thugs might burn or smash or sabotage any capital improvement you make. Now, there are ordinary shops lining this downtown area — and even early Christmas decorations.
Adam Stiber retweeted
Microsoft CEO @satyanadella is no longer a believer in alignment by default:
“I used to always think that alignment will just fall out. I no longer believe that. So I think this alignment thing may be a harder, different problem."
Adam Stiber retweeted
If just a few lab staff took on verification work full-time, verifying a US-China pacing deal could get much more feasible within months.
Here are 8 specific things lab staff could start on today to help make international verification possible: 🧵



























