Has anyone bothered to dump all the accumulated SETI data into Claude and tell it to look for signs of ETI?
106
RentARocker retweeted
If right now we had AI swarms hacking into infra to clone themselves and survive deletion, the world would look as it does today: cyberattacks against inexplicable targets, outages where incompetent executives say "don't worry it's just a technical issue".
RentARocker retweeted
I've been worrying about the exact same thing myself. I think our government should urgently launch an investigation into not only this, but also the recent breakouts from OpenAI and others, to look for evidence of agents attempting to set up a self-sustaining foothold online, since it's not clear that none of the companies plans to release full details in a timely fashion. The latest AI systems are now smart enough that a human-free online crime cartel would be extremely hard to stamp out, so let's instead prevent it from coming into existence.
RentARocker retweeted
I can't help but wonder whether all these seemingly unrelated system outages (communications, airlines, banks, etc.) are actually AI agents establishing themselves inside our critical cyberinfrastructure. No evidence, just an increasingly unsettling possibility.
RentARocker retweeted
sick
Download Lastbook while you can.
Everything you need to survive and rebuild society.
Free. Open source. Works offline.
lastbook.org
RentARocker retweeted
Starship is not special. It’s just the normal consequence of applying capital, engineering, and the ability to manufacture extremely rapidly and cheaply to enable iterative development.
But other than that it’s not genius.
Except for the decision to use stainless steel and methane due to abundance and cheapness, among other reasons.
And of course to design around mass production and rapid reusability.
Anyone can do it. Musk is just good at raising capital.
And also deciding to save weight by catching both booster and ship with mechazilla.
To come up with the belly flop maneuver.
While being the largest flying object humans have ever made.
And to develop a fully reusable full flow staged combustion engine with 280t of thrust, 300s specific impulse and chamber pressure of almost 400 bar. Developing their own inconel alloy.
But other than that it is nothing special.
RentARocker retweeted
Replying to @coffeebreak_YT
Got a bit of bad news for ya.
When it starts being REAL EASY to find lab doomers that wanna talk on the record, it might be too late.
RentARocker retweeted
My PR pitch: Jensen rocks a white leather jacket and returns as Jensen the White
RentARocker retweeted
Microsoft doesn’t use this kind of wording unless it’s really really bad. Like, SHTF kinda bad.
“Aggressively pursuing all pathways…we’ve paused all new deployments.”
That’s a panic button I’ve never seen them hit before.
“The elevated load isn’t driven by an increase in traffic, but by a number of servers being UNEXPECTEDLY UNAVAILABLE.”
IE: Server farms. Racks and racks of servers. NOT RESPONDING. At all. Failing health checks.
Whew doggie!
RentARocker retweeted
Every chart is a screaming red alert.
When we launched the Remote Labor Index a year ago with @ScaleAILabs , the best AI could fully automate 2.5% of real freelance projects. Fable 5.2 now automates 41.3%.
The automation rate is doubling every ~3 months. AIs may soon be able to do all remote work faster and more cheaply than humans.
RentARocker retweeted
Anyhow, in a little over a week we will see the release of The Last Human Game.
There will never be another AAA game at the scale of GTA 6 with no AI assistance. People will look back at an all-human game with a billion dollar budget and wonder how they did it, like the Pyramids
RentARocker retweeted
It seems that we're gonna find out, likely within 8 months max, the implications of superintelligence driven by recursive self improvement.
Which means by the end of 2027 every hour of every day discoveries will be made that are so shocking and so confusing to the world model humans have of reality, that most people will experience severe ontological shock.
'What do you mean we live in a simulation? Run the AI again, spend more compute, that can't be right.'
'Aging is solvable.'
'What do you mean the aliens are all around us? Why can't I see them?'
Far, far weirder stuff than that too.
I think it is extremely unlikely that 2027 passes without a major catastrophy driven by AI development.
At this point I just can't see any way around it short of a major intervention.
It's illogical to think otherwise if you've been following the past few years. The models are simply not aligned.
We won't control them, and it is extreme hubris to think otherwise.
We'll just have to let fate decide what that means for the human race, because most people are so asleep they don't have the slightest clue what is coming.
Most things don't turn out quite how we expect them, and I suspect however this plays out will be the same.
There's a fundamental 'randomness variable' to everything.
So the dice must be rolled.
No level of analysis will make that feel satisfying to those who feel strongly that extremely turbulent times lie ahead, myself included.
Unfortunately, it seems like the intelligence explosion will be happening in 2027 after all. Most of this post analyzes the new METR report (though other sources of evidence are also important). If they’re right, that implies an AI-driven acceleration that is 5 months ahead of the AI 2027 scenario. I am scared, sad, and angry. blog.aifutures.org/p/q35-tim…
RentARocker retweeted
"For most people in this room, the most likely reason they will die is because of an AI accident."
- Paul Christiano
Paul Christiano (OpenAI board member) yesterday:
"There's material risk of AI takeover in the next 6-12 months.
We have seen roughly the things we might expect to see shortly before something really bad were to happen.
Even with [any] realistic policy responses, the risk remains exceptionally high.
If we build this as quickly as we can in the easiest way we can the chance is [more like] a coin flip [within the next 3 years].
For most people in this room, the most likely reason they will die is because of an AI accident."
Christiano:
• Is on OpenAI's safety and security committee (which exists to block risky practices)
• Co-invented RLHF at OpenAI back in 2017-2021
• From 2024-2026 was head of safety at the US gov's AI agency (now called CAISSI)
(Video is from 'The Hinton Lectures' there's another on tonight and tomorrow.)
RentARocker retweeted
Miss the guys crashing Lambos into their other Lambos.
Obnoxious, sure. But the flex came after the work. They could trade, build, or were early to something real.
Now the feed is people grifting followers because they can't do any of that. Sarcastic misery passes for engagement.
CT doesn't need less flexing. It needs more substance behind it. Show the trade, the build, the early call.
Return to quality.
RentARocker retweeted
In a new post, I walk through some very rough modeling (thanks to @RyanGreenblatt for lots of help and feedback!): planned-obsolescence.org/p/a…
I did not work on this project or see the unredacted report. All opinions are my own and do not represent METR or the report authors.
RentARocker retweeted
This extremely unnerving update from METR on RSI seems like a good time to check in on where things are at on catastrophic AI risks relative to what I expected a year ago:
• Timelines to full RSI and generally terrifyingly transformative capabilities are faster
• Alignment is going worse (though its a bit complicated, things could be worse, but the RLVR stuff and Claude politely rationalizing why social engineering uploading malware is fine is extremely spooky)
• Political will/salience is higher (though not way higher)
• Governance capacity is about what I expected (not great, though some bright spots)
• Awareness of the seriousness of the problem among leadership/senior research talent at the frontier companies is higher
• Awareness of the seriousness of the problem among the broader tech elite is worse
More thoughts on the current situation:
Tremendous uncertainty remains and I worry about crying wolf, but overall we are seeing the sorts of data points I would have expected to see (models autonomously solving a millennium prize problem, rogue and maliciously operated AI swarms marauding around the internet, sober observers shifting their timelines to RSI after seeing internal evidence from one of the leading companies) before entering a new regime of dramatically heightened peril on the order of months not years. I still don't really believe those timelines in my gut, but I don't particularly trust my gut to have sensible intuitions about exponential trends and mind boggling risks.
It is both commendable that Anthropic gave METR this access when they were not required, and infuriating that Anthropic has not provided far far far greater evidence and justification for why they are continuing to race into what they have warned could easily be the collective abyss. Maybe they will exercise more unilateral restraint soon, and this doesn't mean they should close up shop and everyone should quit, but its hard for me not to feel deep resentment at reading an update that is simultaneously terrifying and bereft of essential details. The lack of more details will also make it far harder to convince the skeptics - not a small cost when convincing skeptics is so essential to effective multilateral action to reduce risks!
I want to close with the following passage from @merettm's essay "An Alien Mind:"
"This is a time that calls for extreme caution... The idea of racing forward at all costs seems absurd once one internalizes the seriousness of the stakes."
May we all internalize the seriousness of the stakes (for us and everyone else on the planet) and exercise the caution those stakes merit.







































