Glen Webster (@glenwebster) header
Glen Webster (@glenwebster) profile picture

AI enthusiast. Growth-company enabler. Partner at Klick Health, global marketing agency. Family-man, adventure-seeker, fascinated by the future. Proud Canadian.

Toronto
Joined January 2009
Photo by Glen Webster (@glenwebster)Photo by Glen Webster (@glenwebster)Photo by Glen Webster (@glenwebster)Photo by Glen Webster (@glenwebster)Photo by Glen Webster (@glenwebster)Photo by Glen Webster (@glenwebster)Photo by Glen Webster (@glenwebster)Photo by Glen Webster (@glenwebster)Photo by Glen Webster (@glenwebster)
A first of its kind vaccine for acute myeloid leukemia, a deadly blood cancer, succeeded in a Phase 3 clinical trial, drugmaker Sellas Life Sciences and Memorial Sloan Kettering Cancer Center announced. wapo.st/4t6oIRy
98
1,402
280
5,528
712,121
Glen Webster retweeted
Three minutes of AI CEOs admitting that what they're building could end humanity.
17
81
23
305
22,732
Important essay. Highly recommend reading.
There is a common belief in the AI field—that advanced AI means the inevitable forfeiture of human primacy in the world. Even many who disfavor that future believe it is likely. I call this the silent consensus, and it must not be allowed to remain silent any longer.
17
32
1
234
30,364
Glen Webster retweeted
Now is the time for pacing the frontier in AI, and this is the best proposal I've seen for how to do it. On the default path, superintelligence by the end of 2027 or 2028 seems fairly likely (35%+): companies are on track for fully-automated AI R&D soon, and my best guess is that that would drive ~6 years of AI progress in one. That’s like going from GPT-3 to AI that solves Navier-Stokes in <1 year; surpassing the range of human abilities in most cognitive tasks. Even though it's not a leap to godlike superintelligence, it is enough to pose a serious risk of AI takeover, and probably to confer decisive power on whichever country gets there first. Yet the leading AI companies are lacking in basic infrastructure; they can get hacked with a couple of days of work. This needs time to solve. Verifiably reallocating compute from capability development to inference and safety gives that time, and means, in the near term, cheaper AI for users. AI progress can still continue. AI development can progress at a reasonable pace (maybe around the pace we have now, slowing through more dangerous periods, with a dial that can be turned up or down), while avoiding the huge societal disruption and risk of catastrophe from rapid recursive self-improvement. In the meantime, we can enjoy a golden age of human-AI collaboration as AI helps make meaningful breakthroughs in science and technology.
We’re releasing a concrete proposal for how a near term AI slowdown could work. It involves: 1. AI companies declaring how they are using their compute and letting third party auditors verify those disclosures. We call this Verified Compute Allocation Disclosures (VCAD). 2. Compute Reallocation towards serving customers and safety, away from capabilities R&D. (2) slows AI capabilities , while (1) makes the slowdown credible. AI companies currently seem to be going for ‘safety case pacing’. But: (i) there’s no consensus on what a valid safety case looks like so there’s no way to consistently audit for compliance, and (ii) if the R&D doesn’t get paused, temporarily delaying a training run for safety doesn’t meaningfully slow the overall trajectory of capabilities progress. It would be great if we had a viable safety case regime, but we need much more time to get it working. Compute reallocation is a good pacing proposal because it is relatively specific, can be verified, and would lead to a more durable slowdown.
5
24
1
208
10,346
Glen Webster retweeted
It would be irresponsible for AI companies to continue relying on safety cases to 'pace the frontier,' especially as AIs get more capable. There is no scientific understanding of what makes a valid safety case. The government and the public should trust safety cases even less, due to the lack of transparency. So pacing via limiting inputs to AI capabilities R&D is the best near-term option. We’ve tried to figure out the details of one such input-based pacing: compute reallocation. Quick summary in 🧵
We’re releasing a concrete proposal for how a near term AI slowdown could work. It involves: 1. AI companies declaring how they are using their compute and letting third party auditors verify those disclosures. We call this Verified Compute Allocation Disclosures (VCAD). 2. Compute Reallocation towards serving customers and safety, away from capabilities R&D. (2) slows AI capabilities , while (1) makes the slowdown credible. AI companies currently seem to be going for ‘safety case pacing’. But: (i) there’s no consensus on what a valid safety case looks like so there’s no way to consistently audit for compliance, and (ii) if the R&D doesn’t get paused, temporarily delaying a training run for safety doesn’t meaningfully slow the overall trajectory of capabilities progress. It would be great if we had a viable safety case regime, but we need much more time to get it working. Compute reallocation is a good pacing proposal because it is relatively specific, can be verified, and would lead to a more durable slowdown.
2
11
1
73
3,079
Glen Webster retweeted
I expect ~5 years of AI progress to happen in 2027 (50% CI: 3-15). That's a GPT-3 to Fable 5.2 / Model 4 equivalent jump, happening in a single year. Concretely this amount of progress seems likely to cause: > Full AI R&D automation (AI companies could fire all their employees without causing a slowdown) > A significant chance (~40%) of AIs that are better than humans at every cognitive tasks (e.g., via algorithms that learn extremely efficiently compared to today's) > An AI incident much worse than Hugging Face (>$1B in damages, >50 deaths) > An unacceptable risk of irreversible AI takeover being incurred by actions taken in 2027, i.e., a ~20% chance we cross a 'point of no return' during 2027, that locks in a ~10% chance of human extinction over the next 10 years.
Unfortunately, it seems like the intelligence explosion will be happening in 2027 after all. Most of this post analyzes the new METR report (though other sources of evidence are also important). If they’re right, that implies an AI-driven acceleration that is 5 months ahead of the AI 2027 scenario. I am scared, sad, and angry. blog.aifutures.org/p/q35-tim…
42
89
17
904
68,779
Glen Webster retweeted
This is a more detailed, fleshed out and stressed-tested version of a proposal we floated earlier in response to the Pacing the Frontier open letter. It's not the only way to pace the frontier but it's my favorite proposal at the moment. Pretty simple: Shift compute from AI capabilities R&D towards other things, and let third party auditors verify that you have done so.
We’re releasing a concrete proposal for how a near term AI slowdown could work. It involves: 1. AI companies declaring how they are using their compute and letting third party auditors verify those disclosures. We call this Verified Compute Allocation Disclosures (VCAD). 2. Compute Reallocation towards serving customers and safety, away from capabilities R&D. (2) slows AI capabilities , while (1) makes the slowdown credible. AI companies currently seem to be going for ‘safety case pacing’. But: (i) there’s no consensus on what a valid safety case looks like so there’s no way to consistently audit for compliance, and (ii) if the R&D doesn’t get paused, temporarily delaying a training run for safety doesn’t meaningfully slow the overall trajectory of capabilities progress. It would be great if we had a viable safety case regime, but we need much more time to get it working. Compute reallocation is a good pacing proposal because it is relatively specific, can be verified, and would lead to a more durable slowdown.
12
33
2
383
23,654
Glen Webster retweeted
See our proposal here: pacing-ai.com/home Note that we wrote this relatively quickly and scrappily, given how urgent we think the situation is (see AIFPs recent timelines update). We hope to follow up with more relevant analysis in the coming weeks.
3
7
3
92
4,320
Glen Webster retweeted
We’re releasing a concrete proposal for how a near term AI slowdown could work. It involves: 1. AI companies declaring how they are using their compute and letting third party auditors verify those disclosures. We call this Verified Compute Allocation Disclosures (VCAD). 2. Compute Reallocation towards serving customers and safety, away from capabilities R&D. (2) slows AI capabilities , while (1) makes the slowdown credible. AI companies currently seem to be going for ‘safety case pacing’. But: (i) there’s no consensus on what a valid safety case looks like so there’s no way to consistently audit for compliance, and (ii) if the R&D doesn’t get paused, temporarily delaying a training run for safety doesn’t meaningfully slow the overall trajectory of capabilities progress. It would be great if we had a viable safety case regime, but we need much more time to get it working. Compute reallocation is a good pacing proposal because it is relatively specific, can be verified, and would lead to a more durable slowdown.
30
104
15
603
59,645
Glen Webster retweeted
There is a common belief in the AI field—that advanced AI means the inevitable forfeiture of human primacy in the world. Even many who disfavor that future believe it is likely. I call this the silent consensus, and it must not be allowed to remain silent any longer.
105
197
118
1,580
259,915
Glen Webster retweeted
Ahead of Anthropic’s IPO, a rare coalition across AI safety, open source, e/acc, science, and law has signed the MisAnthropic Statement. Read the statement or sign at: misanthropicstatement.com/
159
678
282
3,727
954,167
Glen Webster retweeted
The generally wise @KatjaGrace on public advocacy (supporting arguments in linked post): "1. It’s way, way, way more important that we stop dangerous AI soon than that we ensure that we don’t stop AI too much 2. If we stopped AI development, the risk of not starting up again for an extremely long time is low 3. Getting the public involved is not very dangerous 4. Public comms is not that rife with downside risks 5. Pausing advanced AI soon greatly increases our chances of surviving 6. We don’t need a plan before we pause 7. Raising the alarm is very important at the moment 8. Working on marginally improving safety of models at the AI companies is not remotely competitive with raising the alarm at the moment 9. Doing advocacy doesn’t seem to have adverse effects on people doing it And one where I feel like I haven’t heard so much disagreement lately: 10. It matters what the public think / political will is growable" lesswrong.com/posts/dQJ3ArHM…
12
37
7
284
17,238
Glen Webster retweeted
Long before this year’s rogue AI cyberattacks, researchers spent decades warning that no one actually knows how to make powerful AI do what we want. That’s the “alignment problem,” and it’s the subject of MIRI’s first long-form video.
9
52
4
259
8,444
Glen Webster retweeted
I still find it totally wild that the chief scientist of OpenAI posted this on the company blog, and we all just moved on to the next day's news
36
140
14
1,090
153,809
Glen Webster retweeted
Sister
1,363
12,316
5,100
163,677
22,960,371
What are the visions of the post-AGI future in San Francisco? Many think we're all going to die, but even the "positive" visions seem rather dystopian. Here, I wrote about "handoverism," which involves handing control of the future to an AGI God, with humans outside the loop. ruxandrabio.substack.com/p/h… We are on the cusp of RSI or recursive self-improvement: this means that AI systems can self-improve, without the need for human intervention. This means our world stands to be transformed in what many call “the singularity”. I moved to SF around three weeks ago and one of the things I have been trying to understand is where we are heading, at least according to those developing the tech. The worst scenarios are plainly bleak: all of us, or vast numbers of us, die. But what is striking to me is how little reassurance even some of the happiest scenarios offer. But one common and ostensibly optimistic vision is known as “handoverism”: humanity cedes control of its future to a godlike AI and we become the comfortably maintained inhabitants of a civilisation whose direction is no longer ours to decide. It is difficult to see what democracy would mean in such a world, or where the consent of most of humanity to the instantiation of such a regime enters the picture. The permanent displacement of human labour is treated almost as a given. At the same time, there is scarcely any satisfying answer to the question of how we might remain useful to one another. Even our relationships seem uncertain. The promised utopia looks to me much closer to a kind of dystopia. “It’s not my preferred outcome,” someone working at one of the big labs told me, “but once we achieve superintelligence, which we cannot stop at this point, I cannot see any other option for where humanity will go.” Then, after a pause, he added: “It is still much better than what I actually fear most, which is that we might all die.” He sounded resigned, as if the question of what humans would be for (apparently not much?) had already been settled somewhere else and by someone else. All that remains, it seems, is to wait for this pre-destined fate to unfold before our eyes. But I do not think that is the case. I believe we always have a choice and that we should try and steer this technology in a way that maintains our agency and control. And even if that looks hard and daunting, the immensity of the stakes here make it worth trying at least. I do not know whether the handoverist vision will come to pass. That the people building this technology consider it plausible, and often desirable, guarantees nothing: proximity to a technology does not correlate that well with predicting its impact on society. But they are the ones closest to it, and what they say deserves to be at least taken seriously. The rest of society, including some very intelligent people, has been far too quick to wave these scenarios away and not even get involved in the debate. Whether or not the belief is correct, it is sincerely held, and it is not “marketing hype.” I am writing this because I think it is high time that more people, inside San Francisco and out, engaged with the arguments about what our future will look like, and answered them.
60
71
36
559
154,878
Glen Webster retweeted
Episode dropping tomorrow with @paulfchristiano. He thinks there’s a 1 in 3 chance of extreme superintelligence within a year (absent any slowing down). And he'll explain what labs and governments should do right now given that possibility.
78
148
42
1,613
158,815
Glen Webster retweeted
Fun chart I made for something I'm writing: Percentages of self-made vs. inherited billionaires, split by whether the industry they made their billions in is competitive or basically getting government rents, by country.
136
276
49
3,650
212,219
The AI Treaty March is making its way to the US consulate in Toronto. The event calls on Xi and Trump to make a deal that bans developing more powerful systems until it can be done safely.
5
3
2
10
4,515