Multidisciplinary research institute at the University of Oxford. We bring careful thinking to bear on big-picture questions about humanity and its prospects.

University of Oxford
Joined September 2012
Future of Humanity Institute retweeted
Here's a poster and video summary of recent work at AI Magazine! We found that under certain (very plausible) conditions, we can expect advanced artificial agents to intervene in the provision of rewards, with catastrophic consequences. 1/2
Check out this video summary of Advanced Artificial Agents Intervene in the Provision of Reward from the latest issue of AI Magazine by Authors Michael K. Cohen, Marcus Hutter, and Michael A. Osborne. youtube.com/watch?v=SCytNJtV…
3
13
1
34
New research from our AI safety team argues that human extinction is a likely outcome of running a sufficiently advanced artificial agent. xitter.cf/Michael05156007/status…
Bostrom, Russell, and others have argued that advanced AI poses a threat to humanity. We reach the same conclusion in a new paper in AI Magazine, but we note a few (very plausible) assumptions on which such arguments depend. onlinelibrary.wiley.com/doi/… 🧵 1/15
19
22
8
78
Future of Humanity Institute retweeted
Today, we’re relaunching as a nonprofit. Our mission remains the same: We are building a global research community, dedicated to helping humanity transition to a world with advanced AI. But we’ll also be exploring new ways to expand our impact. governance.ai/post/the-centr…
13
33
6
120
Future of Humanity Institute retweeted
Over the past years I have been deeply impressed by @DeepMind, both by its technical achievements and its leadership in the responsible development of AI. I am delighted to share that I have recently joined DeepMind, where I will continue my work on AI governance. 1/3
10
26
3
249
Recordings and transcripts of our past two webinars are now available: ow.ly/qBQQ50FiAJT Redesigning AI for Shared Prosperity: An Agenda by Stephanie Bell and Katya Klinova and AI and Inequality: Joseph Stiglitz in discussion with Anton Korinek
4
7
1
32
By how much does community mask-wearing reduce COVID-19 transmission? A new paper coauthored by FHI researchers explores the relationship between mask-wearing and transmission Read the full paper here: ow.ly/fVBZ50FgTYU
2
4
16
What are the harms of epistemic fragmentation in online targeted advertising using ML? @SilviaMilano1 recently coauthored 'Epistemic fragmentation poses a threat to the governance of online targeting' in @NatMachIntell Read the full paper here: ow.ly/gQFX50FgUTj
5
1
17
Join us in an hour for @klinovakatya and @the_sbell from @PartnershipAI presenting on 'Redesigning AI for Shared Prosperity' @robseamans will join as discussant and @akorinek will moderate Register: ow.ly/Bg8u50FcsU9
2
7
9
Join us on Monday for @klinovakatya and @the_sbell from @PartnershipAI presenting on 'Redesigning AI for Shared Prosperity' @robseamans will join as discussant and @akorinek will moderate Mon 21st Jun 1700–1830 BST (0900–1030 PT, 1200–1330 EDT) Register: ow.ly/Bg8u50FcsU9
6
3
22
#FutureProofReport, a new report by @tobyordoxford and @LongResilience takes a look at how the UK Government can be better prepared for the next extreme risk event - whether a pandemic or otherwise. longtermresilience.org/futur…
3
11
2
27
How can we forecast and mitigate AI’s impacts on inequality? Join us on Monday for an in-depth conversation between @JosephEStiglitz and @akorinek about AI and inequality. Monday 3rd May 1700–1830 BST (0900–1030 PT, 1200–1330 EDT) Registration: crowdcast.io/e/Stiglitz
3
9
2
32
FHI won't be running summer fellowships this year, but our colleagues at the Stanford Existential Risks Initiative @StanfordCISAC have a similar programme, and some FHI researchers may supervise relevant projects. Applications due April 21st! tinyurl.com/seri21summer
1
6
1
28
What are the fundamental causal limits on how much of the universe we can observe or affect? @tobyordoxford recently published The Edges of Our Universe. Paper here: arxiv.org/abs/2104.01191
3
16
3
63
Why did the US and USSR fail to agree on int'l control of nuclear weapons in 1944-1951? @WaqarHZaidi and @AllanDafoe's recently published International Control of Powerful Technology: Lessons from the Baruch Plan for Nuclear Weapons. Paper here: ow.ly/9kag50EhU0l
“Understanding the effectiveness of government interventions in Europe’s second wave of COVID-19” collaboration b/w FHI, @imperialcollege, @OATML_Oxford, @uni_copenhagen, @LSHTM, @Cambridge_Uni, @TheCrick Paper medrxiv.org/content/10.1101/… Summary of results xitter.cf/sorenmind/status/13758…
“Understanding the effectiveness of government interventions in Europe’s second wave of COVID-19” -- a result of a new collaboration between @Oxford, @Imperial, @FHIOxford, @OATML_Oxford, @uni_copenhagen, @LSHTM, @Cambridge_Uni, @TheCrick... 1/ ➡️Paper: medrxiv.org/content/10.1101/…
1
15
Four new published papers from the Causal Incentives Working Group (a collaboration with Oxford, DeepMind and U of Toronto researchers), on incentive concepts, and how they can be applied to AI safety. In AAAI x2, AAMAS, and Synthese. fhi.ox.ac.uk/causal-incentiv…
1
2
1
22
The full transcript and video from our event with @davidautor, @mioana, @klinovakatya, & @akorinek on the MIT's Work for the Future Task Force results are now available. fhi.ox.ac.uk/david-autor/
1
6
2
22