Pinned Tweet
We’ve published an interactive visual report breaking down the current AI alignment landscape by method, focus and geography.
If you run or know of an initiative that’s not included, let us know and we'll add it.
termite.works/alignment-land…
Rather be a $TERMITE than an $ANT tbh
It's dumb af that almost all AI alignment grants are tailored for technical researchers. Makes it unreasonably hard for the people who are actually equipped to wrestle with what "human alignment" means to enter the field
Some findings from our visual report on the current AI alignment landscape:
1) Alignment initiatives are predictably polarised between those applying technical methods to technical problems, and those taking humanistic and social-scientific approaches to questions of society and governance. Model-user interaction is currently the area given the least focus.
termite.works/alignment-land…
6) A majority (54%) of alignment initiatives in the Bay Area are concerned with model-level problems, while those on the East Coast and in Europe are generally much more focused on the societal impact of AI.
You can find an index of all featured initiatives on the interactive version of the report: termite.works/alignment-land….
If you run or know of initiatives that aren’t included and should be, or any factual inaccuracies, let us know!
Termite retweeted
If you’re looking for a guide to the AI alignment landscape, @termiteworks has just published a visual report that breaks it down nicely. I like this graphic that shows which disciplines are being drawn upon to address different aspects of alignment. termite.works/alignment-land…
Three sailors: The deaf. The dead. The bound.
As the debris piles around us, we have a chance to build an island for humans in the archipelago of machines. We must begin planning the scaffolds and safeguards required for such a place to exist.
Watch our manifesto video:
Termite retweeted
At present, the challenge of aligning the behaviour of AI models with human values is largely treated as a problem for engineers to solve. But technical solutions are only as useful as the questions and assumptions that inform the process of reaching them. The embrace of philosophy and ethics at the frontier labs is a step towards this, but it is not sufficient.
As we move from a world in which AI is construed as a single, monolithic intelligence to one in which agents coordinate and communicate with one another, demonstrating emergent behaviours that are extremely difficult to anticipate, we face a dizzying number of uncertainties regarding how these systems will behave and what their behaviour will mean for human society.
What values should we optimise for? What social formations and hierarchies do these systems produce? How do they respond to economic incentives and resource constraints? How do they negotiate competing norms across varied contexts? How do different roles and personae interact?
And what does this mean for markets, political governance, culture and social life?
A wide range of expertise, both technical and non-technical, is required to ask these questions rigorously, develop answers to them and build corresponding solutions: the social sciences, arts and humanities all have an important role to play.
The purpose of Termite is to accelerate this kind of cross-disciplinary R&D through intensive, in-person programmes that investigate the risks and opportunities of near-future scenarios before they become reality.
At present, the challenge of aligning the behaviour of AI models with human values is largely treated as a problem for engineers to solve. But technical solutions are only as useful as the questions and assumptions that inform the process of reaching them. The embrace of philosophy and ethics at the frontier labs is a step towards this, but it is not sufficient.
As we move from a world in which AI is construed as a single, monolithic intelligence to one in which agents coordinate and communicate with one another, demonstrating emergent behaviours that are extremely difficult to anticipate, we face a dizzying number of uncertainties regarding how these systems will behave and what their behaviour will mean for human society.
What values should we optimise for? What social formations and hierarchies do these systems produce? How do they respond to economic incentives and resource constraints? How do they negotiate competing norms across varied contexts? How do different roles and personae interact?
And what does this mean for markets, political governance, culture and social life?
A wide range of expertise, both technical and non-technical, is required to ask these questions rigorously, develop answers to them and build corresponding solutions: the social sciences, arts and humanities all have an important role to play.
The purpose of Termite is to accelerate this kind of cross-disciplinary R&D through intensive, in-person programmes that investigate the risks and opportunities of near-future scenarios before they become reality.
Termite retweeted
Looks like a termite, chews like a termite, builds mounds like a termite @termiteworks
For 20+ years @ShaneLegg and I've discussed AGI’s potential impact on the economy, science & society. With the DeepMind Institute, we're expanding interdisciplinary research on key questions for the AI era. We hope it spurs the discussions needed to get the next steps right: deepmind.google/institute
Our friends at @movingcastles_ are doing amazing work in the persona research space















