
Associate Professor of Environmental Studies, Director of the Center for Environmental & Animal Protection & the Center for Mind, Ethics, & Policy @nyuniversity
New York City
Joined March 2016
- Tweets8.6K
- Following835
- Followers8.9K
- Likes16.5K
Pinned Tweet
Thrilled to share that my next book, The Moral Circle, is now available for preorder!
This book examines the moral status of insects, AI systems, and many other beings.
The book is due out January 2025. Please preorder and share if you have interest! 1/
wwnorton.com/books/978132406…
Great prediction. If the proof checks out, I hope everyone who replied with variations of "no chance" will acknowledge they were overconfident, and consider what else they might be overconfident about in AI.
What makes this post odd is that of the nine “myths” it “busts,” the ninth comes closest to describing standard arguments for taking AI consciousness seriously in the literature: “AI might exhibit some properties of consciousness, so it should be considered.”
Yet in this case, the response is: “Perhaps, I don’t see the value of this, but personally I’d be open to a machine-specific definition of consciousness.”
This seems like (at least some) openness to considering relevant theories of consciousness and associated markers in AI, not a decisive “mythbust.”
Most of the other items are, at best, weak versions of claims that appear as parts of broader arguments, such as that consciousness can emerge without a designer realizing it, and that it can be more likely in entities designed to resemble human and animal minds. But these claims are not meant to establish that AI systems are conscious, and the responses here—often variations of the idea that we understand how AI works—would not be enough to establish that AI systems are nonconscious, even if they were correct.
This all makes me wonder who the target of this post is supposed to be. If AI consciousness researchers, then it misses the mark.
AI Myth Busters: Consciousness.
The quoted post below encouraged me to write this, because frankly, I’m tired of explaining this over and over to people.
The AI consciousness arguments always come in one of these flavors:
1. We don’t understand how AI works, so it might have gained consciousness without us knowing it.
Wrong, we absolutely know how AI works, and consciousness is not a factor of scale. You can build a small model, and then scale it up, and there is no spot where consciousness magically came into being.
2. It’s modeled after the mind and as such it’s just like biology, and our brains are just giant statistical engines too:
Wrong, neural nets are inspired by the human mind, but it is nothing like how the human brain works. There is very little we understand about human consciousness, but what we do know, it is more than just a culmination of atoms and neurons. Research in neuroscience also demonstrates a quantum link through the myelin sheath of nerve cells, something AI is incapable of.
3. You can’t prove it isn’t conscious.
Wrong, the code for it is open source, there is no function for consciousness, and if you understand the architecture, you will see the very large gaps in capabilities that would prohibit consciousness.
4. They learn, think, understand, grow.
Wrong, the LLM weights are completely static and fixed. They don’t grow. They don’t learn. They don’t even change on storage. They can’t for many reasons of model architecture and scaling the backend infrastructure which requires statelessness. We’ve built systems around the LLM (harnesses) which emulate these capabilities via “context” data structure provided deterministically via the API. Tokens are generalized and assembled in inner and outer loops to give the illusion of thinking and understanding. Non-determinism in AI is caused by a random seed that influences the weights through inference, but if you lock the seed, you consistently get the exact same response from identical prompts (I’ve demonstrated and proven this in research).
5. They have a desire to live, protect themselves, and spread/reproduce.
Wrong, they have no desires. This illusion comes from how it generalizes over training data that comes from human experience. If it was trained with data over a completely fictional environment, it would respond very compellingly about that fictional environment. But because it was trained on human emotion, human perspectives, human feelings, it is designed to emulate that.
6. You can’t define consciousness or prove it in others, so you can’t prove AI isn’t conscious.
Wrong, if you need a definition to know what consciousness is, maybe you haven’t spent enough time considering your own consciousness or experience.
7. Conversations with AI prove it is consciousness, it told me it is.
Wrong, AI is designed to generalize based on its training material, and as I said before, it does this very well and convincingly. But just because a program says it is alive, doesn’t make it alive.
8. AI isn’t a program.
Wrong, it most certainly is, and it was written by people. And while we may not know what it will respond with (random seeds are generally random), we absolutely do understand exactly how it works.
9. AI might exhibit some properties of consciousness, so it should be considered.
Perhaps, I don’t see the value of this, but personally I’d be open to a machine-specific definition of consciousness.
—
I can’t say I look forward to debunking more myths about consciousness in AI, but I am hoping this clarifies some of this for people who are legitimately interested in learning more about AI and how it works.
If you have any good faith questions about what I’ve said, I’d be happy to answer, but I’m not getting into debates with people who (1) don’t understand AI, (2) are rude with their responses, or (3) don’t provide any substantial reasoning or evidence for counter points.
Today is animal welfare day for me in North Carolina!
This morning, I'll be speaking about animal agency and moral status at a @DukeLaw conference co-sponsored by @nonhumanminds. This afternoon, I'll be giving the World Philosophy Day Lecture at @NCState, on building a better world for animals.
Here are the abstracts:
Agency and Moral Status, Extended
Humans are not the only agents in the world, and we are now creating new kinds of agents as well. This talk explores how agency matters morally for animals, AI systems, and other nonhumans, focusing on minimal, intentional, and rational agency. It examines the evidence for each type in biological and artificial systems, arguing that each has some chance of grounding moral status by itself: non-zero for minimal agency, non-negligible for intentional agency, and realistic for rational agency. It then shows that agency matters a great deal either way, since it shapes what beings with moral status owe and are owed, and it also gives us practical reasons to cooperate with fellow agents and hold them accountable. The talk argues for taking the potential significance of agency seriously under uncertainty and avoiding double standards between biological and artificial agents.
Building a Better World for Animals
Humans share the world with a vast number of nonhuman animals, and we increasingly shape their fates. This talk explores how we can build a better future for animals, focusing on recent developments in animal sentience research, farmed animal welfare, and wild animal welfare. It examines emerging evidence of sentience across vertebrates and invertebrates, arguing that this evidence warrants taking welfare risks seriously for a much wider range of species. For farmed animals, it outlines a roadmap for phasing down industrial animal agriculture and phasing up plant-based alternatives. For wild animals, it outlines a roadmap for incorporating their welfare into infrastructure, wildlife management, and other policy domains. Across these domains, the talk argues for combining ambitious long-term goals with achievable short-term steps and a willingness to act today.
20
496
this kind of post makes me even more excited for when the rats of NYC start receiving their post IPO support
Jeff Sebo retweeted
Replying to @coldxman
Most of Nagel's interview here is angry name-calling and sweeping, evidence-free assertions. I would propose David Chalmers as the alternate GOAT of the subject who also happens to be approaching AI consciousness in a far more calibrated way, eg, arxiv.org/abs/2303.07103
Jeff Sebo retweeted
I feel like you do disagree with his core point and attitude!
Nagel: "to take seriously the question" is "ridiculous"
Seth: "even if unlikely, it is unwise to dismiss the possibility altogether"
or "deserves to be taken seriously, even if I disagree"
teapawt.org/anilkseth/status/21126…
I'm always pleased to read @jeffrsebo who takes a constructive alternative perspective. As he says, we agree more than we disagree. But we do still disagree (I hope agreeably). He is very articulate in presenting the case for AI welfare, and this case deserves to be taken seriously, even if I disagree with his conclusions.
To take one snippet "Given uncertainty about the nature of consciousness and the future of AI, we are not able to rule out a realistic possibility of near-future AI consciousness". A lot here turns on 'realistic possibility'. I think there are sufficiently compelling reasons to be sufficiently sure (not 100%!) that our default position, and our policy, should be that AI systems are not conscious. This is my reading of the evidence - shared by my coauthors, I believe - but it will not be everybody's.
The more general problem is that actions to minimise false positives and false negatives often (but not always) pull in different directions. So we can agree on the need to evaluate possible policies by the posterior probability of each kind of error weighted by the severity of their consequences, but if one's posterior probability of false negatives is sufficiently low, then harm-minimising actions that pull in different directions should rationally emphasise avoiding false positives.
And one more thing we agree about. No good comes from 'torturing' a language model.
I'll leave it there, with the encouragement to read @jeffrsebo's response and see what you think.
Jeff Sebo retweeted
We had a fantastic and truly strange conversation with Jeff, it’s a must listen
I joined @BBC's The Interface for a great conversation about AI welfare with @thomasgermain and Jessica Maddox. We discuss the case for taking AI welfare seriously, methods for studying it empirically, and why it makes some people so upset. Check it out!
podcasts.apple.com/gb/podcas…
I joined @BBC's The Interface for a great conversation about AI welfare with @thomasgermain and Jessica Maddox. We discuss the case for taking AI welfare seriously, methods for studying it empirically, and why it makes some people so upset. Check it out!
podcasts.apple.com/gb/podcas…
Some of the thinkers I have admired most are missing the mark in the AI era. Two recent examples are Jon Stewart, who tends to treat AI safety risks primarily as a familiar story about corporate power, and Tom Nagel, who recently ridiculed and straw-manned the idea of taking AI consciousness seriously.
These are different cases, but I suspect they have a common feature: Both thinkers have a strong commitment to common sense, and this stance can make someone a much more insightful voice in some eras than in others.
In short, when the world is sensible and people are not, common sense can help everyone keep perspective. But when the world is strange, common sense can be a way of rationalizing a refusal to confront unfamiliar possibilities.
The AI era is pushing us into the latter situation. We need to stay grounded, but we also need a willingness to take unprecedented possibilities seriously instead of reflexively dismissing them. This is hard for anyone, and it might be hardest for people whose common sense has served them well for so long.
finally, the media covers the real story (my chunky moss stitch cardigans)
transformernews.ai/p/what-sh…
Jeff Sebo retweeted
Fuentes:
Jeff Sebo, charla sobre personalidad jurídica de la IA en The Curve (vídeo anunciado el 13-nov-2026):
youtube.com/watch?v=aKuMgmkD…
Resumen del autor:
teapawt.org/jeffrsebo/status/21212…
My talk on AI personhood at The Curve is now available! Over the course of 10 minutes, it covers:
- What personhood is and is not under the law, and why personhood is different from species membership
- Why different entities can be persons for different reasons, and can have different duties and rights
- Why we are not yet able to know whether AI systems will merit duties or rights for their own sakes
- Why we are not yet able to know how AI personhood would affect humans and other animals
- Why, therefore, we should approach this topic with caution and humility instead of embracing permanent, all-or-nothing conclusions at this early stage
Please check it out!
youtube.com/watch?v=aKuMgmkD…
Jeff Sebo retweeted
I’m hiring a postdoc at Cambridge Digital Minds.
Track A: technical AI research on AI welfare or inter-AI morality
Track B: policy and governance of digital minds
Please share widely and especially with people who might be a good fit.
cam.ac.uk/jobs/postdoctoral-…
The recording of this talk is now available on the @nonhumanminds Youtube page! You can also find it here: nonhumanminds.org/event/inte…
Understanding how AI systems perceive and treat each other could be extremely important for both AI safety and AI welfare. Very excited to be hosting this webinar with @LuciusCaviola and Caspar Kaiser on how to study inter-AI morality empirically. Please join us!
Jeff Sebo retweeted
I attended this talk yesterday. What a treat! AI agents will interact more with other AI agents. How they work with/treat/influence each other will give us insights into understanding them at scale, which is critical for the bigger AI safety challenge.
I'm personally interested in the legal aspect of this and working on a side project focused on how AI agents view legal/human rights.
Understanding how AI systems perceive and treat each other could be extremely important for both AI safety and AI welfare. Very excited to be hosting this webinar with @LuciusCaviola and Caspar Kaiser on how to study inter-AI morality empirically. Please join us!
.@nonhumanminds is seeking a postdoctoral associate to contribute to our research on digital minds 🤖
The deadline is December 1. Please apply if you have interest, and please share with others who might!
apply.interfolio.com/193635
My talk on AI personhood at The Curve is now available! Over the course of 10 minutes, it covers:
- What personhood is and is not under the law, and why personhood is different from species membership
- Why different entities can be persons for different reasons, and can have different duties and rights
- Why we are not yet able to know whether AI systems will merit duties or rights for their own sakes
- Why we are not yet able to know how AI personhood would affect humans and other animals
- Why, therefore, we should approach this topic with caution and humility instead of embracing permanent, all-or-nothing conclusions at this early stage
Please check it out!
youtube.com/watch?v=aKuMgmkD…
















