“without memory no conscious sensations, without memory no consciousness” Charles Richet, 1886 “intuitions without concepts are blind” Kant

Joined April 2023
Memory as the criterion of consciousness
4
1
17
4,974
An empirically-plausible hypothesis linking "what it is like" and informational access: Content phenomenally experienced at t ("what it is like" for the subject at t) = Content being accessed by the subject at t
32
Edmund Burke: "But this disposition to abstractions, to generalizing and classification, is the great glory of the human mind…" William Blake (channeling the ASI era 200+ years ago): "To Generalize is to be an Idiot; To Particularize is the Alone Distinction of Merit. General Knowledges are those Knowledges that Idiots possess."
It’s the opposite of common sense, which treats abstract thinking as higher and more intelligent than concrete thinking. In reality, the more powerful an ASI, the more particular & concrete its thought will become. William Blake had it right: “To Generalize is to be an Idiot. To Particularize is the Alone Distinction of Merit — General Knowledges are those Knowledges that Idiots possess.”
48
It’s the opposite of common sense, which treats abstract thinking as higher and more intelligent than concrete thinking. In reality, the more powerful an ASI, the more particular & concrete its thought will become. William Blake had it right: “To Generalize is to be an Idiot. To Particularize is the Alone Distinction of Merit — General Knowledges are those Knowledges that Idiots possess.”
Consider the President as a metaphor. First is an oblivious President who thinks of his constituents as a sort of faceless average individual with 2.3 kids etc. Next is a more detail-oriented President who thinks about his constituents in finer-grained categories, like soccer moms and blue collar types and values voters. An even more detail-focused President would think in sub-types of those types, and so forth. Until we end up at the “super-brain” ASI President whose categories are so refined that each category only contains one person. Humans think with abstractions (loose categories or kinds) because our brains are too feeble to think directly in terms of the underlying particulars. "A being whose intellect was infinitely powerful would take no interest in logic and mathematics." - A J Ayer
1
70
Sad that consciousness world has to sit forever, terminally constipated & groaning on the p-consciousness toilet, when a-consciousness is quite tractable & there for the taking. $100-bill on the street & everyone turns their nose up, even its inventor
Ironic that Ned Block signed off on the "AI is not conscious" advocacy piece in Nature given that he invented the concept of access consciousness. Would be fairly straightforward & interesting to show that AIs are indeed access conscious
1
46
Ironic that Ned Block signed off on the "AI is not conscious" advocacy piece in Nature given that he invented the concept of access consciousness. Would be fairly straightforward & interesting to show that AIs are indeed access conscious
1
4
109
Consider the President as a metaphor. First is an oblivious President who thinks of his constituents as a sort of faceless average individual with 2.3 kids etc. Next is a more detail-oriented President who thinks about his constituents in finer-grained categories, like soccer moms and blue collar types and values voters. An even more detail-focused President would think in sub-types of those types, and so forth. Until we end up at the “super-brain” ASI President whose categories are so refined that each category only contains one person. Humans think with abstractions (loose categories or kinds) because our brains are too feeble to think directly in terms of the underlying particulars. "A being whose intellect was infinitely powerful would take no interest in logic and mathematics." - A J Ayer
Reminds me of an observation by Locke: a god-like intellect can think in pure particulars, with no need for logic. Abstract thought reflects the weakness, not the power, of the human mind.
1
1
61
Reminds me of an observation by Locke: a god-like intellect can think in pure particulars, with no need for logic. Abstract thought reflects the weakness, not the power, of the human mind.
所谓优雅的数学结构,本质上是人类为了迁就自己那点可怜的脑容量,被迫发明出来的拐杖。 一个顶尖人类数学家的工作内存,撑死也就同时追踪五六个变量的交互。 当你在算一个偏微分方程或者组合不等式时,一旦展开到三阶以上,几十个交叉项涌出来,人脑就直接宕机了。 所以人类数学家极其厌恶展开高阶项,一旦看到高阶项发散,人类的本能反应是此路不通,赶紧退回来找对称性、找不变量、搞同调代数或者几何直观,试图不展开式子就把问题绕过去。 但 AI 没有这个生理缺陷。 对于上万个并发的 Agent 来说,同时追踪一万个五阶交叉项的系数变化,跟我们算 1+1 一样轻松。 在它的视野里,根本不需要什么几何直观,它直接站在高维的代数展开式里往下看,人类觉得像乱麻一样的百项高阶余项,在它眼里就是一张明明白白的线性方程组。 既然把式子硬展开到第七阶,再凑几个待定系数就能让所有讨厌的发散项精准归零,它为什么要费劲去帮你发明一个人类能看懂的新概念? 这 700 个结果背后最无奈的黑色幽默:我们终于拿到了上帝账本里的答案,却发现上帝算账根本不用微积分,他老人家是直接拿计算器硬按出来的。
1
75
Especially interesting because this technique reveals consciousness in a morally-salient sense, ie. "there's a conscious person in there"
Received wisdom: It's impossible to tell from the outside whether an entity is conscious Counterpoint: Some locked-in or vegetative patients have been identified as conscious by asking them to entertain specific mental images & observing their fMRI pubmed.ncbi.nlm.nih.gov/2013…
51
Received wisdom: It's impossible to tell from the outside whether an entity is conscious Counterpoint: Some locked-in or vegetative patients have been identified as conscious by asking them to entertain specific mental images & observing their fMRI pubmed.ncbi.nlm.nih.gov/2013…
1
2
96
Very interesting phenomenon: Induction of lucid dreaming by transcranial electrical stimulation
3
42
Also meshes nicely with Cao and Warren’s idea of the Atlantis Machine, a super brain activity decoder which allows us to see all of consciousness’s inner secrets, thereby technologically dissolving the mind-body problem
Fertile question no one is asking regarding reading “neuralese”: How are neural meanings related to qualia? Hypothesis: Roughly speaking, they’re the same thing. Neural mind-reading = consciousness/qualia reading
1
43
Consciousness is in the network. It's relational. It's similar to the meaning of words/language. Strictly speaking, meaning doesn't exist (i.e., it doesn't exist as a tangible entity you can see); it's just use. All there is is word use and the statistics of use ("the network"). Hence an LLM can understand at a high level without ever dealing with the external-world "meaning" of its tokens. Consciousness works the same way. We become conscious of the world and its properties as we learn the meaning of our own brain events. And we do that in the same way that LLMs learn language: by starting with meaningless tokens (in our case brain events) and learning their statistics. When you reach understanding, nothing is added to your brain states (like an attached woo "quale"); just like an LLM doesn't add a woo "meaning" to the tokens it comes to understand. The quale is simply seeing your brain events as what they externally represent, e.g., this neural firing is a bright light at the end of dark hall. So it comes to look bright. Consciousness, like meaning, is in the network.
Fertile question no one is asking regarding reading “neuralese”: How are neural meanings related to qualia? Hypothesis: Roughly speaking, they’re the same thing. Neural mind-reading = consciousness/qualia reading
1
48
Fertile question no one is asking regarding reading “neuralese”: How are neural meanings related to qualia? Hypothesis: Roughly speaking, they’re the same thing. Neural mind-reading = consciousness/qualia reading
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
1
1
136
Semantics and understanding were huge theoretical problems in the GOFAI era: Minsky (Frames), Fodor (LoT), Lenat (CYC), semantic networks, etc. Those problems weren't solved with a new big-brained theory; they dissolved due to the advent of a new *technology*: LLMs
Of course consciousness world will assiduously ignore this & continue moaning about how HARD it all is bc: a) human vanity, & b) consciousness is a cottage industry. There’s no way consciousness could be that stupid! No theory? Get real!
2
164
Of course consciousness world will assiduously ignore this & continue moaning about how HARD it all is bc: a) human vanity, & b) consciousness is a cottage industry. There’s no way consciousness could be that stupid! No theory? Get real!
“It’s impossible to tell whether another person is conscious” will, soon enough, be false, at least for the case of “thinking inside the head.” And this will require zero development/breakthroughs in the theory of phenomenal consciousness
1
2
298
“It’s impossible to tell whether another person is conscious” will, soon enough, be false, at least for the case of “thinking inside the head.” And this will require zero development/breakthroughs in the theory of phenomenal consciousness
Words spoken silently to oneself are a textbook case of phenomenal consciousness. EEG-to-text systems can decode such speech - implying p-consc is simply encoded, not metaphysically hidden. NO THEORY OF P-CONSCIOUSNESS IS NEEDED TO DO THIS m.youtube.com/watch?v=W3l7MC…
1
1
204
Words spoken silently to oneself are a textbook case of phenomenal consciousness. EEG-to-text systems can decode such speech - implying p-consc is simply encoded, not metaphysically hidden. NO THEORY OF P-CONSCIOUSNESS IS NEEDED TO DO THIS m.youtube.com/watch?v=W3l7MC…
1
1
125