Pinned Tweet
I am deeply excited to share that I will be joining @AsteraInstitute to start a new effort to understand how the brain generates consciousness and intelligence.
We’re launching Astera Neuro, a new neuroscience research effort led by @doristsao as Chief Scientist. Our aim is to unravel a profound scientific mystery: how the brain transforms sensory inputs into conscious experience.
Advancing this work could illuminate the computational principles that drive perception and cognition and inspire approaches for neuroscience-informed AI research, potentially generating new pathways to AGI.
Astera will support this work with $600M+ over the next decade. Read more: astera.org/neuroscientist-do…
FYI, for those wondering: we are working on organizing everything, and will be releasing data and code for our paper on Monday 10/26/26.
Doris Tsao retweeted
Replying to @ItzhakFried
Thank you, Itzhak, for this thoughtful response! I agree with you that the neural structure of consciousness involves more than the few nodes we recorded from. Indeed, it pains me to see all of twitter attributing to me the simplistic idea that consciousness has a frame rate, when in fact I believe that the core question we need to answer to understand consciousness is the perception of persistence. And if consciousness did have a frame rate, which I am skeptical of, this would be even more the core question. My hunch is that the key computations for persistence actually occur in posterior parietal cortex, where the brain is representing persistent pieces of physical matter multi-modally. So yes, even I can see there is more to heaven and earth...
Re the specific refs you cite: I just read both of them again. Both are super interesting (esp this super early response in mPFC preceding spontaneous alternations!), and it would be great to re-analyze the data to see how it compares to our findings (though likely what we really need is new high channel count human recordings during rivalry). I think the example unit you show in figure 2 of Gelbard-Sagiv does show weaker modulation to rivalry than perception, no?
Re Kreiman 2002: responses were analyzed starting at 100 ms after flash. We found that at this latency in monkey IT the transient associated with the flash was still ongoing, which would lead to artificially elevated perceptual modulation, so we analyzed starting at 300 ms, after the transient was over. Nevertheless, I do think it is compelling that not one MTL neuron showed a significant response to the suppressed stimulus.
But more broadly, do you think finding a pure representation of consciousness at the level of a concept cell would vindicate the quest for spatial localization of consciousness? I think the concept cells simply don't have the resolution to represent our qualia of an object (nor do IT cells on their own, for that matter...I think the whole quest was doomed, even independent of our new paper).
Thank you, Brendon! This is amazing 🥹. I just showed it to my son who is in 4th grade.
1/ We discovered something totally unexpected about the neural structure of consciousness that overturns decades of thinking on its biological basis and brings us significantly closer to the recipe for generating conscious awareness.
New preprint: biorxiv.org/content/10.64898… (led by @HesseJanis, with @FrankLanfranchi, @_conor_mcgrory, @Yuelin_Shi, and @EngelTatiana)
12/ What is most exciting is that we have uncovered a signal deep in the brain that richly represents a stimulus you’re not aware of. This finding, in my opinion, makes it tractable to understand how a pattern of neural activity accesses consciousness. The previous dominant idea--that suppressed stimuli become progressively weaker as you go anterior (“fail to ignite”)--left the question of how a representation becomes consciously accessible extremely hard to pin down. Whereas now, with whoppingly clear signals corresponding to both what is and isn’t conscious, we can follow both sets of footprints, to track down the full machinery for generating conscious percepts.
Please see this the follow-up post for important clarifications:
xitter.cf/doristsao/status/21118…
The outpouring of interest in our paper has been … a bit insane.
May I make four points?
1. We have not shown that “consciousness has a frame rate.”
I can see why people draw this conclusion: we report that inferotemporal and prefrontal cortex alternate between conscious and suppressed states roughly every 60 ms during binocular rivalry.
Consciousness depends on many brain areas, and our paper reports results from only a few select nodes.
We still don’t know how conscious access works--the actual recipe for generating conscious experience. What we have shown is that deep in the brain there is an extremely strong signal, rich enough to reconstruct a high-dimensional face in detail, that is inaccessible to consciousness. As I argued in the original tweet, this makes the problem of conscious access a lot more experimentally tractable. But to claim “consciousness has a frame rate,” one would need to have actually solved the mechanism for conscious access and shown that this mechanism operates at a frame rate.
While we currently don’t know conclusively one way or the other (see VanRullen & Koch, 2003 for a review of positive evidence), I personally am skeptical that consciousness has a frame rate. I believe the brain, within posterior parietal cortex, has continuous tracking mechanisms that actively represent the persistence of matter, including ourselves as physical bodies. The coupling between these persistent tracking processes and feature representations across the brain (like those in face patches) is, I think, the essential mechanism of conscious access.
This coupling need not happen at the rate of inferotemporal alternations (and inferotemporal cortex itself may not even alternate outside of the artificial situation of binocular rivalry). As an analogy: imagine the area crucial for conscious access holding a steady drone note, while inferotemporal cortex alternates between two notes, one in harmony and one dissonant. Inferotemporal content might couple to the drone only at moments of harmony, yet experience would still be continuous, because the drone itself (the tracking process that I believe is at the core of conscious perception) never stops. And areas without conflicting content, like auditory cortex during visual rivalry, could stay in continuous harmony with the drone.
In sum, there is no reason to conclude from our study that consciousness is discrete, with a "frame rate."
2. Our results resemble Jezek et al. 2011 (as @jjsakon notes).
Jezek et al. trained rats in two boxes that were identical except for their lighting cues, so that hippocampal place cells formed two distinct maps, one per box. They then “teleported” the rat by abruptly switching the lights. For a few seconds afterwards, CA3 place-cell activity flickered between the two maps, synced to the theta cycle (~125 ms).
@StanDehaene first pointed this paper out to me, and reading it blew me away. To my mind it is the strongest evidence for a bistable attractor in the brain, because the competing maps are stored within the hippocampus itself.
I think the phenomenon we see may be very similar at the circuit level: a bistable attractor network within inferotemporal cortex that alternately converges to one of two patterns, as cells in face patches work together to build a coherent representation of the input. In our case, both images are present in the input, so the competition could arise within IT or be inherited from earlier areas such as V1--recording there is an important next step. (It also still puzzles me that we didn’t see strong coherence between face patches ML and AM.)
More broadly, what’s different about our paper is the brain area (inferotemporal cortex, often modeled as a feedforward DNN) and the ability to relate the two competing patterns to consciousness, with one granted conscious access and the other not.
3. Please comment on bioRxiv!
The Twitter attention has been cool, but I really hope colleagues will be generous enough to post detailed commentary on bioRxiv, where there are currently 0 comments. As @seemaychou points out, peer review doesn’t have to come from just three anonymous reviewers. We would be truly grateful for your critical feedback.
4. Stay tuned
This work was done at Caltech, Berkeley, in collaboration with @EngelTatiana at Princeton, funded by NIH and HHMI.
I hope to share our vision soon for how we can solve consciousness @AsteraInstitute
The outpouring of interest in our paper has been … a bit insane.
May I make four points?
1. We have not shown that “consciousness has a frame rate.”
I can see why people draw this conclusion: we report that inferotemporal and prefrontal cortex alternate between conscious and suppressed states roughly every 60 ms during binocular rivalry.
Consciousness depends on many brain areas, and our paper reports results from only a few select nodes.
We still don’t know how conscious access works--the actual recipe for generating conscious experience. What we have shown is that deep in the brain there is an extremely strong signal, rich enough to reconstruct a high-dimensional face in detail, that is inaccessible to consciousness. As I argued in the original tweet, this makes the problem of conscious access a lot more experimentally tractable. But to claim “consciousness has a frame rate,” one would need to have actually solved the mechanism for conscious access and shown that this mechanism operates at a frame rate.
While we currently don’t know conclusively one way or the other (see VanRullen & Koch, 2003 for a review of positive evidence), I personally am skeptical that consciousness has a frame rate. I believe the brain, within posterior parietal cortex, has continuous tracking mechanisms that actively represent the persistence of matter, including ourselves as physical bodies. The coupling between these persistent tracking processes and feature representations across the brain (like those in face patches) is, I think, the essential mechanism of conscious access.
This coupling need not happen at the rate of inferotemporal alternations (and inferotemporal cortex itself may not even alternate outside of the artificial situation of binocular rivalry). As an analogy: imagine the area crucial for conscious access holding a steady drone note, while inferotemporal cortex alternates between two notes, one in harmony and one dissonant. Inferotemporal content might couple to the drone only at moments of harmony, yet experience would still be continuous, because the drone itself (the tracking process that I believe is at the core of conscious perception) never stops. And areas without conflicting content, like auditory cortex during visual rivalry, could stay in continuous harmony with the drone.
In sum, there is no reason to conclude from our study that consciousness is discrete, with a "frame rate."
2. Our results resemble Jezek et al. 2011 (as @jjsakon notes).
Jezek et al. trained rats in two boxes that were identical except for their lighting cues, so that hippocampal place cells formed two distinct maps, one per box. They then “teleported” the rat by abruptly switching the lights. For a few seconds afterwards, CA3 place-cell activity flickered between the two maps, synced to the theta cycle (~125 ms).
@StanDehaene first pointed this paper out to me, and reading it blew me away. To my mind it is the strongest evidence for a bistable attractor in the brain, because the competing maps are stored within the hippocampus itself.
I think the phenomenon we see may be very similar at the circuit level: a bistable attractor network within inferotemporal cortex that alternately converges to one of two patterns, as cells in face patches work together to build a coherent representation of the input. In our case, both images are present in the input, so the competition could arise within IT or be inherited from earlier areas such as V1--recording there is an important next step. (It also still puzzles me that we didn’t see strong coherence between face patches ML and AM.)
More broadly, what’s different about our paper is the brain area (inferotemporal cortex, often modeled as a feedforward DNN) and the ability to relate the two competing patterns to consciousness, with one granted conscious access and the other not.
3. Please comment on bioRxiv!
The Twitter attention has been cool, but I really hope colleagues will be generous enough to post detailed commentary on bioRxiv, where there are currently 0 comments. As @seemaychou points out, peer review doesn’t have to come from just three anonymous reviewers. We would be truly grateful for your critical feedback.
4. Stay tuned
This work was done at Caltech, Berkeley, in collaboration with @EngelTatiana at Princeton, funded by NIH and HHMI.
I hope to share our vision soon for how we can solve consciousness @AsteraInstitute
1/ We discovered something totally unexpected about the neural structure of consciousness that overturns decades of thinking on its biological basis and brings us significantly closer to the recipe for generating conscious awareness.
New preprint: biorxiv.org/content/10.64898… (led by @HesseJanis, with @FrankLanfranchi, @_conor_mcgrory, @Yuelin_Shi, and @EngelTatiana)
Peer experts: we would be extremely grateful for your timely feedback (e.g., through the bioRxiv comment function). As you can see, the interest is immense, and we will be building on this work at Astera. If you see a critical shortcoming, we want to know asap.
To be clear, since this has sparked a number of threads in my feed and DMs, this work pre-dated @doristsao joining us at @AsteraInstitute with many academics involved. So it will follow its own course with or without journals -- up to the authors involved.
But I invite any and all scientists to offer technical input in public NOW since this is garnering a lot of attention. It need not wait 6-12 months for a journal process. And it obviously is part of the scientific corpus that will influence not only our ongoing work at Astera, but also the field in general. So now would be the time to weigh in since research doesn't stop, especially given the importance and incredibly multi-disciplinary nature of the work.
Given that the team is building upon this work, technical input will be a useful but singular dimension of its rigor. Whether the work can be replicated or built upon will be (and IMO should always be) the bar for any programmatic effort that gets expanded at Astera. And that type of empirical evaluation is already in motion. Any of that work funded by @AsteraInstitute will be released without delay or paywalls.
Doris Tsao retweeted
Very excited to share the most important discovery of my career yet: your brain switches between a conscious and an unconscious mode ~15 times every second. Consciousness may depend not on where in the brain activity occurs but when.
Find out more below.
bit.ly/3WvA6di
1/ We discovered something totally unexpected about the neural structure of consciousness that overturns decades of thinking on its biological basis and brings us significantly closer to the recipe for generating conscious awareness.
New preprint: biorxiv.org/content/10.64898… (led by @HesseJanis, with @FrankLanfranchi, @_conor_mcgrory, @Yuelin_Shi, and @EngelTatiana)
Congratulations @KarlDeisseroth!!! I think all of us in systems neuro have been rooting for you to get this call for a long time coming (the one and only time my lab ever had a jclub on a Saturday was to catch up with all the jaw-dropping papers coming out of your lab).
You revolutionized our field, making it possible to probe this tangle of cells that is us in an entirely new way. I believe the most profound consequences of what you unlocked have yet to be written.
Congratulations to our first #NobelPrize laureate of 2026 🎉
Early this morning Karl Deisseroth found out he was awarded this year's Nobel Prize in Physiology or Medicine.
He seems very happy with the news!







