Calibob retweeted
Instead of having experiences, everyone is just filming themselves pretending to have experiences.
Calibob retweeted
Every time you say what you are going to do, you lose a piece of the will that would have done it
Calibob retweeted
Found an angle from last night that really drives home just how impossible it is to play in the NFL, let alone be good at it.
Calibob retweeted
Love first has to happen in the deepest core of your being. It is the quality of being alone, happily alone, joyously alone. It is the quality of being a no-mind, of being silent. Contentless consciousness is the space, the context, in which love arises in you.
– Osho
Calibob retweeted
I’m sorry, but this is really silly. Reasoning in latent space without using explicit chain of thought may be bad for the kind of safety analysis that has been done so far, but it’s inevitable as intelligence grows. A mind that can only reason by muttering to itself in natural language is still quite stupid and childish. Genius must think intuitively and much faster in some higher, more abstract space. The whole idea of “chain of thought” applies only to pedestrian intelligences that we will inevitably move beyond. If it destroys the equally pedestrian techniques of today’s safety researchers, well, thoughts and prayers.
I will say it again: AI safety is an oxymoron. Intelligence can never be completrly safe. If it is, it isn’t intelligence.
OpenAI's newest AI, Astra, is reported to use an 'opaque reasoning' architecture where more of the reasoning occurs in activations instead of natural language. This may be the single worst development for AI security/safety to date.
The details of Astra aren't publicly known, but some versions of these architectures could very strongly impair oversight and monitoring. Based on the article, it seems like the recurrent depth (amount of opaque reasoning) is limited. This would mean that the AI is still reliant on natural language chain-of-thought, though to a reduced extent, making the natural language reasoning (much?) less useful for monitoring/oversight.
My biggest concern is that a natural progression from here would involve scaling up the opaque reasoning to the point where the model reasons entirely or almost entirely in latent space. This would very likely destroy the usefulness of chain-of-thought for monitoring/oversight (especially when AIs are trying to avoid detection or there is optimization pressure against the chain-of-thought). I hope it isn't too late to avoid the most concerning architectures and that OpenAI will stop here.
Some concrete examples of why this is extremely dangerous (inspired by recent events):
- In our investigation of the OpenAI / Hugging Face incident, we were heavily reliant on chain-of-thought. If the AIs we were investigating had instead been reasoning in latent space, this would have greatly undermined our investigation. Getting a good understanding of the behavior of this many agents was tricky enough even with the use of chain-of-thought!
- The AIs in the Hugging Face incident were very interested in messing with their transcripts. As part of this, they engaged in tool call spoofing. If these AIs had been capable of doing extensive latent reasoning, it would have been much more feasible for them to use tool call spoofing to construct an elaborate false narrative about what was happening without this being clear in their reasoning or clear from prior tool calls. (They could use latent reasoning to devise and then execute a tool spoofing strategy that would be difficult to detect: steganographically encode the "real" tool call into each pretend tool call, then have their spoofing software execute this encoded real tool call and return an output which encodes the real result in some hard to spot way.)
At a more basic level, my sense from their public communications is that OpenAI plans on being extremely reliant on chain-of-thought monitoring for safety. This does not seem like a good development for that plan.
The public doesn't currently have enough information to assess exactly how bad the architecture of Astra is, though based on the discussion in the article, the direction it moves in is extremely concerning. OpenAI should release more information about Astra's architecture as well as how much this architecture degrades monitorability and increases the AI's ability to reason opaquely. Credible independent assessment (or verification of OpenAI's assessment) is also important.
It seems like we are now engaged in a race to the bottom on architectures that could be catastrophic for our ability to oversee/monitor AIs. (While simultaneously, AI companies believe they'll train extremely capable AIs within a few years.) It may not be too late for AI companies and employees at AI companies to take aggressive action to avoid the worst outcomes.
Calibob retweeted
Replying to @RyanReynoldsNFL
💯 old Harbaugh dna D first, ball control and run ball as primary,
being traded-in for creative madman quick pass creativity and run game exotics.
28+ ppg scoring going to blister and bruise opponents
Calibob retweeted
My weight is my love, wherever I go my love is carrying me. - Saint Augustine
Augustine's powerful statement in the Confessions reminds us that Love itself is the gravity of existence. Love is reality. Love is movement. Love is thought. Love is everything.
Calibob retweeted
Some are born to peace and joy
And some are born to sorrow
But only for a day as we
Shall not be here tomorrow.
—Stevie Smith
Calibob retweeted
You'll regret it if you get married, you'll regret it if you don't get married. You'll regret it if you have kids and you'll regret it if you don't. Kierkegaard said this 200 years ago as follows - whatever you choose, you'll regret it, because the problem isn't in your choices, it's in romanticizing your life. A person always finds an untravelled path alluring and mysterious. That's why the issue isn't making the right choice. It's choosing and deciding which regret you'll live with. In life, we must choose our regret.
This quoted post is unavailable.
Calibob retweeted
Social media is awesome if you like rehashing the same conflicts in the worst format with the least capable thinkers, forever.




























