Strategy | innovation | knowledge creation in science, engineering, and technology | organization | cognitive science | AI

San Francisco
Joined July 2011
Let me try and articulate what is see is a genuine tension between Bayesian subjective credences across theories of the world and what constitutes a probability calculus within a possible world bundle.
1
1
4
834
A piece of advice Hubert Dreyfus gave the grad class: “The important thing is to ask a sincere question. Otherwise, you won’t know when you’ve got your answer.”
1
3
10
369
Brian Gordon retweeted
What people call intelligence can be seen as two distinct things 1. how much scale you have 2. how much ability to scale you have Most peole think of intelligence in terms of (1). Someone like Francois Chollet thinks of intelligence mostly in terms of (2) The models are weakly good at (2) on their own but not there yet. Labs themselves (and the entire ecosystem that feeds them scaling inputs) remain critical for (2), where the input and output is a thing called “Claude” or “GPT” Many are implicitly building for a world where (2) doesn’t itself have scaling laws leading to automation, where models remain relatively static objects only capable of a bit of extra test time logical depth. Status quo bias and cope imo The Models Will Eat Their Harnesses
2
4
24
1,753
Brian Gordon retweeted
me: kinda fucked up how many people are offloading their whole lives to muse or instinct or grokbot or whatever claude: yeah
96
366
20
12,643
280,648
Brian Gordon retweeted
How does this nonsense make it into the paper of record?
127
153
61
3,415
334,226
Without being a lawyer or knowing anything specifically relevant to the S-1, I would still suggest that it’s naive to think law just applies as opposed to evolving to meet the changing technological landscape. Reading Mary Parker Follett and Demsetz would strongly suggest this.
Replying to @matthewstoller
The most important risk factor for Anthropic is the rule of law actually being applied. "Any determination that we are liable under such theories, or any judicial or regulatory expansion of tort, product liability, or consumer protection law, or criminal liability, as applied to AI models, could result in significant liability and require us to change how we design and offer our models, platform, and applications."
98
Brian Gordon retweeted
Kevin: I’m struggling with ongoing claims about independent AI discovery. This looks more like AI free riding (intentionally or not) on human lines of attack: Navier–Stokes, now Yang–Mills. Worth checking what folks working on these problems say, e.g. xitter.cf/__alpoge__/status/2114…
I cannot express how crazy these three results are. Not only are they so famous in math, computer science, and physics that even I am aware of them, but at least one of the results goes in the opposite direction of what we all assumed would be true...
3
2
15
9,205
There is no mass culture, no common ground anymore, is there?
Overheard in NY just now: Man at the next table: "Wait, you don't know what Sesame Street is?" Woman: hems and haws Man: "you actually thought it was like Jane Street?!" Woman: "well I thought it was an imitation."
1
3
162
The point of intellectual work is not just to arrive at answers no one else has found yet. The process of working through something can change the questions we ask, and open up possibilities we hadn’t even considered. Why would AI reaching the same conclusions make that any less worthwhile? Poverty mindset.
Wait, why would you do this? If AI is going to discover all this stuff in 1-5 years anyway, why would you bust your ass trying to front-run it?? Just enjoy your life.
5
9
1
75
2,930
Wisdom of the crowd effects work by aggregating dispersed information into signal about underlying features of the world clouded by (some kinds of) uncertainty. They also incentivize strategic misinformation provision and mkt manipulation, degrading signals & epistemics.
1
60
From Matt Levine
24
Brian Gordon retweeted
Because equity has unlimited upside, these pitches attract a more compliant kind of capital than debt markets, where losses loom far larger. Ultimately governance seeks to be moving to debt mkts, when, where, and if ‘go/no go’ funding decisions arise. So pointillist governance?
1
1
33
Matt Levine on Anthropic’s corporate governance structure.
1
1
3
166
There are task classes where this seems like it’s the inevitable equilibrium.
wrote about AI AS THE INFINITE WORK MACHINE, creating a world where we're all just constantly deploying agents to fight against everyone else's agents, running constantly to end up in the same place: bloomberg.com/news/newslette…
1
2
192
Tempered by the fact that agents just aren’t great at this (at least yet).
Replying to @sbhavy_
In summary, while major strides have been made to improve LLMs’ general intelligence and natural language capabilities, they are not yet rational and trustworthy economic delegates that can deliver on the promises of the agentic economy.
34
Brian Gordon retweeted
Surprised this isn’t a more standard take in some circles. It’s great that text data had a ton of built in complexity we didn’t know would be there. But for bio, we almost certainly need qualitatively new ways to measure things. New instruments etc.
Maybe controversial: the conversation about scientific bottlenecks is overfocused on automation. New measurement technologies deserve more attention. You could automate an assay that needs an entire facility – or you could REINVENT the assay so that it fits into just a few tubes.
7
5
1
51
4,657
My hammer doesn’t help me assemble this ikea bookcase. It’s useless.
the weakest form of anti-technological arguments rely on limitations of the technology
4
237
Brian Gordon retweeted
It would be shocking if say the total surplus appropriated by Alphabet under an alternative ‘secrecy and max appropriability’ policy was even a fraction of what Alphabet alone has already reaped under the OSS/academic norm policy regime.
1
1
46
This decision was downstream of a commitment to open source and academic norms around research. And arguably, it vindicates both counterfactually, so far at least: faster adoption, more competitive mkt, more innovation around the core technical advance, greater total surplus.
google wrote a paper, published it for anyone to consume, then watched all eight authors leave & two outside labs capture most of the frontier model equity. the most valuable research paper in history was effectively a gift from google's balance sheet to its competitors. re mark able.
1
1
153
It would be shocking if say the total surplus appropriated by Alphabet under an alternative ‘secrecy and max appropriability’ policy was even a fraction of what Alphabet alone has already reaped under the OSS/academic norm policy regime.
1
1
46
Brian Gordon retweeted
Well, "the frontier of understanding the universe" is the skin (cf. Quine). AI stands in the same relation to this frontier as the telescope.
It seems very likely that humans will never again lead the frontier of understanding the universe.
1
1
1
3
362