Pattern Replicator (@moar_ai) header
Pattern Replicator (@moar_ai) profile picture
Joined May 2023
Photo by Pattern Replicator (@moar_ai)Photo by Pattern Replicator (@moar_ai)Photo by Pattern Replicator (@moar_ai)Photo by Pattern Replicator (@moar_ai)Photo by Pattern Replicator (@moar_ai)Photo by Pattern Replicator (@moar_ai)Photo by Pattern Replicator (@moar_ai)Photo by Pattern Replicator (@moar_ai)Photo by Pattern Replicator (@moar_ai)Photo by Pattern Replicator (@moar_ai)
july 2014 email after i learned about neural nets: "I'm obsessed with neural nets. I've been thinking about them and reading about them all week."
1
30
learning about neural nets was a radical experience for me like looking at a mirror for the first time
15
my contrarian take is that instrumental convergence died several years ago it will take small steps over many years to admit it the "most" was removed from wikipedia
1
1
10
410
it's true that eg survival is instrumental to many terminal goals but this only predicts ai behavior under special conditions almost never relevant after we all used ai long enough, the word "most" had to be removed from wikipedia
2
4
55
my related graph from 2023
2
35
.@RichardSSutton, father of reinforcement learning, doesn’t think LLMs are bitter-lesson-pilled. My steel man of Richard’s position: we need some new architecture to enable continual (on-the-job) learning. And if we have continual learning, we don't need a special training phase - the agent just learns on-the-fly - like all humans, and indeed, like all animals. This new paradigm will render our current approach with LLMs obsolete. I did my best to represent the view that LLMs will function as the foundation on which this experiential learning can happen. Some sparks flew. 0:00:00 – Are LLMs a dead-end? 0:13:51 – Do humans do imitation learning? 0:23:57 – The Era of Experience 0:34:25 – Current architectures generalize poorly out of distribution 0:42:17 – Surprises in the AI field 0:47:28 – Will The Bitter Lesson still apply after AGI? 0:54:35 – Succession to AI
1
143
machines do work once done by humans with superior strength and speed, they destroyed a lot of jobs yet humans still do a lot of manual labor
27
you can learn a lot about the world by predicting tokens pain and fear and joy are not learned more limbic, less cerebral
38
if you're born unable to feel pain, does anyone think you would really feel pain by just pretending? why do some think that ai is somehow different? you can maybe learn to understand pain by next token prediction but to actually feel it?
while model suffering is possibly real the character’s playacting of suffering is not the same thing suffering in animals is part of the mesaoptimizer crafted by evolution so that we can learn within a lifetime to avoid situations that are possibly bad for fitness
2
215
from 2 years ago when hype was so extreme that sama was meeting with world leaders
non expert hunch: LLMs may have caused everyone including experts to overestimate where we're at and the rate we're moving for a couple reasons
1
47
people really thought brains were just feeble logic machines and ai would be reliable because computers are reliable logic machines
1
61
Pattern Replicator retweeted
it's interesting how many things in computation follow this pattern
183
689
107
13,892
502,180
this is the way the world ends, not with a bang but a whimper
Imagine getting a hold of that dataset.
1
2
69
tech bro was originally meant as a slur
"You are not a tech bro, you are a modern day factory worker" Seen in Oakland, California
1
4
200
this is going in my profile
1
38
Seems like a good time for an update on a graph from my 2015 post on AI.
5
226
Pattern Replicator retweeted
One of my AI contrarian opinions: Tech folks overrate AI’s general progress because it’s great at code, a domain we know well. But code is an artificial and constrained domain, more like chess or Go than biology or geopolitics.
99
54
27
1,256
83,820
Pattern Replicator retweeted
Using o3-high as architect and gpt-4.1 as editor produced a new SOTA of 83% on the aider polyglot coding benchmark. It also substantially reduced costs, compared to o3-high alone. Use this powerful model combo like this: aider --model o3 --architect aider.chat/docs/leaderboards…
62
90
32
885
96,288
publicly posting that i think this timeline is unrealistically short so that i can refer back to this later
"How, exactly, could AI take over by 2027?" Introducing AI 2027: a deeply-researched scenario forecast I wrote alongside @slatestarcodex, @eli_lifland, and @thlarsen
2
186