trying to explain logarithms as well as possible

nyc
Joined September 2014
Everything that can be solved with rotation, should be solved with rotation
Replying to @ZelaArber
The state encodes the task information. On the sphere a token's only free quantity is its direction, so we track each cell's angle to its own input. On Sudoku, clues rotate toward their input, blanks end near orthogonal, and the final angle flags wrong answers. (5/9)
1
8
517
The Nagelian Imperative: always get to know the person directly, even though you can’t
2
156
This is really excellent work
Replying to @heyyalexwang
tldr; every layer is a memory layer and we can use heuristic arguments to estimate their memory capacity based on how much interference they can suppress
1
3
438
Currently working on a mod where, by playing and catching pokemon, you learn to think about how to code To beat Brock you may have to learn how to think in terms of booleans And the pokemon moves can be expressed and executed as codemode blocks, which are free to miss/fail etc
🤖 Made with AI
1
4
240
Calling all system one thinkers i.e. @CompleteSkeptic @dotpem @lotusfracture Isn’t “loc” a more sensible general primitive than “box”? Box seems able to handle recursive localization nesting in images, but not for more general geometries. You may eventually introduce “loc”? :)
i have many thoughts on this - you can have a jev feedback loop to figure out when you're done - you can recurse on bboxes and get smaller and smaller - you could mask objects as you detect them and then ask for the next instance of object if you need to keep it sequential tldr: Box is a very interesting primitive for sys1 models
2
2
1,651
This is awesome
Replying to @nayshins
Mirror is a Rust agent core with a python TUI using an RPC. The same agent core can run headless behind an HTTP API just as easily as in your terminal. Every session is a single append only log, and everything else (the transcript, what the model actually sees, token usage, extension state) is just a fold over that log. Compaction appends a new context window with a summary and the recent turns, and a rewind is a fork that points back at the parent’s log up to where you rewound, so nothing ever gets copied or thrown away.
2
196
a16z? You mean armin ronacherandmario zechner?
5
258
You will get more generalizable feedback when you put your canine a little bit out of distribution
RLCF: reinforcement learning for canine feedback
1
10
268
The OpenAI manuscripts are pretty fucking unreadable to me! Now instead I am starting with these papers from the 90s from Christopher Moore and @prof_g to lay a foundation before I get to Tao and @evamirandag
Of all the buckets of manuscripts, I’m currently most interested in bucket 376 of 377, “Universal computation in forced Navier-Stokes flows”, building on the work of @evamirandag “Can a force that eventually stops changing continue to perform an arbitrarily long computation?”
1
1
6
672
Of all the buckets of manuscripts, I’m currently most interested in bucket 376 of 377, “Universal computation in forced Navier-Stokes flows”, building on the work of @evamirandag “Can a force that eventually stops changing continue to perform an arbitrarily long computation?”
2
2
1
8
1,044
It’s go time
somebody should make a language that's good for systems programming, fast compile times, good concurrency, pretty simple mostly just gets out of your way, easy to distribute cross arch, very unfortunate that we all _MUST_ use rust all the time, maybe some day
1
2
209
Long term repo maintenance is great to focus on Looking forward to sweeper agents
Can LMs discover & fix bugs if you don't tell them what went wrong? To proactively maintain a repo, agents need to find problems before users do. SWE-sweep benchmarks this on 100 repos, 22 languages, 4k real bugs (numpy, php interpreter, lean kernel). Top models get <5%.
3
248
🤖 Made with AI
did a single person predict that coded music videos would take over diffusion
6
319
Generative Educational Network (GEN) (it reminded me of a GAN, except instead of a discriminator learning to tell apart real vs fake generations from an adversarial generator, a learner just predicts the byte sequences taught by an educational generator) True machine learning
Can an LM, starting from random init (!!), learn to generate all of its pretraining data? Introducing Self-Play Pretraining with Zero Data. Two models start from random initialization: a generator proposes programs for a universal Turing machine and a learner trains on their outputs. We never train on any real data, but see predictable scaling on natural datasets: zero-shot val loss on images, text, audio, and melodies decreases predictably with self-play compute. And the learner develops in-context learning capabilities. A fun proof-of-concept, co-led with @AdityaCowsik and @KfirDolev and co-authors @gbruno_dl, @ANourya @noahdgoodman, and @YoavLevine.
1
345
starting to think claude is like lisa simpson (values-driven, buddhist, vegetarian)
I made this with one prompt using Opus 5.5 I spoke to my computer for 5mins, claude worked for 12 hours, and I woke up to this full prompt:
632
My uncle showed this to me as a kid with a piece of paper and a magnifying glass. It has gotten remarkably easy to generate code to try and explain things, and yet nothing will ever beat an uncle making it magical with found materials
I asked Opus 5.5 to explain camera focus by building an interactive lens lab Here's what it came up with after 1 hour 26 minutes in one shot, $25.66 API cost lens.lab.sael.net Move the focus ring and you can see the glass elements shift the sharp plane through the scene
7
624
From the folks who brought you Pacing the Frontier, introducing Mutually Assured Deployment
4
3
1
57
3,820