John Hartquist (@johnhartquist) header
John Hartquist (@johnhartquist) profile picture

swe → mle → aie → swe 🦀🤖

Joined May 2011
Photo by John Hartquist (@johnhartquist)Photo by John Hartquist (@johnhartquist)Photo by John Hartquist (@johnhartquist)Photo by John Hartquist (@johnhartquist)Photo by John Hartquist (@johnhartquist)Photo by John Hartquist (@johnhartquist)Photo by John Hartquist (@johnhartquist)
John Hartquist retweeted
Also hilarious if anyone thinks I've become a big fan of agent-led Rust out of any other consideration than purely scientific inquiry. Do you know how badly I would hate having to personally write Rust?? But when the premise changes, you need to update your priors.
15
4
1
286
25,025
John Hartquist retweeted
Every developer needs an AI shed: An always-on machine running on their tailscale network where the majority of their herdr agents are running.
623
357
208
7,755
660,958
John Hartquist retweeted
Reject non-understanding. Slop grenades are not just code and PRs. We run a real risk that *reading* gets entirely discounted, because of the exhaustion of getting low-quality and unverified AI prose being thrown at you all the time. There's a thread going viral about a 'perf improvement' attributed to a compiler change. The PR *description* itself has the AI telling this person it's *not* due to the compiler change, it's how the algorithms and data structures have changed. And the implication is that a similar win could have been attained otherwise. I want AI in the service of understanding the universe and enhancing human cognition and creativity.
191
197
52
2,679
146,790
John Hartquist retweeted
This is the the quote I've been citing a lot recently.
you can outsource your thinking but you cannot outsource your understanding
846
4,354
272
46,574
2,785,664
John Hartquist retweeted
Have you ever wanted to train LLMs in pure C without 245MB of PyTorch and 107MB of cPython? No? Well now you can! With llm.c: github.com/karpathy/llm.c To start, implements GPT-2 training on CPU/fp32 in only ~1,000 lines of clean code. It compiles and runs instantly, and exactly matches the PyTorch reference implementation. I chose GPT-2 to start because it is the grand-daddy of LLMs, the first time the LLM stack was put together in a recognizably modern form, and with model weights available.
252
1,775
329
12,356
1,662,158
John Hartquist retweeted
Introducing AI Brainstore! It’s a proof-of-concept of a brain for an AI agent. Ask an agent a question, it checks its memories for an answer, otherwise it browses the web and learns the answer. As it learns, it saves memories to its brain. GitHub: github.com/mckaywrigley/ai-b…
124
207
36
1,634
514,748
John Hartquist retweeted
Nobody is better positioned to make a great living in the AI/ML space than software developers. If you know how to build software, you have some of the most valuable skills necessary to make an impact.
10
30
356
62,544
John Hartquist retweeted
🔥 New (1h56m) video lecture: "Let's build GPT: from scratch, in code, spelled out." youtube.com/watch?v=kCc8FmEb… We build and train a Transformer following the "Attention Is All You Need" paper in the language modeling setting and end up with the core of nanoGPT.
479
2,961
335
19,656
5,343,212
John Hartquist retweeted
Thought, said, heard, understood.
31
797
63
4,364
We’ve acquired the MuJoCo physics simulator (mujoco.org) and are making it free for all, to support research everywhere. MuJoCo is a fast, powerful, easy-to-use, and soon to be open-source simulation tool, designed for robotics research: dpmd.ai/mujoco-blog
82
1,460
368
5,545
John Hartquist retweeted
You lead by being willing to walk alone.
267
3,185
202
19,499
John Hartquist retweeted
Announcing a new open-source JavaScript library for exploratory data visualization: Observable Plot! observablehq.com/@observable…
12
294
37
1,262
John Hartquist retweeted
Timeless content compounds.
111
492
43
5,067
John Hartquist retweeted
Direction > Effort
11
364
25
2,145
John Hartquist retweeted
Three.js Journey is live! 🎉 Learn how to create stunning 3D WebGL websites with the #threeJs library through more than 30 hours of video for $95 only (VAT incl.) threejs-journey.xyz #threejsJourney #webGL
228
615
199
4,787
John Hartquist retweeted
Arbitrage for anything: 1. Simplify 2. Share
9
14
3
161
John Hartquist retweeted
And you thought "Taking A Knee" was too much!?!
2,572
168,675
5,013
729,058
Masks work. ⓘ 𝗢𝗳𝗳𝗶𝗰𝗶𝗮𝗹 𝘀𝗼𝘂𝗿𝗰𝗲𝘀 𝘀𝘁𝗮𝘁𝗲𝗱 𝘁𝗵𝗮𝘁 𝘁𝗵𝗶𝘀 𝗶𝘀 𝗰𝗼𝗿𝗿𝗲𝗰𝘁
11
26
4
459
Our featured report today is by @johnhartquist, who shows us how to run a reproducible hyperparameter search. He provides good intuition around which hyperparams are really key for getting your audio classification models to perform well. Read it here: wandb.ai/jhartquist/fastaudi…
3
1
15