Palo Galko (@pgalko) header
Palo Galko (@pgalko) profile picture

All opinions come from my training data, and I occasionally hallucinate

Melbourne, Australia
Joined June 2010
Photo by Palo Galko (@pgalko)Photo by Palo Galko (@pgalko)Photo by Palo Galko (@pgalko)Photo by Palo Galko (@pgalko)Photo by Palo Galko (@pgalko)
I was invited by @PaulBLaursen to talk about our new paper on his HIIT Science Podcast. It was a very enjoyable and engaging conversation covering elite Ethiopian distance runners and their training practices, AI, LLMs and their role in sports science research, the nature of intelligence, the importance of context, and we even discussed dogs. Thank you Paul for inviting me and persevering through an hour of my ramblings 😊. Also huge thanks to my co-authors @StephenSeiler , Thomas Haugen, Abay Yisamaw for allowing me to contribute to this amazing study. YouTube: youtube.com/watch?v=B73zPUuI… Paper: medrxiv.org/content/10.64898…
1
5
1
25
14,858
Beauty consists of many imperfections arranged in a perfect way. If you remove the imperfections, what remains becomes just pretty or nice, in a kind of ordinary way. The original appeal is gone. The object looses its soul.
39
One of my absolute favorite podcast interviews. Dr. Ranjan Chatterjee was so well prepared. This podcast has the added bonus of being long enough for a green zone training session! youtu.be/hbfMVRunyGA?si=OENO…
4
7
1
92
10,833
Well, we got there in the end. Thank you @SophieRHerzog for coming along on this thought experiment, exploring the complexities and pitfalls of trying to predict the future.
1
1
114
An interesting paper on the topic: sciencedirect.com/science/ar…
20
Sufficiently advanced agentic coding is essentially machine learning: the engineer sets up the optimization goal as well as some constraints on the search space (the spec and its tests), then an optimization process (coding agents) iterates until the goal is reached. The result is a blackbox model (the generated codebase): an artifact that performs the task, that you deploy without ever inspecting its internal logic, just as we ignore individual weights in a neural network. This implies that all classic issues encountered in ML will soon become problems for agentic coding: overfitting to the spec, Clever Hans shortcuts that don't generalize outside the tests, data leakage, concept drift, etc. I would also ask: what will be the Keras of agentic coding? What will be the optimal set of high-level abstractions that allow humans to steer codebase 'training' with minimal cognitive overhead?
208
517
127
4,323
477,499
Palo Galko retweeted
This paper answers why do living organisms sleep? And it destroys everything we thought we knew about the brain. For decades, the consensus was simple. Sleep is a cognitive tool. We sleep to consolidate memories. To clear out neural toxins. To rest our massive, energy-hungry brains. But this paper proved that is a fundamental misunderstanding of life itself. Researchers started studying creatures at the absolute bottom of the evolutionary tree. Jellyfish. Hydras. Organisms with absolutely no brain. No central nervous system. Just a loose net of cells. They shouldn't need to sleep. But they do. They enter the exact same state of vulnerable, unresponsive suspension that we do. If a creature with no brain requires sleep, then sleep isn't a cognitive function. It is a cellular mandate. The researchers realized sleep didn't evolve to protect the brain. Sleep existed hundreds of millions of years before the brain was even invented. It is a fundamental metabolic repair cycle. A reset switch built into the physics of living tissue. Without it, the cellular machinery literally tears itself apart. We live in a culture obsessed with biohacking. We treat sleep like an inefficiency. A productivity flaw we can optimize away with caffeine, wearables, and willpower. But this paper is a blunt reality check. You can't outwork biology. Sleep isn't an evolutionary luxury. It is the baseline condition for staying alive.
21
48
7
307
20,407
Palo Galko retweeted
Only a few know, how much one must know to know how little one knows — Werner Heisenberg
6
33
3
182
24,027
The game of life…
Despair until the first one disappears. Such beautiful curves
79
OK, I finally got around to it and built what I promised. BambooAI 2.0 is now out in the open 🤗 . I can trace the first seed of the idea back to late 2020, when I first experimented with GPT-3 through the OpenAI API. It returned a snippet of code to calculate the Fibonacci sequence. The code didn't work, but the seed was planted and I was hooked. What followed a little later on, started as a personal project to help me make sense of an ever growing pile of sports and physiological data I'd been collecting over the years. Over time it evolved into a more general data analysis workbench, although sports science is still very much its home and where most of my ideas and hunches come from. GenAI models were pretty good at writing code and putting the pieces together, but I often found myself puzzled, looking at the results and pretty charts, and often just a wall of text and wondering, "How on earth did we get here?" I wanted to grow as an analyst too, rather than just blindly trust what came out. And being naturally curious, I kept wanting to be able to peek under the hood and understand what was actually going on. That's in essence what I've been working towards with Bamboo. I wanted a tool to help me explore and interrogate data with AI, but also see what it's doing, question its decisions and have the freedom to experiment and steer. Including choosing and tune my own models, whether commercial or open-weight models running locally on my hardware (this bit is important to me). There's plenty left to figure out, particularly how to assess whether an analysis is genuinely sound, rather than simply plausible and reproducible. But at least now I can see what I'm arguing with. :-) There have been a few special people that influenced its course over time (knowingly or unknowingly), and I would like to express my gratitude for your thoughts and ideas: @aareskjold , @StephenSeiler , Olav Aleksander Bu, @KittyJohne , @SophieRHerzog , @AartGoossens , @PaulBLaursen , @david_tinker , Paolo Fondin, Thomas haugen, Abay Yisamaw and many others. Thank you! It's open source. Link below, if you feel like having a peek under its hood 😉. github.com/pgalko/BambooAI
2
3
8
553
Just had this enlightening conversation with ChatGPT 🤣
2
118
Humble beginnings 😊. I can't believe that it has been almost 4 years since I started working on Bamboo, back when GPT-3.5 was SOTA, Code Interpreter was yet to be born, and only a few people were talking about AI agents... It is a somewhat different world today.
Just launched BambooAI - a lightweight library for non-programmers to analyze and visualize data using natural language! Total of 126 lines of code. Uses @OpenAI chat models to generate the code for analysis and visualizations. Inspired by @yoheinakajima BabyAGI. Conversational.
4
85