James (@kun_stle) header
James (@kun_stle) profile picture

applied post-training research @ Chakra Labs

Seattle, WA
Joined June 2024
Huge congrats @27upon2 and the @SemiAnalysis_ team! Awesome work.
Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains. GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
1
2
10
541
It’s cool that Astra/Fable both work around their multi-modal limitations (no native video) by using Swift/Python programs for frame and audio analysis. If available, they can use FFmpeg too. I naively imagined that native video understanding would be table stakes but obviously the models can get around this.
2
6
201
Gemini seems the best at native video understanding. Probably because they own all the video.
1
104
What’d you name your internal Harbor fork? I’ve seen: - Marina - Fjord - Quay
4
9
668
1. “@../“ should work for referring to neighbor top-level dirs so I can cross-reference. 2. I want a Cmd-P command to open a new project w/ shell autocomplete rather than clicking through tabs.
1
1
190
3. On first boot, there aren’t basic command instructions. I’d really like something like “Cmd-P to open a project” or something, like VSCode or Zed do. 4. I want to close the sidebar, e.g. “Cmd-b”. — Requests made with respect, I love what yall are doing.
1
2
197
Replying to @theo
@theo I installed and started using T3 Code for my work today. Wow, it makes me a _lot_ faster. The minor overhead of “which agent tabs are finished” is gone. Here are a couple of things I’d love:
1
1
254
Today we’re launching Prompt Adaptation, a state-of-the-art agentic system that automatically adapts prompts across LLMs. Prompt Adaptation outperforms all other methods and significantly improves accuracy over manual prompt engineering, saving you thousands of hours per year.
21
71
23
632
111,049
Happy Thanksgiving, everybody! Today and every day, let’s remember the importance of giving back and showing our gratitude to those who have given us so much.
10,305
19,215
1,167
271,349
55,855,967