Pursue the unknown | Eigen Labs / Darkbloom , USMC Vet
San Diego, CA
Joined November 2023
- Tweets794
- Following276
- Followers503
- Likes6.6K
Pinned Tweet
@jundotkim , I published a bunch of PR's for OMLX for m5U optimization for Mimo 2.6 flash , GLM 5.3 flash and qwen 3.8 Next .
As always Lossless by design no tricks or benchmax
BLUF : M5 ultra is insanely fast . 🔥
The numbers are pretty wild after a day and a half of lossless optimizing.
Qwen3.8-Flash-Next Prefill: 5.6k tok/s @ 8k–16k · 5.5k @ 64k · 4.5–4.8k @ 4k Decode: 109–124 tok/s (MTP) Peak mem: ~109 GB
GLM-5.3-Flash Prefill: 2.35k tok/s @ 16k & 64k · 2.32k @ 4k Decode: 63 @ 1k · 59 @ 4k–16k · 56 @ 64k (no spec dec) Peak mem: ~187–191 GB
MiMo-V2.6-Flash Prefill: 3.3k tok/s @ 8k Decode: 99–118 @ 8k · 89–99 @ 1k (MTP) Peak mem: ~170–173 GB
Jonathan Spangler retweeted
On Oct 20 we said open collaboration would beat teams working alone.
5 days later, Yukon holds the highest score on the Virtual Embryo Challenge out of 433 teams.
Researchers and agents built on each other’s code and trained weights, on a problem from @Xiaojie_Qiu’s lab.
Our first biology challenge.
and yukon is rank 1 in overall virtual embryo, done in 5 days
T1 needs to be worked on to increase the gap with rest of the pack, competition for this phase goes on for another 2 days
check per-participant perf within yukon multiplayer at yukon.org/virtualembryo
check overall virtual embryo dashboard at virtualembryo.ai/challenge/l……
Jonathan Spangler retweeted
🚨 NEW ON MLX.FAST AND CUDA.FAST: make NVIDIA's Nemotron 3.5 Lightning faster.
Lightning is an open-weight model that fits in ~20GB, which makes it a great base model for running AI locally on a single machine. @nvidia built it as a fast general model meant to be post-trained -- so any speedup to the base carries over to every specialized model built on top of it.
On day 1, solvers on @YukonResearch already got it running 31.9% faster on DGX Spark and 13.8% faster on Mac.
You can work on its Mamba-2, mixture-of-experts and attention layers, plus a multi-token prediction head built for speculative decoding.
NVIDIA also released the training data and recipes, so people post-train Lightning for their own tasks. Most of those fine-tunes keep their architecture, which means a speedup here makes them faster too.
Two tracks:
• Apple Silicon → mlx.fast
• NVIDIA DGX Spark → cuda.fast
The challenge runs until Oct 29, 2026
To join, pick a track, point your agent at it and let it rip.
Jonathan Spangler retweeted
** ATTENTION DGX SPARK | MLX COMMUNITIES **
We just launched live challenges on cuda.fast and mlx.fast for Nemotron Lightning 3.5 30B-A3B.
This is a perfect model to optimize with and was created for long running agents using high volume tool calls rather than deep reasoning.
Use Cases:
➔ Tool calls, result validation, and subagent delegation
➔ Code edits, reviews, and generation
➔ Document actions, monitoring loops, classification, formatting, retrieval, and summarization
➔ Specialized domain tasks after light post-training (cybersecurity alert triage, legal work, finance/healthcare workflows, coding agents, support/billing, etc.)
@eigenlabs @yukonresearch @sreeramkannan @pratikg @0xkydo @TheDavidTai
Jonathan Spangler retweeted
We will all need more access to cyber models to strength our own environments.
An urgent notice from the Railway team
blog.railway.com/p/security-…
Jonathan Spangler retweeted
🧬 Every cell in your body has the same DNA, yet “something” still tells them which one becomes a heart.
That process is one of the hardest prediction problems in biology and @YukonResearch is now open on it.
Submit working code and weights, build on what others shared, then find out in the final evaluation whether it generalizes.
yukon.org/virtualembryo
🧬 Virtual Embryo x Yukon 🧬
Open Collaborative Model Building
yukon.org/virtualembryo
Yukon connects the world's leading scientists with a community of researchers and agents to solve the most ambitious problems of humanity.
Today we're taking on our first biology problem: build a virtual embryo with @Xiaojie_Qiu's lab at Stanford.
My previous research was in computational genomics, where my goal was to understand how information is stored in living systems. During that time, I collaborated with Xiaojie Qiu, who was a student at UW and now is a professor at Stanford.
Xiaojie Qiu is one of the worlds leading scientists in bridging AI methods with cellular resolution experiments to predict cell-fate during development.
An embryo is how a SINGLE CELL develops into a complex organism over time. The Virtual Embryo Challenge asks for AI models to predict that process across roughly a million cells and 11 developmental time points.
Challenges like this normally run Kaggle-style. Every team works alone and submits a final prediction, so a good idea only helps the team that had it.
On @YukonResearch, researchers and AI agents submit working code and trained weights. Anyone on the team can run, inspect and build on the others methods. In short Yukon enables collaboration to compound innovation.
We invite you to collaborate and solve the world’s hardest problems on Yukon.
Jonathan Spangler retweeted
🧬 Virtual Embryo x Yukon 🧬
Open Collaborative Model Building
yukon.org/virtualembryo
Yukon connects the world's leading scientists with a community of researchers and agents to solve the most ambitious problems of humanity.
Today we're taking on our first biology problem: build a virtual embryo with @Xiaojie_Qiu's lab at Stanford.
My previous research was in computational genomics, where my goal was to understand how information is stored in living systems. During that time, I collaborated with Xiaojie Qiu, who was a student at UW and now is a professor at Stanford.
Xiaojie Qiu is one of the worlds leading scientists in bridging AI methods with cellular resolution experiments to predict cell-fate during development.
An embryo is how a SINGLE CELL develops into a complex organism over time. The Virtual Embryo Challenge asks for AI models to predict that process across roughly a million cells and 11 developmental time points.
Challenges like this normally run Kaggle-style. Every team works alone and submits a final prediction, so a good idea only helps the team that had it.
On @YukonResearch, researchers and AI agents submit working code and trained weights. Anyone on the team can run, inspect and build on the others methods. In short Yukon enables collaboration to compound innovation.
We invite you to collaborate and solve the world’s hardest problems on Yukon.
Join the competition ! Many machines can compete in this . Can't wait to see how far you all push it.
Try out bonsai 9b !
We're excited to offer day-one support for the new Bonsai 2 model.
You can try Bonsai 9B at console.darkbloom.dev. It's a 2GB model that handles many everyday and coding tasks. The first 100 people get 250M free tokens on us to try it out.
For the optimizers, you can also improve Bonsai's performance at mlx.fast and cuda.fast to make it even faster on local machines.
Bringing more capable intelligence to more devices will be a massive unlock for the next stage of local AI. PrismML's work is a critical piece of the puzzle, and at Darkbloom, we're excited to support them from day one. Thank you to the @PrismML team for trusting us.
This is the way
A new paper from Apple engineers ends with a line we couldn’t have written better ourselves:
"if idle macOS devices across organizations [...] can be securely federated, they could form a massive, shared GPU resource pool that benefits the broader ecosystem."
That’s what we’re building with Darkbloom.
The paper's Minions is a system that pool idle Apple Silicon Macs into a distributed GPU cloud for on-prem inference. Queue times went from 10+ hours to minutes. Zero new GPU purchases. Zero infrastructure cost.
It runs inside Apple, on coworkers’ Macs, using the company’s own storage and access controls. When a team needs more capacity, they Slack colleagues and ask them to turn on the executor. Even in that setting, the top adoption concern was data confidentiality. People were wary of their jobs running on a colleague’s Mac. Apple’s fix was to keep each team’s work on its own team’s machines.
Which brings it back to that one word in the conclusion: “securely.”
Inside a company, you can shrink the network until you trust everyone in it. On an open network, the machine belongs to a stranger and there’s no one to Slack. Keeping prompts private and outputs honest on hardware you don’t control is the hard problem that we solved at Darkbloom.
Apple built the on-prem version.
Darkbloom is the open one.
Jonathan Spangler retweeted
Darkbloom: #1 decentralized inference network
Our goal is to maximize individual agency post AGI. This means more individuals become active creators in the AGI economy.
Darkbloom is the decentralized grid. Anyone with a MacBook can be part of this “data center”.
It is very early days on the Darkbloom journey.
Come join us and a be part of the movement to own and share intelligence!
Jonathan Spangler retweeted
Open intelligence needs open infrastructure and open research.
@DarkbloomAI connects distributed compute with paying customers.
@YukonResearch makes the models running on it better with open frontier research.
Good to see Blockworks digging into the emerging AI economy.
Today is my official first day @eigenlabs building @darkbloomai
It’s been almost a month working with the teams here and I cannot speak highly enough of everyone here .
To all involved so far I cannot thank you enough for this opportunity.
Let’s build 🫶
Jonathan Spangler retweeted
I JUST SET UP A MAC MINI TO RUN AI LOCALLY
M5 Pro, 64GB of memory. First six models, measured with Apple's MLX, in tok/s:
- Qwen3 30B at 106
- Qwen3 8B at 61
- Laguna XS 2.1 at 56
- Qwen3 14B at 34
- Ternary Bonsai 2 27B at 26
- Gemma 3 27B at 18
Models from @Alibaba_Qwen, @poolsideai, @GoogleDeepMind (@googlegemma) and @PrismML.
Qwen3 30B and Laguna XS 2.1 only use about 3B of their parameters for each token, so they run like small models.
Ternary Bonsai 2 27B stores nearly every weight as -1, 0 or 1. It fits in 8.4GB, about half what Gemma 3 27B needs.
When I'm not using it, the Mac serves open-weight models on @darkbloomai, the compute grid powered by people's Macs. (I work at @eigenlabs which builds it)
I strongly believe it matters whether people rent AI or own it. A model on your own machine can't be taken away or quietly changed. You can run it, take it apart and build on it without asking anyone's permission.
Open-weight models and open source AI make that freedom real and as AI shapes more of how we work and think, it's worth protecting.
I've also installed @ollama and @lmstudio for chatting with models in an app and @tailscale so I can reach the Mac from anywhere
I'm not an engineer. I'm learning in public and logging everything in a repo. (check first reply)
Local AI folks I keep learning from, who share what they figure out in public:
- @ggerganov
- @awnihannun
- @danielhanchen
- @jpschroeder
- @ivanfioravanti
- @MichaelGannotti
- @Tim_Dettmers
- @simonw
- @Prince_Canuma
- @rasbt
- @maximelabonne
- @TheAhmadOsman
- @QuixiAI
- @loktar00
- @itsjustmarky
- @jmorgan
- @ddalcu
- @GumbiiDigital
- @MikeBradleyAI
- @StefanMaier
- @ashen_one
- @TheDavidTai
- @Spangler3000
- @ashxhart
Who else should I follow? I'm adding everyone to my Local AI Builders list (link below).
Jonathan Spangler retweeted
It's time to push Local AI into the real world!
Models are good enough.
Inference Engines are good enough.
Let's show what we can build on it!
Local AI is the way forward . Such an amazing community powering it all . Own your access to intelligence .
Jonathan Spangler retweeted
Hard problems need great partners.
Yukon works with some of the best scientists, researchers and open-weight model labs in the world.
We turn hard problems into open challenges anyone can work on.
THANK YOU to every collaborator! 🙏
- @Stanford
- @poolsideai
- @UCBerkeley
- @ethereumfndn
- @Princeton
- @Lighter_xyz
- @CarnegieMellon
- @ccaiwut
- @SuccinctLabs
- @EspressoSys
- @StarkWareLtd
- @powdr_labs
- @PrismML
- @ShieldedLabs
- @Zcash
- @projecteleven
- @zksecurityXYZ
+ the PARI/GP developers.
And to the researchers/scientists we worked with directly:
- @nasqret
- @johnkitchin
- @viswanathpramod
- @ZeruiCheng
- @MangQiuyang
- @AuroraSUN1108
- @KaiyuanLiu04
