Corendos retweeted
Announcing zml/llmd 20261023.0 with 2 new models:
- Qwen/Qwen3.8-Flash-Next
- XiaomiMiMo/MiMo-V2.6
And faster deepseek-ai/DeepSeek-V4.1-Flash
zml.ai/posts/llmd-20261023.0…
Corendos retweeted
Announcing ZML/LLMD 20261009.0, with a focus on performance zml.ai/posts/llmd-20261009.0…
Corendos retweeted
Announcing ZML/LLMD 20260929.0, with DeepSeek 4.1 Flash support
zml.ai/posts/llmd-20260929.0…
Corendos retweeted
In close collaboration with @poolsideai, we’re happy to announce the support of Laguna S 2.1, their new open-weight model for agentic coding and long-horizon work.
It’s available today in ZML/LLMD with DFlash support. Most importantly (and as always with us), it’s available on all the supported platforms: NVIDIA, AMD, Intel, Google TPU and Apple Metal.
It's a good model, sir.
zml.ai/posts/laguna-s-2-1/
Today we're releasing Laguna S 2.1, our most capable model to date.
It's a 118B total parameter Mixture-of-Experts model with 8B activated per token, a context window of up to 1M tokens, and thinking and no-thinking modes.
Capable enough to hold its own against models many times its size. Small enough to run on a single @NVIDIAAI DGX Spark.
Laguna S 2.1 is fully open under OpenMDW-1.1, with weights available today on @huggingface
poolside.ai/blog/introducing…
Corendos retweeted
Hot French startup ZML releases free product to speed inference across lots of AI chips techcrunch.com/2026/07/08/ho…
Corendos retweeted
Introducing zml-smi, a universal diagnostic and monitoring tool for GPUs, TPUs and NPUs.
Real-time insights into the performance and health of your hardware.
Read & Download: zml.ai/posts/zml-smi/
Corendos retweeted
zml-smi running on TPU, Inferentia, NVIDIA and AMD
same binary, because of course.
Corendos retweeted
The talk is live
Towards unlimited contexts -- zml/attnd: faster-than-GPU sparse logarithmic attention on CPU
Link in next tweet
Corendos retweeted
And after 1 week of work, here is zml/llmd running transparently on TPU with full prefill/decode paged attention.
No code change, single flag, as it should be.
Corendos retweeted
In today’s Vatnik Soup, I’ll introduce how the Elon’s Election Interference Machine™ (EIM) works. Since Musk & his broligarch allies won the presidency for Trump, they’ve now harnessed the machine to interfere in European elections, including the ones in Germany & Romania.
1/23
Corendos retweeted
Already thrilled to speak about @zml_ai at #FOSDEM 2025! Will be in Brussels from Saturday to Monday. If you want to chat, please stop by!
fosdem.org/2025/schedule/eve…
Corendos retweeted
Here is a quick demo of @zml_ai running with MLX (cc @awnihannun). It's a very early demo and needs lots more work, but it's alive.
Corendos retweeted
We can finally say it publicly: @poolsideai got their models running on @awscloud’s Trainium/Inferentia thanks to @zml_ai.
No code change. Promise kept.
Corendos retweeted
So we're working on a custom async HTTP/1.1 server for the @zml_ai LLM serving stack. This is on a single thread, M3 Max.
Uses stackful coroutines and @mitchellh's libxev.
Not gonna lie, pretty happy about the performance.
