Pinned Tweet
Enhancements have been made to the best nvidia/GLM-5.3-Flash-FP4-Local quants. Using NVIDIA FLARE inference engine, deployed on 2× DGX Spark, now supports a 1M context, 4 concurrent slots, and MTP-3, achieving up to 52 tokens/s decode speed for C1.
github.com/Reederey87/glm53-…
4
453
New big models from OpenAI.
Some of you have been asking very politely. Some of you have just been asking.
GPT-6.2 Astra and Sol are now available.
Super efficient and built to perform where it counts—the real world.
openai.com/index/introducing…
41
Smaller Qwen4 models coming soon! Apparently available for 1x & 2x DGX Sparks 🔥
📢 Meet Qwen4-Max, your new AI teammate for work, creativity, and discovery!
Qwen4-Max is built on a new MoE architecture with native vision and a 1M-token context window.
Highlights:
- Outperforms Qwen3.8-Max with up to ~50% fewer tokens, while average cost per task drops over 60% in our internal evaluation.
- Advances real-world productivity through greater proficiency with professional tools, stronger long-horizon execution, and higher-quality deliverables.
- Handles real tasks, including 3D modeling, game development, manufacturing, finance, law, healthcare, and frontier scientific discovery.
- $1.5/M tokens for input, $4.5/M tokens for output, and $0.075/M tokens for implicit caching — all lower than Qwen3.8-Max, with implicit caching down by 70%.
The API is live on QwenCloud. You can also try Qwen4-Max on Qwen Studio, QwenWork and Qoder.
Start building today! 🚀
- Blog: qwen.ai/blog?id=qwen4-max
- API: qwencloud.com/models/qwen4-m…
- Token Plan: qwencloud.com/pricing/token-…
More to come! The open weights of smaller Qwen4 models will be released. Stay tuned. 👀
1
110
Artem Mats retweeted
📢 Meet Qwen4-Max, your new AI teammate for work, creativity, and discovery!
Qwen4-Max is built on a new MoE architecture with native vision and a 1M-token context window.
Highlights:
- Outperforms Qwen3.8-Max with up to ~50% fewer tokens, while average cost per task drops over 60% in our internal evaluation.
- Advances real-world productivity through greater proficiency with professional tools, stronger long-horizon execution, and higher-quality deliverables.
- Handles real tasks, including 3D modeling, game development, manufacturing, finance, law, healthcare, and frontier scientific discovery.
- $1.5/M tokens for input, $4.5/M tokens for output, and $0.075/M tokens for implicit caching — all lower than Qwen3.8-Max, with implicit caching down by 70%.
The API is live on QwenCloud. You can also try Qwen4-Max on Qwen Studio, QwenWork and Qoder.
Start building today! 🚀
- Blog: qwen.ai/blog?id=qwen4-max
- API: qwencloud.com/models/qwen4-m…
- Token Plan: qwencloud.com/pricing/token-…
More to come! The open weights of smaller Qwen4 models will be released. Stay tuned. 👀
GLM-5.3 Flash is my daily driver on 2× DGX Spark. I prefer NVIDIA’s NVFP4-Local weights to DeepSeek v4.1 EXL3 quants.
1M context, ~45 tok/s single-stream, auto-start after reboot. Will work on that further.
My setup + benchmarks:
github.com/Reederey87/glm53-…
3
34
2,448
Mini or Duo for mobile coding?
Prices are very close:
iPad mini Wi‑Fi ($699) + iPhone 18 Pro Max ($1,299) = $1,998.
iPhone Duo starts at $1,999.
My preference: mini + phone for longer reviews; Duo for the convenience of one pocketable device.
1
243
Inkling 2 small weight will be released soon!!!
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor.
Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon.
thinkingmachines.ai/news/ink…
62
I switched from Droid CLI and Hermes Agent to DeepSeek Harness for day-to-day coding.
Quantized GLM-5.3-Flash runs well on my NVIDIA DGX Sparks, and I can call in Codex to help plan a change or give the code a final review.
The plugin catalog makes it easy to add MCP tools, browser automation, and reusable coding workflows as I need them.
deepseek.com/en/harness/
#DeepSeekHarness #LocalAI #DGXSpark #Codex
4
2
231
New CUDA Kernel King came!!!
Introducing Kimi K3.1 Pro: our most capable 3T-class open-weight model.
🔹 1M-token context, 2.8T total / 104B active params (MoE), Multimodal.
🔹 Full-project coding: games in Unreal, Unity & Godot.
🔹 Excels at parametric 3D modeling in Blender & CAD.
🔹 More reliable at finance work: Accurate modeling with hallucination down by 65%.
🔹 Matching the strongest proprietary models across coding, agentic and knowledge benchmarks.
Kimi K3.1 Pro and K3.1 Pro Highspeed (2–3× faster) are now live on Kimi.ai, Kimi Work, Kimi Code, and the Kimi API.
Open weights by Nov 4, 2026.
🔗 API: platform.kimi.ai
🔗 Tech blog: kimi.ai/blog/kimi-k3-1-pro
48
This is why NVIDIA’s QAD quants matter for local AI.
GLM-5.3-Flash-FP4-Local gets extra training to recover what compression loses. With quantization-aware distillation (QAD), the original BF16 model acts as a teacher, helping the compressed model learn to give similar answers while working with lower-precision weights.
That takes more work than a regular quant conversion: NVIDIA used 500 million training tokens over 3 epochs for this release.
The result is a 320B model using about 166 GiB, validated on two 128 GB DGX Sparks, with room for context. Quality stays close to BF16 on NVIDIA’s two reported benchmarks: GPQA 91.3% vs 92.1%; tool use 92.4% vs 91.9%.
EXL3 at 2–3 bits per weight can squeeze models into even less memory. But fitting a bigger model doesn’t automatically mean better answers. For my coding and math work, this QAD GLM build is a much better choice than the DeepSeek-V4.1-Flash 2-3 bpw EXL3 builds I tested on the same two Sparks.
I’d rather preserve more of a model’s ability than chase parameter count at the lowest possible bitrate.
More releases like this, please @NVIDIAAI !!!!
Model: huggingface.co/nvidia/GLM-5.…
How QAD works: developer.nvidia.com/blog/ho…
I have tested nvidia/GLM-5.3-Flash-FP4-Local and one of the best DSV4.1 Flash EXL3 quads of the LibertAIDAI/DeepSeek-V4.1-Flash-1017-EXL3-2.9bpw on a 2 x DGX Spark cluster on real coding and math problems. Better output was given by the QAD NVFP4 quants of the GLM 5.3 Flash distilled by NVIDIA. No looping, better instruction following, working fine in Deepseek-Harness. It is my #1 choice for Local AI on 2 DGX Spark machines now.
Thanks @NVIDIAAI for supporting local AI.
Newest cut of DeepSeek v4.1 Flash has arrived with stronger banch results.
🚀 DeepSeek-V4.1-Flash-1017 is here!
Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API.
🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model.
1/4
160
Claude Haiku 5.5 Has Been Released
Nearly a year after the prior release, Anthropic has chosen to enter the budget tier. Benchmark data indicate a clear edge over GPT-6 Luna. Costs are $0.1/$0.5 per million tokens for inputs up to 100k tokens; beyond that length, rates rise fivefold to $0.5/$2.5.
93
🚀 v1.6.0 is out — GLM-5.3-Flash EXL3 on 2x DGX Spark
35 commits since previous release.
What moved:
• Decode: prose ~30.8 → ~34.8, structured 69 → ~75 @ full 7/7, essay → ~27.4
• Agents stop re-reading history: 110k replay ~98% (4s not 132s), 4x60k sessions 98.7%
• Ops hardened: dual-HCA, 50ms SHM recheck baked in, prefix admission + resident tail
Why not TensorFold, I know about decode speed. But I optimized it for: agentic coding, tool usage, and re-reading speed of long histories in a 1M window on a stable vLLM stack.
More info here:
github.com/Reederey87/glm53-…
7
548
OpenAI is lowering the limits for its $200 Pro subscription.
At the same time, they are reopening sign-ups for this tier. They justify the move by noting that the total output capacity will still exceed what the Pro subscription offered a month ago (prior to the Astra release) and by promising not to bring back the five-hour limits. Additionally, they promise to add new features to the subscription that won't count against usage limits.
All this is happening against the backdrop of the cancelled Astra 6.1 release—due to safety concerns regarding the model—and rumors of an upcoming $500 "Pro Max" plan. Meanwhile, their main competitor, Anthropic, has just launched the highly successful Opus 5.5 and Sonnet 5.5 models.
1
1
122
Anthropic has released Opus 5.5.
According to benchmarks, it outperforms Fable 5.1; it is already available via chat, Claude Code, and the API. The price per token has been lowered compared to Opus 5—it’s now $4/$20 per million tokens. Additionally, they’ve raised the five-hour usage limits and introduced a banked reset feature.
I had very mixed feelings about Opus 5; it’s the kind of model you have to constantly babysit due to issues with instruction adherence. Let's see what the feedback on 5.5 looks like.
1
162
DeepSeek V4.1 Flash leads on agentic coding and core harness benchmarks, GLM-5.3-Flash edges out general/enterprise Elo scores, and Xiaomi's MiMo-V2.6-Flash dominates security/cyber tasks.
Introducing Xiaomi MiMo-V2.6 — Pro & Flash.
Frontier intelligence, all the modalities, built in public.
🔹 Two omnimodal models, advancing through scaled reinforcement learning
🔹 Pro performs on par with Claude Opus 5 and GPT-5.6 Sol across most agent benchmarks
🔹 Pro scores 46 on the Artificial Analysis Intelligence Index — the highest among open-source models
🔹 Stronger coding, computer use, 3D reasoning and creative capabilities
🔹 Open model weights, technical report, RL environments and training code
Blog:mimo.xiaomi.com/mimo-v2-6
292
Grok 4.7 has been released.
It offers a noticeable boost while maintaining the same price and speed. Musk had previously stated that Grok 4.7 would be a new pre-trained model with 2.1 trillion parameters, but plans evidently changed. Meanwhile, training for Grok 4.8—with its 2.5 trillion parameters—was supposed to wrap up last week, and the model is likely already in the RL phase.
153
DeepSeek-V4.1-Flash REAP-256E running on 2× DGX Spark (GB10): 25.65 tok/s decode, 841,973-token KV pool. Fully reproducible.
This is FP4, not a 3-bit or 2-bit EXL3 re-quant.
What "REAP-256E" means is the routed-expert pool was pruned 384 → 256 per layer using Cerebras' REAP method — delete the experts that contribute least.
Nothing was re-quantized.
This is a beginning, not a finish line. More improvements planned further.
Big thanks for weights to @Libertai_DAI .
github.com/Reederey87/deepse…



















