Devye (@XDevye) header
Devye (@XDevye) profile picture

本地大模型 | AIGC爱好者 拥有💻4*dgx Spark + 2*R9700 + RTX 5090 + Pro2000 本地LLM搭配 智能:Deepseek v4.1 Flash 1017 速度:Qwen3.8 27B 生图:Qwen Image 2.1

Joined April 2025
Today, we’re releasing the open weights for Hy4. Our natively multimodal flagship MoE (770B total / 49B active, 1M context). Alongside the Hy4 System Card with a comprehensive safety evaluation report. ➡️ Join the Hy team for a live AMA this Friday, 8–10 AM PT on r/LocalLLaMA—drop any questions about Hy models and chat with us directly! GitHub: github.com/Tencent-Hunyuan/H… Weights: huggingface.co/tencent/Hy4 GGUF:huggingface.co/AngelSlim/Hy4… License: huggingface.co/tencent/Hy4/b… System Card: hy.tencent.ai/Hy4_system_car…
63
154
85
1,275
68,480
Devye retweeted
🚀 Inkling-2-Small deployed on a 4× NVIDIA DGX Spark cluster with 200GbE RoCE interconnect (TP4)! Benchmarked coding, prose, and JSON workloads across 120 requests with 100% API completion. ⚡ Peak throughput: 121.9 tokens/s 🎯 75-question QEval: 74/75 (98.7%) 🧠 Model: Inkling-2-Small by @thinkymachines Excellent work by Scott Biggart on the distributed TP4 implementation! 🔗 GitHub: github.com/swbiggart/inkling… 🤗 Model: huggingface.co/thinkingmachi…
My first local AI recipe is out! Inkling-2-Small on 4× DGX Spark, using Thinking Machines’ original checkpoint weights, with no additional weight quantization. Built on TensorFold with DSpark speculative decoding. My measurements: • Single stream with DSpark: 70 tok/s on tool calls, 61 on code, 56 on thinking (31 plain) • 4 concurrent streams: ~101 tok/s combined at the default settings • First token at 2K: 1.3 s cold, ~0.2 s cached • Context up to 1M tokens github.com/swbiggart/inkling… Thanks to @thinkymachines for the weights, and @ashxhart + the @tensorfold_dev contributors for the engine. Would love independent runs and feedback!
2
3
20
1,302
Devye retweeted
Replying to @inco_ai
@inco_ai out here being legends! HUGE thanks for changing the license on your 10/10 GLM-5.3-Flash-DFlash2 model to Apache 2.0! Already adding direct compatibility for this one in REXL3 😍 Dreams do come true! huggingface.co/incoai/GLM-5.…
4
8
125
5,255
Devye retweeted
you only need two models (for now)
132
182
55
5,067
159,322
Devye retweeted
📢 Meet Qwen4-Max, your new AI teammate for work, creativity, and discovery! Qwen4-Max is built on a new MoE architecture with native vision and a 1M-token context window. Highlights: - Outperforms Qwen3.8-Max with up to ~50% fewer tokens, while average cost per task drops over 60% in our internal evaluation. - Advances real-world productivity through greater proficiency with professional tools, stronger long-horizon execution, and higher-quality deliverables. - Handles real tasks, including 3D modeling, game development, manufacturing, finance, law, healthcare, and frontier scientific discovery. - $1.5/M tokens for input, $4.5/M tokens for output, and $0.075/M tokens for implicit caching — all lower than Qwen3.8-Max, with implicit caching down by 70%. The API is live on QwenCloud. You can also try Qwen4-Max on Qwen Studio, QwenWork and Qoder. Start building today! 🚀 - Blog: qwen.ai/blog?id=qwen4-max - API: qwencloud.com/models/qwen4-m… - Token Plan: qwencloud.com/pricing/token-… More to come! The open weights of smaller Qwen4 models will be released. Stay tuned. 👀
840
1,609
1,292
14,873
2,527,790
Today we are happy to share one of our first open research releases: Latent Sparse Attention (LSA), a step towards subquadratic attention that matches accuracy of full attention at ultra-long context. Sparse attention attends to only a few tokens per query, but it has to find the right ones. At 10M tokens, that search takes 98% of the attention layer's time. LSA makes sparse attention up to 22.7× faster and full attention 72.4x faster. With @kubicek_ales @caciolai @PengLiangzu @SukritSumant @Ben_Hoov @FraserGreenlee @RMBattleday @radim_urban @thoefler @jcrwhittington
100
338
82
2,845
509,110
Claude Opus 5.5 in the cloud against DeepSeek-V4.1-Flash on four DGX Sparks: same voxel-world prompt, one try each. Opus built Lumenfall in my Claude Code CLI. The Sparks run @bertholomusai's TensorFold recipe (his EXL3 4.0 bpw quant split across all four Sparks, commit 8f84e7a) and built Aetherfall. Opus 5.5, cloud: done in 33.2 min DeepSeek, 4 Sparks: done in 49.7 min Tokens written, Opus: 173,159 Tokens written, DeepSeek: 121,707 Browser check, Opus: 9.0/10 Browser check, DeepSeek: 9.0/10 Cost, Opus: about $7.82 at API list prices (Anthropic pricing page, Oct 23, 2026), I ran it on my subscription Cost, 4 Sparks: no API bill, my own hardware The worlds are really not that far apart when it comes to quality. The setups differ: the Sparks ran in the locked test container, answer limit 262,144 tokens, in the recipe's neighbor-ring mode on my switchless ring. Opus ran in my own CLI with internet, my files, no time gate and about 71,000 tokens of context before the first answer. Times run from agent start (Sparks) and from sending the prompt (Opus; 26.0 min by the model's own clock file, which started late). Play the Spark world in your browser. Every number, the exact command and the raw output: niklaslenz.com/v2/deepseek-v… New generations from Qwen, DeepSeek and GLM are due in the next days or weeks. I'm curious what their worlds will look like. Recipe, quant and TensorFold fork by @bertholomusai. TensorFold engine by @ashxhart. Model by DeepSeek. Claude by Anthropic. My pick: Lumenfall from the cloud is a better world, but if it has to run at home, bertholomus' 4-Spark ring gives you Aetherfall at the same browser-check score with no API bill.
6
2
17
1,664
Devye retweeted
Elon can predict the future like no one else.
Replying to @Teslarati
The rate of improvement from original GPT to GPT-3 is impressive. If this rate of improvement continues, GPT-5 or 6 could be indistinguishable from the smartest humans. Just my opinion, not an endorsement. I left OpenAI 2 to 3 years ago. Am a neutral outsider at this point.
14
6
164
25,478