国产大模型鉴定不易走权重开源路线
Today, we’re releasing the open weights for Hy4.
Our natively multimodal flagship MoE (770B total / 49B active, 1M context).
Alongside the Hy4 System Card with a comprehensive safety evaluation report.
➡️ Join the Hy team for a live AMA this Friday, 8–10 AM PT on r/LocalLLaMA—drop any questions about Hy models and chat with us directly!
GitHub: github.com/Tencent-Hunyuan/H…
Weights: huggingface.co/tencent/Hy4
GGUF:huggingface.co/AngelSlim/Hy4…
License: huggingface.co/tencent/Hy4/b…
System Card: hy.tencent.ai/Hy4_system_car…
8
Devye retweeted
Today, we’re releasing the open weights for Hy4.
Our natively multimodal flagship MoE (770B total / 49B active, 1M context).
Alongside the Hy4 System Card with a comprehensive safety evaluation report.
➡️ Join the Hy team for a live AMA this Friday, 8–10 AM PT on r/LocalLLaMA—drop any questions about Hy models and chat with us directly!
GitHub: github.com/Tencent-Hunyuan/H…
Weights: huggingface.co/tencent/Hy4
GGUF:huggingface.co/AngelSlim/Hy4…
License: huggingface.co/tencent/Hy4/b…
System Card: hy.tencent.ai/Hy4_system_car…
🚀 Inkling-2-Small deployed on a 4× NVIDIA DGX Spark cluster with 200GbE RoCE interconnect (TP4)!
Benchmarked coding, prose, and JSON workloads across 120 requests with 100% API completion.
⚡ Peak throughput: 121.9 tokens/s
🎯 75-question QEval: 74/75 (98.7%)
🧠 Model: Inkling-2-Small by @thinkymachines
Excellent work by Scott Biggart on the distributed TP4 implementation!
🔗 GitHub: github.com/swbiggart/inkling…
🤗 Model: huggingface.co/thinkingmachi…
My first local AI recipe is out!
Inkling-2-Small on 4× DGX Spark, using Thinking Machines’ original checkpoint weights, with no additional weight quantization. Built on TensorFold with DSpark speculative decoding.
My measurements:
• Single stream with DSpark: 70 tok/s on tool calls, 61 on code, 56 on thinking (31 plain)
• 4 concurrent streams: ~101 tok/s combined at the default settings
• First token at 2K: 1.3 s cold, ~0.2 s cached
• Context up to 1M tokens
github.com/swbiggart/inkling…
Thanks to @thinkymachines for the weights, and @ashxhart + the @tensorfold_dev contributors for the engine.
Would love independent runs and feedback!
这个模型有OpenAI的血脉,应该还有潜力可以挖掘
Inkling-2-Small on two DGX spark, with TideLM.
I used the prompt, thanks @semichenkko for awesome prompt!
teapawt.org/semichenkko/status/212…
It worked very well. It follows the prompt. I think Inkling 2 small is competitive enough to DSv4.1 and GLM 5.3 full.
1
33






















