If you think Strata is fast, Think again. @coldniko
HyperCore-Tune is a drop in Optuna Tuner that will produce the perfect tune for Strata on your hardware.
--eng tok/s MAX
--prefill tok/s MAX
--latency ms MIN
max_run<model>.sh
max_run<model>.json
github.com/hypercoreiai/Hype…
HyperCore-CPP is running a 120B parameter model on 2.8 GB RAM With 13000+ Experts loaded in VRAM!!!
github.com/hypercoreiai/Hype…
1
62
Thinking faster is getting easier with Tier 1 decode speeds.github.com/hypercoreiai/Hype…
17
github.com/hypercoreiai/Hype…
Run the Big GGUF models on consumer grade hardware.








