Paging experts: in offloaded MoE serving, the cheap win is eviction, not routing
When MoE experts live in CPU memory, every miss is a PCIe copy. What copies cost, why sticky routing trades quality for speed, and Belady's rule for experts.
carbonforge.ai