1/8) Excited to share PR²: Predictive Routing Replay for MoE-Based LLM RL! 🎉
This is also the first paper from our research group at @RutgersCS@RutgersU.
While MoE LLMs scale remarkably well, RL training exposes a hidden source of instability: routing.
Paper: arxiv.org/abs/2606.00395
A special shout-out to my talented PhD student, @DaizeDongCS, for leading this project and driving many of its key ideas and experiments.