Not All Models Suit Expert Offloading: On Local Routing Consistency of Mixture-of-Expert Models.

Thu, 01 May 2025 01:00:00 +0200

Jingcong Liang , Siyuan Wang, Miren Tian, Yitong Li, Duyu Tang, Zhongyu Wei:
Not All Models Suit Expert Offloading: On Local Routing Consistency of Mixture-of-Expert Models. CoRR abs/2505.16056 (2025)