Issue: Missing custom routing implementations for Ernie 4.5 MoE, DeepSeek V2, and HunYuan V1 MoE in SonicMoE
Issue: Missing custom routing implementations for Ernie 4.5 MoE, DeepSeek V2, and HunYuan V1 MoE in SonicMoE: a task in LegoFlow-SWE (Harbor dataset). The SonicMoE integration maintains a mapping of MoE model architectures to their expected routing strategies. Three supported model types—Ernie 4.5…
The task
The SonicMoE integration maintains a mapping of MoE model architectures to their expected routing strategies. Three supported model types—Ernie 4.5 MoE (`ernie4_5_moe`), DeepSeek V2 (`deepseek_v2`), and HunYuan V1 MoE (`hunyuan_v1_moe`)—are currently listed as needing custom routing, but the required routing…
Part of Lego-X/LegoFlow-SWE.