[4] [ arXiv:2608.28511 ](https://arxiv.org/abs/2608.28511 "Abstract") [[pdf](https://arxiv.org/pdf/2608.28511 "Download PDF"), [other](https://arxiv.org/format/2608.28511 "Other formats")]

Abstract

[4] [ arXiv:2608.28511 ](https://arxiv.org/abs/2608.28511 "Abstract") [[pdf](https://arxiv.org/pdf/2608.28511 "Download PDF"), [other](https://arxiv.org/format/2608.28511 "Other formats")] Title: Training Communication-Efficient Mixture-of-Experts Language Models with Layer Re-Configuration [Simeng Sun](https://arxiv.org/search/cs?searchtype=author&query=Sun,+S), [Roger Waleffe](https://arxiv.org/search/cs?searchtype=author&query=Waleffe,+R) Subjects: Artificial Intelligence (cs.AI)