Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient

Summary

This is a publication. If there is no link to the publication on this page, you can try the pre-formated search via the search engines listed on this page.

Authors: Jan Ludziejewski, Maciej Piro, Jakub Krajewski, Maciej Stefaniak, Micha Krutul, Jan Maanicki, Marek Cygan, Piotr Sankowski, Kamil Adamczewski, Piotr Mio, Sebastian Jaszczur

Journal number: 2502.05172

Journal publisher: Maciej Pióro

Published year: 2025