Survey on Recent MoE systems
Table of Contents
Switch Transformer
FastMoE
- link
- https://arxiv.org/pdf/2103.13262.pdf
- author's blog post (in Chinese)
- https://laekov.com.cn/view/6b400a
Tutel
A recent implementation from Microsoft.
A recent implementation from Microsoft.
Email: expye@outlook.com
Date: 2021-11-24 Wed 00:00
Last modified: 2022-01-24 Mon 00:07
Licensed under CC BY-NC 4.0