Survey on Recent MoE systems

Table of Contents

Background

MoE

Switch Transformer

FastMoE

Tutel

link
https://github.com/microsoft/tutel

A recent implementation from Microsoft.

Author: expye(Zihao Ye)

Email: expye@outlook.com

Date: 2021-11-24 Wed 00:00

Last modified: 2022-09-23 Fri 00:04

Licensed under CC BY-NC 4.0