Stepped MoE: reducing memory movement in large mixture-of-experts models

 (arxiv.org)

2 points | by arnav1993k 3 hours ago

2 comments

  • Iolaum 3 hours ago
    This may be a very good paper but when I saw Apple regarding the authors org I stopped.
  • arnav1993k 3 hours ago
    [flagged]