One-Step Gradient Delay is Not a Barrier for Large-Scale Asynchronous Pipeline Parallel LLM Pretraining
Paper LLMs & Texto

One-Step Gradient Delay is Not a Barrier for Large-Scale Asynchronous Pipeline Parallel LLM Pretraining

Asynchronous pipeline parallelism with PipeDream-2BW can achieve near-synchronous performance through optimizer selection and error feedback correction, overcoming traditional stab…

Hugging Face · Daily Papers ·Philip Zmushko, Egor Petrov · ·▲ 19 upvotes

Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.

Autores: Philip Zmushko, Egor Petrov, Nursultan Abdullaev, Mikhail Khrushchev, Samuel Horváth

  • 19 upvotes da comunidade
  • Temas: Pipeline Parallelism, asynchronous implementations, gradient staleness, PipeDream-2BW, AdamW, Muon

Resumo

Resumo original (em inglês), extraído do paper:

Asynchronous pipeline parallelism with PipeDream-2BW can achieve near-synchronous performance through optimizer selection and error feedback correction, overcoming traditional stability concerns.

Onde ler

compartilhar: