Breaking the Bubble: Asynchronous Pipeline Parallel Training with Bounded Weight Inconsistency
arXiv:2606.07881v1 Announce Type: new Abstract: Pipeline parallelism is essential for training large neural networks, but existing schedules trade off throughput, memory, and optimization consistency.