ASTRA: Communication-Efficient Acceleration for Multi-Device Transformer Inference
DGX agentarXiv:2505.19342v2 Announce Type: replace-cross Abstract: Multi-device inference can reduce Transformer latency by parallelizing computation. However, existing methods require high inter-device bandwi