Gradient Under Microscope: Benchmarking Resource Utilization of Memory-Efficient Gradient Computation Methods
DGX agentarXiv:2608.08961v1 Announce Type: new Abstract: AI training's rising resource intensity is straining electricity supplies and carbon budgets, motivating systematic study of memory-efficient training o