Compander-Aligned Query Geometry for Quantized Zeroth-Order Optimization
DGX agentarXiv:2605.10673v1 Announce Type: new Abstract: Low-bit forward evaluation is an attractive route to memory-efficient zeroth-order (ZO) adaptation: the optimizer needs only scalar losses, and the mode