MCAP: Deployment-Time Layer Profiling for Memory-Constrained LLM Inference
DGX agentarXiv:2604.21026v1 Announce Type: new Abstract: Deploying large language models to heterogeneous hardware is often constrained by memory, not compute. We introduce MCAP (Monte Carlo Activation Profili