Dynamic Semantic Compression for Efficient Latent-Space Inference in Large Language Models
DGX agentarXiv:2609.15338v1 Announce Type: cross Abstract: Large Language Models (LLMs) primarily perform inference at the token level, resulting in substantial memory overhead and compromised computational ef