BudgetMem: Training-Free Selective Memory for Cost-Efficient Long-Context Processing in Language Models
arXiv:2511.04919v3 Announce Type: replace Abstract: Processing long documents with large language models (LLMs) is expensive: a single query over a 100K-token document can cost from tens of cents to o