LaCy: What Small Language Models Can and Should Learn is Not Just a Question of Loss
This paper was accepted at the Workshop on Memory for LLM-Based Agentic Systems at ICLR. Language models have consistently grown to compress more world knowledge into their parameters, but the knowled