GEM: A Generative Embedding Model Bridging Reasoning and Retrieval

arXiv:2608.13200v1 Announce Type: cross Abstract: Modern LLMs excel at reasoning and instruction following, enabling users to express complex and diverse information needs. However, conventional retrievers largely rely on surface-level matching between queries and documents, resulting in a growing gap between how users express their needs and how retrievers interpret them. In this paper, we present GEM, a generative embedding model that augments retrieval through its own knowledge by explicitly reasoning about user intent and relevance criteria. GEM unifies generation and embedding within a single model: it first reasons over the query, then appends an embedding token to encode the enriched context for retrieval. zhili{Evaluated on reasoning-intensive and instruction-following retrieval tasks, GEM demonstrates the effectiveness of its reasoning-augmented retrieval, outperforming its non-reasoning variant and matching baselines using substantially larger models.} Furthermore, GEM's generative nature allows test-time compute scaling via prompting to further enhance retrieval performance. Our code is available at: https://anonymous.4open.science/r/GEM.

Related

• SemFlowRAG: Directed Semantic Flow from Abstraction to Evidence for Complex Reasoning
• OThink-SRR1: Search, Refine and Reasoning with Reinforced Learning for Large Language Models
• The Detection-Extraction Gap: Models Know the Answer Before They Can Say It

Source: arXiv cs.AI | 2026-08-14