Search: “context”

In Line with Context: Repository-Level Code Generation via Context Inlining

arXiv:2601.00376v2 Announce Type: replace-cross Abstract: Repository-level code generation has attracted growing attention in recent years. Unlike function-level code generation, it requires the model

1 May 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

SinkRouter: Sink-Aware Routing for Efficient Long-Context Decoding in Large Language and Multimodal Models

DGX agent

arXiv:2604.16883v1 Announce Type: new Abstract: In long-context decoding for LLMs and LMMs, attention becomes increasingly memory-bound because each decoding step must load a large amount of KV-cache

model-releasesarxiv-cs-lg

21 Apr 2026

KV Cache Offloading for Context-Intensive Tasks

arXiv:2604.08426v1 Announce Type: cross Abstract: With the growing demand for long-context LLMs across a wide range of applications, the key-value (KV) cache has become a critical bottleneck for both

Local Ai

DP-MIND: Differentially private memory-guided Long context Inference

arXiv:2610.13132v1 Announce Type: new Abstract: LLM-as-a-Service has become a dominant paradigm for accessing large language models without requiring local deployment. However, the process raises seve

local-aiarxiv-cs-ai

12 Oct 2026

MMLongCite: A Benchmark for Evaluating Faithfulness of Long-Context Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2510.13276v2 Announce Type: replace Abstract: The rapid advancement of long-context vision language models (LCVLMs) has led to a significant expansion of their context windows. However, an exten

6 Oct 2026

Agents

The Optimization Landscape of Learning Compacted Context Models

arXiv:2610.05885v1 Announce Type: new Abstract: Many works approach continual learning through the lens of infinite context windows. As an agent puts more observation into context (concretely the KV c

agentsarxiv-cs-lg

6 Oct 2026

CoEM: Empowering Long-Context Reasoning with Commit-on-Evidence Memory

arXiv:2609.36935v1 Announce Type: new Abstract: Long-context reasoning is essential for complex and long-horizon tasks, yet the performance of large language models (LLMs) degrades as context length i

safetyarxiv-cs-ai

30 Sept 2026

SpectralShift: Effective Context Window Extension of Gated DeltaNet via Spectral Reparameterization

arXiv:2609.14320v1 Announce Type: new Abstract: Recently, linear attention layers have been increasingly adopted to replace softmax attention at scale for long-context modeling. However, existing cont

15 Sept 2026

Towards Evolving Context Parameterization for Large Language Models

arXiv:2609.14168v1 Announce Type: cross Abstract: Context parameterization enables large language models (LLMs) to internalize contexts into reusable model parameters, avoiding repeated processing acr

15 Sept 2026

Mixing Makes Markovian Contexts Cheap for Linear Bandits

arXiv:2603.12530v3 Announce Type: replace Abstract: Recent work shows that when contexts are drawn i.i.d., linear contextual bandits can be reduced to single-context linear bandits. This ``contexts ar

safetyarxiv-cs-lg

9 Sept 2026

Beyond Context Windows: Persistent Discovery Context for Data-Centric Agents

arXiv:2609.02129v1 Announce Type: new Abstract: Data-centric agents repeatedly perform a discovery step before planning or execution: identifying the data objects relevant to a task. Yet successful di

3 Sept 2026

Agents

Context Inference Attacks Without Jailbreaks

arXiv:2609.01663v1 Announce Type: cross Abstract: Agentic AI systems are increasingly deployed to process sensitive data at inference time, such as healthcare records or financial documents assembled

agentsarxiv-cs-lg

3 Sept 2026

DIP: Dynamic In-Context Planner For Diffusion Language Models

arXiv:2601.03199v2 Announce Type: replace-cross Abstract: Diffusion language models (DLMs) have shown strong potential for general natural language tasks with in-context examples. Existing In-Context

1 Sept 2026

Agents

ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL

arXiv:2608.28476v1 Announce Type: new Abstract: Long-horizon agentic tasks require large language models (LLMs) to iteratively retrieve, integrate, and maintain dispersed information across multi-turn

agentsarxiv-cs-cl

31 Aug 2026

HyMem: Hierarchical Context Management for Long-Horizon Agents via Information Isolation

arXiv:2608.15703v1 Announce Type: new Abstract: Large language model (LLM) agents often perform poorly on complex, long-horizon tasks because their context becomes increasingly cluttered over time. As

18 Aug 2026

CLBench-V: Evaluating Multimodal Context Learning from Grounding to Knowledge Acquisition

arXiv:2607.25294v1 Announce Type: cross Abstract: Real-world tasks often require models to learn from task-specific context rather than relying only on pre-trained knowledge. While recent work has hig

29 Jul 2026

ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning

arXiv:2607.02509v1 Announce Type: new Abstract: Understanding and reasoning over long contexts has become a key requirement for deploying large language models (LLMs) in realistic applications. Althou

3 Jul 2026

How to Train Your Long-Context Visual Document Model

arXiv:2602.15257v3 Announce Type: replace-cross Abstract: We present the first comprehensive, large-scale study of training long-context vision language models up to 344K context, targeting long-docum

30 Jun 2026

Applications

MATCH: Modulating Attention via In-Context Retrieval for Long-Context Transformers

arXiv:2606.29844v1 Announce Type: cross Abstract: The quadratic computational cost of traditional attention mechanisms poses a major bottleneck to the scalability and practical deployment of large lan

applicationsarxiv-cs-ai

30 Jun 2026

Which Tokens Need Context? A Reference-Based Analysis of Translation Responsibility Using Fertility and Entropy

arXiv:2606.29489v1 Announce Type: new Abstract: When humans translate, not every word depends equally on the surrounding context. Some tokens, particularly function words like pronouns and auxiliaries

researcharxiv-cs-cl

30 Jun 2026

Local Ai

LLMs Prompted for Legal Context Object More: Overrefusal from Small On-Premises LLMs in Criminal Legal Context

arXiv:2606.24585v1 Announce Type: new Abstract: While the validity of LLMs' use in the legal context remains subject to ethical and legal debate, legal professionals are already experimenting with per

local-aiarxiv-cs-ai

24 Jun 2026

From Context-Aware to Conflict-Aware: Generalizing Contrastive Decoding for Knowledge Conflict in LLMs

arXiv:2606.10298v1 Announce Type: new Abstract: When large language models generate from retrieved or augmented contexts, conflicts between external context and parametric priors remain a central reli

10 Jun 2026

SoLoPO: Unlocking Long-Context Capabilities in LLMs via Short-to-Long Preference Optimization

arXiv:2505.11166v3 Announce Type: replace-cross Abstract: Despite advances in pretraining with extended context sizes, large language models (LLMs) still face challenges in effectively utilizing real-

safetyarxiv-cs-ai

4 Jun 2026

Context-Augmented Code Generation: How Product Context Improves AI Coding Agent Decision Compliance by 49%

arXiv:2605.08112v1 Announce Type: cross Abstract: AI coding agents powered by large language models can read codebases and produce functional code, but they routinely violate team-specific product dec

12 May 2026

Local Ai

Semantic Context-aware mOdality fUsion Transformer (SCOUT): A Context-Aware Multimodal Transformer for Concept-Grounded Pathology Report Generation

arXiv:2605.01144v1 Announce Type: new Abstract: Whole-slide images (WSIs) present a fundamental challenge for computational pathology due to their extreme resolution, multi-scale heterogeneity, and th

local-aiarxiv-cs-cv

5 May 2026

Flux Attention: Context-Aware Hybrid Attention for Efficient LLMs Inference

arXiv:2604.07394v1 Announce Type: cross Abstract: The quadratic computational complexity of standard attention mechanisms presents a severe scalability bottleneck for LLMs in long-context scenarios. W

HiCI: Hierarchical Construction-Integration for Long-Context Attention

arXiv:2603.20843v2 Announce Type: replace Abstract: Long-context language modeling is commonly framed as a scalability challenge of token-level attention, yet local-to-global information structuring r

Knowing When to Stop: Efficient Context Processing via Latent Sufficiency Signals

arXiv:2502.01025v4 Announce Type: replace Abstract: Large language models (LLMs) process entire input contexts indiscriminately, which is inefficient when the information required to answer a query is

12 Oct 2026

Decoupling Memory from Context: Structured Memory for Token-Efficient Test-Time Continual Learning

arXiv:2610.02687v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in enterprise, scientific, and medical applications, where agents must incorporate domain-specifi

5 Oct 2026

Capturing In-Context Learning Dynamics with Task Operators

arXiv:2610.01054v1 Announce Type: cross Abstract: In-context learning (ICL) enables language models to perform new tasks from demonstrations without weight updates. However, every ICL inference requir

2 Oct 2026

Scaling Parameter and Context in Attention: Native Sparse Attention from Mixture-of-Head

arXiv:2609.38832v1 Announce Type: new Abstract: Scaling attention parameters can improve language model quality, but retaining full token histories makes additional heads costly at long contexts. Furt

1 Oct 2026

A Benchmarking Framework for Context-aware XR Interfaces

arXiv:2609.30466v1 Announce Type: cross Abstract: Everyday Extended Reality (XR) systems aim to provide context-aware access to the right functionalities at the right time and place, with minimal manu

28 Sept 2026

ContextPipe: Database-Inspired Context Assembly for Long-Horizon Agents

arXiv:2609.00749v1 Announce Type: new Abstract: Long-horizon large language model (LLM) agents require context assembly: the runtime must decide what to include in each prompt, in what order, and when

2 Sept 2026

LatentPress: Context Compression Beyond Text and Vision

arXiv:2609.01507v1 Announce Type: cross Abstract: Compressed context is usually carried as human-readable text or as rendered images that must be decoded, even when its consumer is a language model. W

2 Sept 2026

A Robust In-Context Model for Conservation Laws: Injecting Context into Flux Neural Operators via Recurrent Vision Transformers

arXiv:2605.05488v2 Announce Type: replace Abstract: We propose an architecture that augments the Flux Neural Operator (Flux NO), which combines the classical finite volume method (FVM) with neural ope

researcharxiv-cs-lg

21 Aug 2026

In-Context VLA: Endowing Vision-Language-Action Models with Language via In-Context Post-Training and Agentic Tool Use

arXiv:2608.05738v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have become the dominant recipe for generalist manipulation, yet they are almost universally trained by behavior clo

safetyarxiv-cs-ro

7 Aug 2026

ACE-GraphRAG: Agentic Context Engineering for Hierarchical GraphRAG

arXiv:2608.01269v1 Announce Type: new Abstract: Hierarchical Graph Retrieval-Augmented Generation (GraphRAG) organizes corpus knowledge at multiple levels of granularity, yet fixed context constructio

safetyarxiv-cs-cl

4 Aug 2026

Gradient-free Task-Conditioned Retrieval for On-Device In-Context Learning

arXiv:2607.27766v1 Announce Type: new Abstract: On-device in-context learning (ICL) relies on pre-inference retrieval to select demonstrations for useful context before downstream model inference. Thi

31 Jul 2026

Mergeable Model-Side Aggregation States for Long-Context Language Models

arXiv:2607.26448v1 Announce Type: new Abstract: A known limitation of long-context language models is their increasingly unreliable performance in non-additive, set-based aggregation as context length

30 Jul 2026

Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation

model-releasesarxiv-cs-cv

arXiv:2606.26907v1 Announce Type: new Abstract: While text-to-image (T2I) models have achieved remarkable progress, they struggle with real-world requests that are often underspecified, implicit, or d

26 Jun 2026

Retrieval and Multi-Hop Reasoning in 1M-Token Context Windows: Evaluating LLMs on Classical Chinese Text

arXiv:2605.02173v1 Announce Type: new Abstract: We evaluate the long-context retrieval and reasoning capabilities of five frontier large language models with advertised 1M-token context windows on a c

6 May 2026

Investigation into In-Context Learning Capabilities of Transformers

model-releasesarxiv-cs-lg

arXiv:2604.25858v1 Announce Type: new Abstract: Transformers have demonstrated a strong ability for in-context learning (ICL), enabling models to solve previously unseen tasks using only example input

29 Apr 2026

Applications

Overcoming the Modality Gap in Context-Aided Forecasting

arXiv:2603.12451v3 Announce Type: replace Abstract: Context-aided forecasting (CAF) holds promise for integrating domain knowledge and forward-looking information, enabling AI systems to surpass tradi

applicationsarxiv-cs-lg

23 Apr 2026

Applications

RASP-Tuner: Retrieval-Augmented Soft Prompts for Context-Aware Black-Box Optimization in Non-Stationary Environments

arXiv:2604.18026v1 Announce Type: new Abstract: Many deployed systems expose black-box objectives whose minimizing configuration shifts with an externally observed context. When contexts revisit a sma

applicationsarxiv-cs-lg

21 Apr 2026

Stacked from One: Multi-Scale Self-Injection for Context Window Extension

arXiv:2603.04759v2 Announce Type: replace Abstract: The limited context window of contemporary large language models (LLMs) remains a primary bottleneck for their broader application across diverse do

TICDA: Tabular In-Context Data Attribution

arXiv:2610.07996v1 Announce Type: cross Abstract: Tabular foundation models (TFMs) achieve strong predictive performance by conditioning on labeled demonstrations provided in context, without any para

7 Oct 2026

Retrieval-Based In-Context Learning: A Domain Adaptation Framework

arXiv:2610.05717v1 Announce Type: cross Abstract: In-context retrieval (ICR) is a retrieval-based form of in-context learning (ICL) in which demonstrations are retrieved from a source database based o

researcharxiv-cs-lg

6 Oct 2026

RoPE at the End of Its Rope? Theory, Diagnosis, and Mitigation of Long-Context Failures

arXiv:2609.39929v1 Announce Type: cross Abstract: Long-context failures of RoPE-based language models can arise from RoPE's intrinsic tradeoff between maintaining stable token preferences and distingu