Search: “context”

LISA: Linear-Indexed Sparse Attention for Efficient Long-Context Reasoning

arXiv:2607.19358v1 Announce Type: new Abstract: Recent advances in long chain-of-thought reasoning models such as DeepSeek-R1 have led to increasingly longer inference context lengths under the test-t

23 Jul 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Evidence Recomposition and Predictive Context Residualization for Visual Attribution in Multimodal Large Language Models

DGX agent

arXiv:2509.22415v3 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have achieved strong vision-language performance, yet their token-level visual evidence remains diffi

researcharxiv-cs-ai

15 Jul 2026

Tutorials

Enhancing In-context Panoramic Generation via Geometric-aware Pretraining

arXiv:2607.08765v1 Announce Type: new Abstract: In this work, we present Canvas360, a two-stage framework for in-context panoramic generation that combines geometry-aware pretraining with downstream t

tutorialsarxiv-cs-cv

10 Jul 2026

The Context Access Divide: Interaction-Level Architecture as a Complementary Dimension of Agentic Inequality

arXiv:2607.08495v1 Announce Type: cross Abstract: Sharp et al. (2025) introduce 'agentic inequality' as a framework for analyzing disparities in access to AI agents across three dimensions: availabili

10 Jul 2026

Training and Evaluating Diffusion Policies with Long Context Lengths

arXiv:2606.16447v2 Announce Type: replace-cross Abstract: Imitation learning has enabled highly-dexterous robotic manipulation from RGB observations. Policies trained with these methods, however, typi

10 Jul 2026

Benchmarking KV-Cache Optimizations across Task Quality and System Performance for Long-Context Serving

arXiv:2607.05399v1 Announce Type: cross Abstract: Large language model serving is increasingly limited by KV-cache growth under long-context workloads, yet existing KV-cache compression techniques are

8 Jul 2026

A Unified Framework for In-Context Learning with Causal and Masked Language Models

arXiv:2607.04081v1 Announce Type: new Abstract: In-context learning (ICL) has emerged as a central capability of pretrained language models, yet its theoretical analysis has focused primarily on causa

7 Jul 2026

Context-Constrained Transfer Learning for Tabular Foundation Models via Data Distillation

arXiv:2607.04809v1 Announce Type: cross Abstract: Tabular Foundation Models (TFMs) have demonstrated strong empirical performance as black-box inference engines through in-context learning. However, t

7 Jul 2026

Tutorials

Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communications

arXiv:2502.12096v5 Announce Type: replace-cross Abstract: In this paper, we introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in gener

tutorialsarxiv-cs-cv

7 Jul 2026

Gavel: Agent Meets Checklist for Evaluating LLMs on Long-Context Legal Summarization

arXiv:2601.04424v2 Announce Type: replace Abstract: Large language models (LLMs) now support contexts of up to 1M tokens, but their strengths and weaknesses on complex long-context tasks remain unclea

agentsarxiv-cs-cl

2 Jul 2026

MosaicKV: Serving Long-Context LLM with Dynamic Two-D KV Cache Compression

arXiv:2607.00760v1 Announce Type: new Abstract: Long-context LLM services now sustain prompts with hundreds of thousands to millions of tokens, making the key-value (KV) cache a first-order serving co

hardwarearxiv-cs-lg

2 Jul 2026

ACE: Pluggable Adaptive Context Elasticizer across Agents

arXiv:2606.31564v1 Announce Type: new Abstract: The increasing complexity of agentic tasks has led to rapidly growing trajectory lengths, which poses significant challenges for large language model (L

InfoFlow KV: Information-Flow-Aware KV Recomputation for Long Context

arXiv:2603.05353v2 Announce Type: replace Abstract: Retrieval-augmented generation (RAG) for long-context question answering is bottlenecked by inference-time prefilling over large retrieved contexts.

SeKV: Resolution-Adaptive KV Cache with Hierarchical Semantic Memory for Long-Context LLM Inference

arXiv:2606.31145v1 Announce Type: new Abstract: Large language models increasingly operate over long contexts, where the KV cache becomes a dominant memory bottleneck: its size grows linearly with seq

hardwarearxiv-cs-cl

Safety

Vision-Language Procedural Reasoning for Context-Aware Reward Modeling of Robotic Endovascular Guidewire Navigation

arXiv:2606.30698v1 Announce Type: new Abstract: Robotic-assisted endovascular interventions demand accurate, stable, and context-aware guidewire navigation in complex and patient-specific vascular ana

safetyarxiv-cs-ro

The Context-Ready Transformer

arXiv:2606.27538v1 Announce Type: cross Abstract: We introduce the context-ready transformer, a new recurrent neural network architecture built from a D-layer transformer block that pre-contextualizes

hardwarearxiv-cs-ai

29 Jun 2026

ToxiREX: A Dataset on Toxic REasoning in ConteXt

arXiv:2606.27981v1 Announce Type: new Abstract: We introduce a new, contextual, multilingual dataset called ToxiREX: Toxic REasoning in ConteXt. The dataset consists of threads of Reddit comments and

29 Jun 2026

Beyond Model Size: Probing the Gaps in Visual in-Context Learning by Training a Tiny Model

model-releasesarxiv-cs-cv

arXiv:2606.10905v1 Announce Type: new Abstract: Visual in-Context Learning (VICL) aims at making progress towards adaptive vision models, that can -- based on a few examples -- adapt to a new task at

10 Jun 2026

ContextShift: A Controlled Benchmark for Context Dependence in Object Detection

model-releasesarxiv-cs-cv

arXiv:2606.09495v1 Announce Type: new Abstract: Modern object detectors achieve strong performance on standard benchmarks, yet their robustness to contextual variation remains insufficiently understoo

FlashCP: Load-Balanced Communication-Efficient Context Parallelism for LLM Training

arXiv:2606.08476v1 Announce Type: cross Abstract: Context parallelism (CP) is essential for training large-scale, long-context language models, as it partitions sequences to reduce memory overhead. Ho

FlashMemory-DeepSeek-V4: Lightning Index Ultra-Long Context via Lookahead Sparse Attention

arXiv:2606.09079v1 Announce Type: cross Abstract: Conventional LLMs keep the full KV cache loaded during decoding, causing a severe GPU memory bottleneck for ultra-long context serving. In this report

Generalizing Geometry-Guided Mamba as a Plug-and-Play Context Module for CNN-based Semantic Segmentation

arXiv:2606.08866v1 Announce Type: new Abstract: CNN-based semantic segmentation networks usually rely on context heads such as ASPP, PPM, or attention modules to enlarge the receptive field. These hea

researcharxiv-cs-cv

In-Context Reinforcement Learning via Communicative World Models

arXiv:2508.06659v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) agents often struggle to generalize to new tasks and contexts without updating their parameters, mainly because th

Revising Context, Shifting Simulated Stance: Auditing LLM-Based Stance Simulation in Online Discussions

arXiv:2606.06443v1 Announce Type: new Abstract: Large language models are increasingly used to simulate social media users and infer how individuals may respond to online discussions. However, it rema

5 Jun 2026

Activation-Based Active Learning for In-Context Learning: Challenges and Insights

arXiv:2606.05134v1 Announce Type: new Abstract: Deep active learning has previously been explored for LLM in-context sample selection, but not with methods that utilise recent advances in understandin

4 Jun 2026

Discourse-Role Labels as Presentation-Time Variables for Context Use in Language Models

arXiv:2606.04109v1 Announce Type: new Abstract: Context-augmented language model systems often wrap supplied content with labels such as Reference:, Evidence:, Instruction:, Note:, or Example:, but th

4 Jun 2026

KACE: Knowledge-Adaptive Context Engineering for Mathematical Reasoning

arXiv:2606.00532v1 Announce Type: new Abstract: Context engineering can improve large language models without updating their weights, but mathematical reasoning exposes a key limitation: feedback accu

2 Jun 2026

ReTabAD: A Benchmark for Restoring Semantic Context in Tabular Anomaly Detection

arXiv:2510.02060v2 Announce Type: replace Abstract: In tabular anomaly detection (AD), textual semantics often carry critical signals, as the definition of an anomaly is closely tied to domain-specifi

1 Jun 2026

Long-Context Modeling with Dynamic Hierarchical Sparse Attention for Memory-Constrained LLM Inference

arXiv:2510.24606v2 Announce Type: replace Abstract: The quadratic cost of attention limits the scalability of long-context LLMs, especially under limited hardware memory budgets. While attention is of

29 May 2026

Loong: A Human-Like Long Document Translation Agent with Observe-and-Act Adaptive Context Selection

arXiv:2605.30274v1 Announce Type: cross Abstract: Document-level translation remains one of the most challenging tasks for large language models, which are constrained by limited context windows that

29 May 2026

Mixing Mechanisms: How Language Models Retrieve Bound Entities In-Context

arXiv:2510.06182v2 Announce Type: replace Abstract: A key component of in-context reasoning is the ability of language models (LMs) to bind entities for later retrieval. For example, an LM might repre

29 May 2026

Understanding Generalization and Forgetting in In-Context Continual Learning

model-releasesarxiv-cs-lg

arXiv:2605.28705v1 Announce Type: new Abstract: In-context learning (ICL) derives its power from enabling Large Language Models to adapt to new tasks via prompt-based reasoning alone, entirely bypassi

28 May 2026

ICICLE: Expanding Retrieval with In-Context Documents

arXiv:2605.26902v1 Announce Type: cross Abstract: Generative retrieval (GR) maps queries directly to document identifiers (docids) using parametric knowledge, However, this design makes corpus expansi

27 May 2026

RepoMirage: Probing Repository Context Reasoning in Code Agents with Perturbations

arXiv:2605.26177v1 Announce Type: cross Abstract: Code agents are currently having skillful performance on repository-level software engineering benchmarks, but it remains unclear whether success on e

27 May 2026

Advancing Graph Few-Shot Learning via In-Context Learning

arXiv:2605.24410v1 Announce Type: new Abstract: Graph few-shot learning, which aims to classify nodes from novel classes with only a few labeled examples, is a widely studied problem in graph learning

26 May 2026

Latent Q-Barrier Shielding for Safe In-Context Reinforcement Learning

arXiv:2605.25267v1 Announce Type: cross Abstract: Safe in-context reinforcement learning (ICRL) adapts online from interaction history without test-time parameter updates while controlling episode cos

26 May 2026

Automatic Contextual Audio Denoising

model-releasesarxiv-cs-lg

arXiv:2605.22262v1 Announce Type: cross Abstract: Audio context determines which sound components and sources are relevant and which can be perceived as irrelevant (noise) by listeners. For example, t

23 May 2026

More Context, Larger Models, or Moral Knowledge? A Systematic Study of Schwartz Value Detection in Political Texts

arXiv:2605.22641v1 Announce Type: new Abstract: Detecting Schwartz values in political text is difficult because implicit cues often depend on surrounding arguments and fine-grained distinctions betwe

22 May 2026

Retrospective Sparse Attention for Efficient Long-Context Generation

arXiv:2508.09001v2 Announce Type: replace Abstract: Large Language Models (LLMs) are increasingly deployed in long-context tasks such as reasoning, code generation, and multi-turn dialogue. However, i

21 May 2026

TabQL: In-Context Q-Learning with Tabular Foundation Models

arXiv:2605.18979v1 Announce Type: new Abstract: We propose Tabular Q-Learning (TabQL), a reinforcement learning framework that replaces the conventional parametric Q-network in Deep Q-Learning (DQN) w

20 May 2026

Easier to Judge than to Find: Predicting In-Context Learning Success for Demonstration Selection

arXiv:2605.18512v1 Announce Type: new Abstract: In-context learning (ICL) is highly sensitive to which demonstrations appear in the prompt, but selecting them is expensive because the space of possibl

19 May 2026

KVDrive: A Holistic Multi-Tier KV Cache Management System for Long-Context LLM Inference

arXiv:2605.18071v1 Announce Type: new Abstract: Supporting long-context LLMs is challenging due to the substantial memory demands of the key-value (KV) cache. Existing offloading systems store the ful

hardwarearxiv-cs-cl

19 May 2026

X-SYNTH: Beyond Retrieval -- Enterprise Context Synthesis from Observed Human Attention

arXiv:2605.15505v1 Announce Type: new Abstract: In enterprise operations, the context required for an AI agent task is scattered across systems of record, static information stores, and communication

18 May 2026

KV-Fold: One-Step KV-Cache Recurrence for Long-Context Inference

arXiv:2605.12471v1 Announce Type: cross Abstract: We introduce KV-Fold, a simple, training-free long-context inference protocol that treats the key-value (KV) cache as the accumulator in a left fold o

13 May 2026

Composing diffusion priors with explicit physical context via generative Gibbs sampling

arXiv:2605.10642v1 Announce Type: new Abstract: Pretrained diffusion models provide powerful learned priors, but in scientific sampling the target distribution often depends on physical context that i

Safety

Large Language Models for Sequential Decision-Making: Improving In-Context Learning via Supervised Fine-Tuning

arXiv:2605.09009v1 Announce Type: cross Abstract: Large language models (LLMs) have shown remarkable in-context learning (ICL) capabilities, yet their potential for sequential decision-making remains

safetyarxiv-cs-ai

Safety

Make Each Token Count: Towards Improving Long-Context Performance with KV Cache Eviction

arXiv:2605.09649v1 Announce Type: new Abstract: The key-value (KV) cache is a major bottleneck in long-context inference, where memory and computation grow with sequence length. Existing KV eviction m

safetyarxiv-cs-lg

No Mean Feat: Simple, Strong Baselines for Context Compression

arXiv:2510.20797v2 Announce Type: replace-cross Abstract: Context compression reduces Transformer inference costs by replacing lengthy inputs with shorter pre-computed representations. It carries sign