Search: “context”

Function-Vector Heads Are Two Populations: Writers and Cancellers in In-Context Learning

arXiv:2606.07560v1 Announce Type: cross Abstract: Function-vector (FV) heads (Todd et al., 2024) are typically identified by the magnitude of their causal contribution to in-context rule tasks, under

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Graph2Idea:Retrieval-Augmented Scientific Idea Generation with Graph-Structured Contexts

DGX agent

arXiv:2606.09105v1 Announce Type: new Abstract: Generating novel, feasible, and high-quality research ideas is an important yet challenging task in scientific discovery.Recent Large Language Model (LL

model-releasesarxiv-cs-ai

9 Jun 2026

How Much Dense Attention is Necessary? Oracle-Guided Sparse Prefill for Full/GQA Layers in Hybrid Long-Context Models

arXiv:2606.07703v1 Announce Type: cross Abstract: Long-context prefill remains expensive because full/GQA layers still score the historical sequence, even in hybrid models with local, sparse, linear,

In-Context Learning of Temporal Point Processes with Foundation Inference Models

model-releasesarxiv-cs-lg

arXiv:2509.24762v3 Announce Type: replace Abstract: Modeling event sequences of multiple event types with marked temporal point processes (MTPPs) provides a principled way to uncover governing dynamic

Applications

Multi-View Speech Representation Learning for Parkinson's Disease Detection Using Context-guided Cross-modal Attention

arXiv:2606.09271v1 Announce Type: cross Abstract: Parkinson's disease (PD) is a progressive neurodegenerative disorder that frequently causes speech impairments associated with hypokinetic dysarthria.

applicationsarxiv-cs-lg

Robust In-Context Reinforcement Learning Under Reward Poisoning Attacks

arXiv:2506.06891v3 Announce Type: replace Abstract: We study the corruption-robustness of in-context reinforcement learning (ICRL), focusing on the Decision-Pretrained Transformer (DPT, Lee et al., 20

The Effect of Training Task Diversity on In-Context Learning through the Lens of Low-Dimensional Subspaces

arXiv:2606.06814v1 Announce Type: cross Abstract: The transformer's emergent ability to perform in-context learning (ICL) has sparked a wide range of studies designed to understand its underlying mech

8 Jun 2026

A Taxonomy of Runtime Faults in Model Context Protocol Servers

arXiv:2606.05339v1 Announce Type: cross Abstract: MCP (Model Context Protocol) enables LLMs (Large Language Models) to interact with external tools and data sources via a standardized protocol. Its ra

6 Jun 2026

LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agents

arXiv:2606.06087v1 Announce Type: new Abstract: Agent systems increasingly use textual skills to encode reusable task procedures, but injecting these skills into the prompt at every step incurs substa

5 Jun 2026

Good Reasoning Makes Good Demonstrations: Implicit Reasoning Quality Supervision via In-Context Reinforcement Learning

arXiv:2603.09803v2 Announce Type: replace Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in large language models but treats all correct solutions equally, potentia

safetyarxiv-cs-lg

4 Jun 2026

CP-Agent: Context-Aware Multimodal Reasoning for Cellular Morphological Profiling under Chemical Perturbations

arXiv:2606.03435v1 Announce Type: new Abstract: Cell Painting combines multiplexed fluorescent staining, high-content imaging, and quantitative analysis to generate high-dimensional phenotypic readout

3 Jun 2026

ACON: Optimizing Context Compression for Long-horizon LLM Agents

arXiv:2510.00615v3 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed as agents in dynamic real-world environments, where success depends on maintaining precise re

CART: Context-Anchored Recurrent Transformer -- A Parameter-Efficient Architecture with Learned Stability

arXiv:2606.01495v1 Announce Type: cross Abstract: We present CART (Context-Anchored Recurrent Transformer), a parameter-efficient language model that reuses a single shared core block R times across d

Images as Tables: In-Context Learning with TabPFN for Low-Data Detection of AI-Generated Images

arXiv:2606.00872v1 Announce Type: new Abstract: AI-generated image detection is a moving-target problem: detectors trained on one generator often fail when a new generator appears, and only a few labe

researcharxiv-cs-cv

Resonant Context Anchoring: Decoupling Attention Routing and Signal Gain at Inference Time

arXiv:2606.01923v1 Announce Type: new Abstract: Large Language Models (LLMs) frequently exhibit 'contextual disregard' when faced with input evidence that conflicts with their internal parametric memo

Structured Semantic Information Helps Retrieve Better Examples for In-Context Learning Applied to Few-Shot Relation Extraction

arXiv:2601.20803v2 Announce Type: replace Abstract: This paper presents several strategies to automatically obtain additional examples for in-context learning, effectively transforming relation extrac

Unified Context Evolution for LLM Agents

arXiv:2606.02304v1 Announce Type: new Abstract: LLM-based agents can solve multi-step interactive tasks by combining reasoning with environment feedback, yet each episode starts from the same fixed co

agentsarxiv-cs-cl

WaveFilter: Enhancing the Long-Context Capability of Diffusion LLMs via Wavelet-Guided KV Cache Filtering

arXiv:2606.00724v1 Announce Type: cross Abstract: Diffusion Large Language Models (DLMs) have demonstrated significant advantages across various tasks. However, constrained by their multi-step iterati

Applications

Algorithmic Recourse of In-Context Learning for Tabular Data

arXiv:2605.31272v1 Announce Type: new Abstract: As predictive models are increasingly deployed in high-stakes settings such as credit approval, there is a growing need for post-hoc methods that provid

applicationsarxiv-cs-lg

1 Jun 2026

Tutorials

Developing an AI-Powered UX Research Point of View for Digital Health in A Regulatory Context: An Exemplar Case from MSM and Transgender HIV Care in Nigeria

arXiv:2605.31138v1 Announce Type: cross Abstract: User Experience Research (UXR) in a legal and regulatory contexts presents unique challenges that require specialised approaches to protect vulnerable

tutorialsarxiv-cs-ai

1 Jun 2026

Causal Interventions on Continuous Variables: A Case Study on Verb Bias in Steering Vectors for In-Context Learning

arXiv:2605.29971v1 Announce Type: new Abstract: Causal interventions in language model representations have largely targeted discrete features, like grammatical number. However, language models must a

safetyarxiv-cs-cl

Enhancing Multi-Agent Communication through Attention Steering with Context Relevance

arXiv:2605.30136v1 Announce Type: new Abstract: LLM-based multi-agent systems have demonstrated remarkable performance on complex tasks through collaborative reasoning. However, these systems tend to

MATANet: A Multi-context Attention and Taxonomy-Aware Network for Fine-Grained Underwater Recognition of Marine Species

arXiv:2601.03729v2 Announce Type: replace Abstract: Fine-grained recognition of marine organisms is important for ecological research, biodiversity monitoring, habitat conservation, and evidence-based

safetyarxiv-cs-cv

mcp-proto-okn: Natural-language access to open scientific knowledge graphs through the Model Context Protocol

arXiv:2605.30283v1 Announce Type: new Abstract: MCP Server Proto-OKN (mcp-proto-okn) is a Python-based Model Context Protocol server that enables AI assistants to discover, inspect, query and integrat

Same Evidence, Different Answers: Canonical-Context On-Policy Distillation for Multi-Turn Language Models

arXiv:2605.30251v1 Announce Type: cross Abstract: Large language models (LLMs) often solve a task when all instructions are given in a single prompt, but fail when the same information is revealed gra

STAP: A Shuffle-Tokenized App Predictor with Ultra Long Context for Vocabulary-Free Mobile App Prediction

arXiv:2605.29863v1 Announce Type: new Abstract: Predicting the next mobile application a user will launch is essential for intelligent device resource management and proactive assistance. Existing mod

Memory-Based vs. Context-Only Conditioning Produces Distinct Behavioral Patterns in Stateful Personalization

arXiv:2605.27389v1 Announce Type: cross Abstract: We study how conditioning context shapes personalization behavior in a teacher-facing educational recommender system. We compare contextual conditioni

28 May 2026

ZipRL: Adaptive Multi-Turn Context Compression with Hindsight Response Replay

arXiv:2605.28069v1 Announce Type: new Abstract: Adaptive context compression is vital for scaling Large Language Models (LLMs) to complex, multi-turn agent tasks. However, rule-based compression metho

28 May 2026

From Static Context to Calibrated Interactive RL: Mitigating Distribution Shift in Multi-turn Dialogue with Aligned Simulator

arXiv:2605.26403v1 Announce Type: new Abstract: A long-standing goal of the research community is to develop highly interactive LLM-based dialogue agents. Recent research focuses on optimizing policie

MetaSICL: Adapting Audiroty LLM via Meta Speech In-Context Learning

arXiv:2601.18904v2 Announce Type: replace-cross Abstract: Auditory Large Language Models (LLMs) have demonstrated strong performance across a wide range of speech and audio understanding tasks. Nevert

Stability Implies Redundancy: Delta Attention Selective Halting for Efficient Long-Context Prefilling

arXiv:2604.18103v2 Announce Type: replace Abstract: Prefilling computational costs pose a significant bottleneck for Large Language Models (LLMs) and Large Multimodal Models (LMMs) in long-context set

When Correct Demonstrations Hurt: Rethinking the Role of Exemplars in In-Context Learning

arXiv:2605.26350v1 Announce Type: cross Abstract: In-context learning (ICL) is often motivated by the intuition that demonstrations help because they provide correct input-output examples. However, we

Yes, Q-learning Helps Offline In-Context RL

arXiv:2502.17666v4 Announce Type: replace-cross Abstract: Existing offline in-context reinforcement learning (ICRL) methods have predominantly relied on supervised training objectives, which are known

Attested Tool-Server Admission: A Security Extension to the Model Context Protocol

arXiv:2605.24248v1 Announce Type: cross Abstract: The Model Context Protocol (MCP) standardizes how a large-language-model (LLM) agent and an external tool server exchange messages, but not trust: a h

26 May 2026

DRInQ: Evaluating Conversational Implicature with Controlled Context Variation

arXiv:2605.24267v1 Announce Type: new Abstract: Human conversation relies heavily on conversational implicature, in which speakers convey meanings that are suggested rather than explicitly stated. Alt

26 May 2026

EDGE-OPD: Internalizing Privileged Context with Evidence Guided On-Policy Distillation

arXiv:2605.23493v1 Announce Type: new Abstract: On-Policy Distillation (OPD) has gained wide attraction as an LLM post-training paradigm due to its effectiveness in improving capabilities without intr

25 May 2026

Eye Gaze-Informed and Context-Aware Pedestrian Trajectory Prediction in Shared Spaces with Automated Shuttles: A Virtual Reality Study

arXiv:2603.19812v2 Announce Type: replace Abstract: To address this gap, we conduct a Virtual Reality experiment in which pedestrians interact with automated shuttles under varying approach angles (45

25 May 2026

GILT: An LLM-Free, Tuning-Free Graph Foundational Model for In-Context Learning

arXiv:2510.04567v2 Announce Type: replace-cross Abstract: Graph Neural Networks (GNNs) are powerful tools for processing relational data but often struggle to generalize to unseen graphs, giving rise

25 May 2026

Tutorials

Learning Causal Orderings for In-Context Tabular Prediction

arXiv:2605.22335v1 Announce Type: new Abstract: In-context learning for tabular data sets strong predictive standards in observational settings; it however primarily relies on correlational structure,

tutorialsarxiv-cs-lg

23 May 2026

Towards Context-Invariant Safety Alignment for Large Language Models

arXiv:2605.20994v1 Announce Type: new Abstract: Preference-based post-training aligns LLMs with human intent, yet safety behavior often remains brittle. A model may refuse a harmful request in a stand

safetyarxiv-cs-cl

21 May 2026

In-Context Learning Operates as Concept Subspace Learning

model-releasesarxiv-cs-lg

arXiv:2605.18830v1 Announce Type: new Abstract: Regression and Bayesian accounts of in-context learning (ICL) explain how demonstrations can induce predictors, while mechanistic analyses often identif

20 May 2026

EchoSR: Efficient Context Harnessing for Lightweight Image Super-Resolution

arXiv:2605.17470v1 Announce Type: new Abstract: Image super-resolution (SR) aims to reconstruct high-quality, high-resolution (HR) images from low-resolution (LR) inputs and plays a critical role in v

researcharxiv-cs-cv

Local Ai

In-context learning enables continental-scale subsurface temperature prediction from sparse local observations

arXiv:2605.16665v1 Announce Type: new Abstract: Continental-scale knowledge of subsurface temperature is limited by the cost and sparsity of borehole measurements, but such information is essential fo

local-aiarxiv-cs-lg

Tutorials

Rover: Context-aware Conflict Resolution with LLM

arXiv:2605.17279v1 Announce Type: cross Abstract: Code merging is a significant challenge, particularly in large-scale projects. Existing solutions, including program analysis and machine learning, sh

tutorialsarxiv-cs-ai

Local Ai

Synthetic Aperture Radar Image Change Detection Based on Global Dynamic Context-Aware Network

arXiv:2605.16764v1 Announce Type: new Abstract: Convolutional neural networks (CNNs) have been extensively and successfully applied to the task of synthetic aperture radar (SAR) image change detection

local-aiarxiv-cs-cv

Context Pruning for Coding Agents via Multi-Rubric Latent Reasoning

arXiv:2605.15315v1 Announce Type: new Abstract: LLM-powered coding agents spend the majority of their token budget reading repository files, yet much of the retrieved code is irrelevant to the task at

18 May 2026

DualKV: Shared-Prompt Flash Attention for Efficient RL Training with Large Rollouts and Long Contexts

arXiv:2605.15422v1 Announce Type: new Abstract: Modern RL post-training methods such as GRPO and DAPO train on N response sequences of R tokens sampled from a shared prompt of P tokens, but standard F

safetyarxiv-cs-lg

18 May 2026

Applications

Context Steering: A New Paradigm for Compression-based Embeddings by Synthesizing Relevant Information Features