Search: “context”

Attention as In-Context Empirical Bayes: A Two-Stage View via Particle Dynamics

arXiv:2605.29351v1 Announce Type: new Abstract: We study minimal attention-only transformers under all-token corruption and show they admit a two-stage empirical Bayes interpretation. A single attenti

29 May 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Mindscape-Aware Retrieval Augmented Generation for Improved Long Context Understanding

DGX agent

arXiv:2512.17220v2 Announce Type: replace Abstract: Humans understand long and complex texts by relying on a holistic semantic representation of the content. This global view helps organize prior know

researcharxiv-cs-cl

29 May 2026

Toward User Preference Alignment in LLM Recommendation via Explicit Context Feedback

arXiv:2605.29141v1 Announce Type: cross Abstract: Traditional recommender systems (RecSys) primarily infer user preferences from implicit signals (such as clicks, watches, and purchases), often neglec

29 May 2026

Tools

As agents use more context, input tokens have become the majority of price-equivalent token costs.

As AI agents handle increasingly complex tasks with extended context windows, the cost structure of LLM usage has shifted such that input tokens now represent the majority of price-equivalent expenses

toolscursor--x

Comonadic Morphophonology: A Compositional Framework for Context-Dependent Morphological Rules in Finnish

arXiv:2605.28484v1 Announce Type: new Abstract: Composing finite-state transducers (FSTs) for context-dependent morphophonological rules -- consonant gradation, vowel harmony, possessive suffix assimi

Rethinking Visual Neglect: Steering via Context-Preference for MLLM Hallucination Mitigation

arXiv:2605.27993v1 Announce Type: new Abstract: Object hallucination remains a primary obstacle to the reliable deployment of Multimodal Large Language Models (MLLMs). Current inference-time mitigatio

StoryLens: Preference-Aligned Story Rewriting via Context-Aware Narrative Enrichment

arXiv:2605.28073v1 Announce Type: cross Abstract: Story rewriting aims to adapt existing narratives to diverse reader preferences while preserving plot consistency and narrative coherence. Unlike conv

Can Retrieval Heads See Images? Multimodal Retrieval Heads in Long-Context Vision-Language Models

arXiv:2605.27243v1 Announce Type: new Abstract: Large vision-language models increasingly rely on long-context modeling to reason over documents, hour-level videos, and long-horizon agent trajectories

agentsarxiv-cs-cv

Device Context Protocol: A Compact, Safety-First Architecture for LLM-Driven Control of Constrained Devices

model-releasesarxiv-cs-lg

arXiv:2605.26159v1 Announce Type: cross Abstract: Large language models are increasingly used as orchestrators of external tools via the Model Context Protocol (MCP), but MCP is built for software ser

NestedKV: Nested Memory Routing for Long-Context KV Cache Compression

arXiv:2605.26678v1 Announce Type: new Abstract: Long-context language models are limited by the memory footprint of the key-value (KV) cache. Existing training-free KV compression methods usually rank

PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimization

arXiv:2507.16679v3 Announce Type: replace-cross Abstract: In-Context Learning has shown great potential for aligning Large Language Models (LLMs) with human values, helping reduce harmful outputs and

The Attribution Blind Spot: Detecting When Language Models Rely on Memory Rather Than Retrieved Context

arXiv:2605.26778v1 Announce Type: new Abstract: Retrieval-augmented generation promises to ground language model outputs in external evidence, yet the field has no reliable way to verify whether retri

researcharxiv-cs-ai

Benchmarking the Limits of In-Context Reinforcement Learning for Ad-Hoc Teamwork

arXiv:2605.24423v1 Announce Type: new Abstract: In-Context Reinforcement Learning (ICRL) has enabled foundation agents to adapt instantaneously to novel tasks, yet its efficacy in Ad-Hoc Teamwork (AHT

CurveRL: Principled Distribution-Aware Context Reweighting for LLM Reasoning

model-releasesarxiv-cs-lg

arXiv:2605.24331v1 Announce Type: new Abstract: Context or prompt-level reweighting has emerged as a central algorithmic lever in Reinforcement Learning with Verified Rewards (RLVR) for improving the

MCPXKIT: The Unified Toolkit for Analyzing Model Context Protocol Security

arXiv:2508.12538v2 Announce Type: replace-cross Abstract: The Model Context Protocol (MCP) has emerged as a universal standard that enables AI agents to seamlessly connect with external tools, signifi

agentsarxiv-cs-ai

Meta-Soft: Leveraging Composable Meta-Tokens for Context-Preserving KV Cache Compression

arXiv:2605.22337v2 Announce Type: replace Abstract: The KV cache used in large language models has linearly growing time complexity, so LLMs face memory blow-up and reduced decoding efficiency when th

Retrieved In-Context Principles from Previous Mistakes

arXiv:2407.05682v2 Announce Type: replace Abstract: In-context learning (ICL) has been instrumental in adapting Large Language Models (LLMs) to downstream tasks using correct input-output examples. Re

WhenLoss: Diagnosing Write and Retrieval Bottlenecks in Long-Context Memory Systems

arXiv:2605.24579v1 Announce Type: new Abstract: Long-context memory systems often fail under fixed budgets, but end-to-end evaluation does not reveal whether evidence was discarded during compression

Self-Improving In-Context Learning

arXiv:2605.23180v1 Announce Type: new Abstract: We propose to improve in-context learning (ICL) by optimizing the continuous embeddings of a fixed few-shot prompt at test time. The key observation is

25 May 2026

VideoOdyssey: A Benchmark for Ultra-Long-Context and Omni-Modal Video Understanding

model-releasesarxiv-cs-cv

arXiv:2605.22907v1 Announce Type: new Abstract: Real-world long video understanding requires models to perform continuous tracking, information integration and memory retention over massive temporal s

25 May 2026

Distributional Alignment as a Criterion for Designing Task Vectors in In-Context Learning

arXiv:2605.20730v1 Announce Type: new Abstract: In-context learning (ICL) allows large language models (LLMs) to adapt to new tasks through demonstrations, yet it suffers from escalating inference cos

safetyarxiv-cs-cl

21 May 2026

END: Early Noise Dropping for Efficient and Effective Context Denoising

arXiv:2502.18915v3 Announce Type: replace Abstract: Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of natural language processing tasks. However, they are of

21 May 2026

Local Ai

Explainable AI: Context-Aware Layer-Wise Integrated Gradients for Explaining Transformer Models

arXiv:2602.16608v2 Announce Type: replace Abstract: Transformer models achieve state-of-the-art performance across domains and tasks, yet their deeply layered representations make their predictions di

local-aiarxiv-cs-cl

21 May 2026

Context-Aware Detection and Victim-Centered Response Generation for Online Harassment in Private Messaging

arXiv:2512.14700v2 Announce Type: replace-cross Abstract: Online harassment is a widespread social and public health concern, yet most computational approaches for detecting and addressing harassment

Efficient and Minimax Optimal In-context Nonparametric Regression with Transformers

arXiv:2601.15014v2 Announce Type: replace-cross Abstract: We study in-context learning for nonparametric regression with alpha-Holder smooth regression functions, for some alpha>0. We prove that, with

How does longer temporal context enhance multimodal narrative video processing in the brain?

arXiv:2602.07570v2 Announce Type: replace-cross Abstract: Understanding how humans and artificial intelligence systems process complex narrative videos is a fundamental challenge at the intersection o

Position: The Turing-Completeness of Real-World Autoregressive Transformers Relies Heavily on Context Management

arXiv:2605.19514v1 Announce Type: new Abstract: Many works make the eye-catching claim that Transformers are Turing-complete. However, the literature often conflates two distinct settings: (i) a fixed

Databricks context engineer associate: the industry’s first certification for reliable AI agent systems

Databricks has launched the Context Engineer Associate certification, described as the industry's first credential specifically designed for professionals building reliable AI agent systems. The certi

agentsdatabricks

Elastic-dLLM: Position Preserving Context Compression and Augmentation of Diffusion LLMs

arXiv:2605.18165v1 Announce Type: new Abstract: Unlike autoregressive models, which generate one token at a time, dLLMs denoise a chunk of [MASK] tokens jointly and sample one or more tokens per step;

Finding Sense in Nonsense with Generated Contexts: Perspectives from Humans and Language Models

arXiv:2602.11699v3 Announce Type: replace Abstract: Nonsensical and anomalous sentences have been instrumental in the development of computational models of semantic interpretation. A core challenge i

LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation

arXiv:2410.13846v3 Announce Type: replace-cross Abstract: Scaling language models to handle longer contexts introduces substantial memory challenges due to the growing cost of key-value (KV) caches. M

Long Context Modeling with Ranked Memory-Augmented Retrieval

arXiv:2503.14800v3 Announce Type: replace-cross Abstract: Effective long-term memory management is crucial for language models handling extended contexts. We introduce the Enhanced Ranked Memory Augme

researcharxiv-cs-ai

ProxyKV: Cross-Model Proxy Pruning for Efficient Long-Context LLM Inference

arXiv:2605.16360v1 Announce Type: cross Abstract: Efficient long-context inference in Large Language Models (LLMs) is severely constrained by the Key-Value (KV) cache memory wall, yet existing pruning

Torq acquires AI security startup Jit to add context graphs to its security operations center platform

Autonomous security operations company Torq Ltd. today announced that it has acquired Jit.io Ltd., a cybersecurity startup whose technology generates AI-driven context graphs to inform security invest

agentssiliconangle

SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalization

arXiv:2604.02268v2 Announce Type: replace Abstract: Agent skills, structured packages of procedural knowledge and executable resources that agents dynamically load at inference time, have become a rel

safetyarxiv-cs-lg

18 May 2026

LATERN: Test-Time Context-Aware Explainable Video Anomaly Detection

arXiv:2605.15054v1 Announce Type: new Abstract: Vision-language models (VLMs) have recently emerged as a promising paradigm for video anomaly detection (VAD) due to their strong visual reasoning abili

safetyarxiv-cs-cv

15 May 2026

Context Matters: Auditing Gender Bias in T2I Generation through Risk-Tiered Use-Case Profiles

arXiv:2605.13113v1 Announce Type: cross Abstract: Text-to-image (T2I) generative models are increasingly used to produce content for education, media, and public-facing communication, and are starting

14 May 2026

Latent Causal Void: Explicit Missing-Context Reconstruction for Misinformation Detection

arXiv:2605.12156v1 Announce Type: new Abstract: Automatic misinformation detection performs well when deception is visible in what an article explicitly states. However, some misinformation articles r

13 May 2026

Mitigating Context-Memory Conflicts in LLMs through Dynamic Cognitive Reconciliation Decoding

arXiv:2605.12185v1 Announce Type: new Abstract: Large language models accumulate extensive parametric knowledge through pre-training. However, knowledge conflicts occur when outdated or incorrect para

13 May 2026

Beyond Continuity: Challenges of Context Switching in Multi-Turn Dialogue with LLMs

arXiv:2605.09268v1 Announce Type: cross Abstract: Users interacting with Large Language Models (LLMs) in a multi-turn conversation routinely refine their requests or pivot to new topics. LLMs, however

Tutorials

Cool idea from Nous Research. What if you could speed up long-context pretraining with a subquadratic wrapper that you remove before deploym…

Cool idea from Nous Research. What if you could speed up long-context pretraining with a subquadratic wrapper that you remove before deployment? That is the idea behind Lighthouse Attention. The metho

tutorialsdair-ai--x

Local Ai

FORGE: Fragment-Oriented Ranking and Generation for Context-Aware Molecular Optimization

arXiv:2605.10230v1 Announce Type: new Abstract: Molecular optimization seeks to improve a molecule through small structural edits while preserving similarity to the starting compound. Recent language-

local-aiarxiv-cs-lg

Optimal Attention Temperature Improves the Robustness of In-Context Learning under Distribution Shift in High Dimensions

arXiv:2511.01292v2 Announce Type: replace-cross Abstract: Pretrained Transformers can perform in-context learning (ICL) from a few demonstrations, but this ability can fail sharply when the test distr

Route Before Retrieve: Activating Latent Routing Abilities of LLMs for RAG vs. Long-Context Selection

arXiv:2605.10235v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) have expanded the context window to beyond 128K tokens, enabling long-document understanding and multi-s

SkillRAE: Agent Skill-Based Context Compilation for Retrieval-Augmented Execution

arXiv:2605.10114v1 Announce Type: new Abstract: Large Language Model (LLM)-based agents (e.g., OpenClaw) increasingly rely on reusable skill libraries to solve artifact-rich tasks such as document-cen

agentsarxiv-cs-cl

Industry

Threads is testing a Meta AI integration similar to X's Grok, letting users mention Meta AI in a post or a reply to get more context, in five countries (Aisha Malik/TechCrunch)

Aisha Malik / TechCrunch: Threads is testing a Meta AI integration similar to X's Grok, letting users mention Meta AI in a post or a reply to get more context, in five countries — Threads is testing a

industrytechmeme

A Foundation Model for Instruction-Conditioned In-Context Time Series Tasks

arXiv:2603.22586v2 Announce Type: replace Abstract: In-context learning (ICL) enables task adaptation at inference time by conditioning on demonstrations rather than updating model parameters. Althoug

11 May 2026

Hardware

An Efficient Hybrid Sparse Attention with CPU-GPU Parallelism for Long-Context Inference