Search: “context”

Context-Fidelity Boosting: Enhancing Faithful Generation through Watermark-Inspired Decoding

arXiv:2604.22335v1 Announce Type: new Abstract: Large language models (LLMs) often produce content that contradicts or overlooks information provided in the input context, a phenomenon known as faithf

safetyarxiv-cs-cl

27 Apr 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

feels like we have all the primitives for building powerful autonomous agent model task management tool use/auth memory & context management…

DGX agent

feels like we have all the primitives for building powerful autonomous agent model task management tool use/auth memory & context management self improvement UI/UX what’s missing? verifiers (for self

agentsyohei-nakajima--x

27 Apr 2026

LSTM-MAS: A Long Short-Term Memory Inspired Multi-Agent System for Long-Context Understanding

arXiv:2601.11913v2 Announce Type: replace-cross Abstract: Effectively processing long contexts remains a fundamental yet unsolved challenge for large language models (LLMs). Existing single-LLM-based

22 Apr 2026

Tutorials

MapPFN: Learning Causal Perturbation Maps in Context

arXiv:2601.21092v2 Announce Type: replace Abstract: Planning effective interventions in biological systems requires treatment-effect models that adapt to unseen biological contexts by identifying thei

tutorialsarxiv-cs-lg

22 Apr 2026

Scaling External Knowledge Input Beyond Context Windows of LLMs via Multi-Agent Collaboration

arXiv:2505.21471v2 Announce Type: replace Abstract: With the rapid advancement of post-training techniques for reasoning and information seeking, large language models (LLMs) can incorporate a large q

21 Apr 2026

OjaKV: Context-Aware Online Low-Rank KV Cache Compression

arXiv:2509.21623v2 Announce Type: replace-cross Abstract: The expanding long-context capabilities of large language models are constrained by a significant memory bottleneck: the key-value (KV) cache

20 Apr 2026

Listening Alone, Understanding Together: Collaborative Context Recovery for Privacy-Aware AI

arXiv:2604.13348v1 Announce Type: new Abstract: We introduce CONCORD, a privacy-aware asynchronous assistant-to-assistant (A2A) framework that leverages collaboration between proactive speech-based AI

17 Apr 2026

Lossless Prompt Compression via Dictionary-Encoding and In-Context Learning: Enabling Cost-Effective LLM Analysis of Repetitive Data

arXiv:2604.13066v1 Announce Type: new Abstract: In-context learning has established itself as an important learning paradigm for Large Language Models (LLMs). In this paper, we demonstrate that LLMs c

16 Apr 2026

Context Matters: Vision-Based Depression Detection Comparing Classical and Deep Approaches

arXiv:2604.10344v1 Announce Type: new Abstract: The classical approach to detecting depression from vision emphasizes interpretable features, such as facial expression, and classifiers such as the Sup

safetyarxiv-cs-cv

14 Apr 2026

I made a open source CLI agent for 8k tokrn context windows - v0.3- improves ollama compatibility and speed by up to 2 times

A community-shared open source CLI agent project posted to r/ollama, designed specifically for use with 8K token context windows in local Ollama-based LLM setups. Version 0.3 focuses on improving Olla

local-air-ollama

14 Apr 2026

hands on workshop: context engineering for multi agent systems [D]

This r/MachineLearning discussion thread centers on a hands-on workshop covering context engineering — the process of designing and optimizing the information an AI agent sends to and receives from a

agentsr-machinelearning

13 Apr 2026

DisCEdge: Distributed Context Management for Large Language Models at the Edge

arXiv:2511.22599v2 Announce Type: replace-cross Abstract: Deploying Large Language Model (LLM) services at the edge benefits latency-sensitive and privacy-aware applications. However, the stateless na

10 Apr 2026

Near-100% Accurate Data for your Agent with Comprehensive Context Engineering

model-releasesgoogle-cloud-ai

Agentic workflows are already used for initiating action. To be successful, agents typically need to combine multiple steps and execute business logic reflective of real-life decisions. But, as develo

10 Apr 2026

deepagents just hit 30k stars on github! deepagents is great for building agents that do complex work. they manage context well and use a du…

deepagents just hit 30k stars on github! deepagents is great for building agents that do complex work. they manage context well and use a durable runtime. though inspired by coding agent design, deepa

agentsharrison-chase--x

12 Oct 2026

Using LMs to Model the Effects of Context and Coreference during Sentence Comprehension

arXiv:2609.32119v2 Announce Type: replace Abstract: Language models (LMs) are often used as a tool to model human language processing. Recent studies suggest that severely restricting LMs' context win

9 Oct 2026

Decoupling Logic from Persona: Structural Immunity of Edge LLM Agents to Context Pollution

arXiv:2610.09772v1 Announce Type: new Abstract: Small language-model agents on edge devices must hold a persona and reason correctly at once, inside one context window that fills with conversational h

8 Oct 2026

Attenuated in-context identification in time-series foundation models: diagnosis under counterfactual inputs and repair by synthetic forced-system fine-tuning

arXiv:2610.08118v1 Announce Type: new Abstract: Covariate-aware time-series foundation models (TSFMs) promise training-free what-if answers for instrumented plants: the change in output that a differe

7 Oct 2026

Learning Decision-Stump Thresholds in Context: Dynamics of Softmax Attention

model-releasesarxiv-cs-lg

arXiv:2610.07074v1 Announce Type: cross Abstract: Estimating a decision threshold requires locating observations near an unknown boundary. We study how gradient-based pretraining learns this statistic

7 Oct 2026

Applications

Support-Set Target Leakage in Relational Foundation Models during In-Context Learning: Model Dependence and Evaluation Reliability

arXiv:2609.36417v1 Announce Type: new Abstract: Relational in-context learning (ICL) uses labeled support examples and their linked relational context to predict labels for new queries. This creates a

applicationsarxiv-cs-ai

30 Sept 2026

Scalable In-Context Reinforcement Learning with Recurrent Algorithm Distillation

model-releasesarxiv-cs-lg

arXiv:2609.35333v1 Announce Type: new Abstract: Algorithm Distillation (AD) has demonstrated the remarkable ability of Transformers to perform in-context reinforcement learning without explicit weight

29 Sept 2026

Decodable In-Context State and Model Output Across Training

arXiv:2609.31401v1 Announce Type: new Abstract: Prior work established that a probe can decode an in-context binding on model errors and that probe-guided steering can repair some of them. We follow p

28 Sept 2026

Nonparametric In-Context Learning under Growing Geometric Complexity: Minimax Optimality and Local Geometry-Adaptivity of Transformers

arXiv:2609.31458v1 Announce Type: cross Abstract: Transformers have become a central architecture for in-context learning (ICL), particularly through their state-of-the-art performance in large langua

28 Sept 2026

Gender Bias in Vision-Language In-Context Learning

arXiv:2609.27682v1 Announce Type: new Abstract: In-context learning (ICL) enables large vision-language models (LVLMs) to perform tasks by following patterns from in-context examples, yet its potentia

safetyarxiv-cs-cv

24 Sept 2026

Genie One MCP: Give any AI Agent the Right Business Context

**Genie One MCP: Give any AI Agent the Right Business Context** The guide introduces Genie One MCP as a framework for embedding relevant business context in artificial intelligence agents, enabling th

agentsdatabricks

22 Sept 2026

MM-ContextFold: Context Folding for Multimodal Agentic Retrieval

arXiv:2609.23121v1 Announce Type: new Abstract: Multimodal Agentic Retrieval (MAR) requires agents to solve complex information-seeking tasks by iteratively invoking external tools. Typical frameworks

agentsarxiv-cs-cv

22 Sept 2026

Qwen3.8-Flash-Next at 1M context on Strix Halo: 38 tok/s decode, 18 min prefill (halogen 0.12.0)

Hi. I saw some feedback that halogen was degrading at context depth. So I fixed that. Served through the image, same machine, same session, same prompts, 0.11.10 vs 0.12.0: decode at 1,004,581 tokens

local-air-localllama

19 Sept 2026

Block Parallelism For Efficient Distributed Long-Context Diffusion Language Model Training

arXiv:2609.19242v1 Announce Type: new Abstract: Block diffusion language models (BDLMs) combine autoregressive dependencies across blocks with parallel denoising within blocks, but long-context traini

local-aiarxiv-cs-lg

18 Sept 2026

Recursive Reasoning or Statistical Extrapolation? In-Context Learning in Multi-Agent Interdependent Decision-Making

arXiv:2609.18591v1 Announce Type: new Abstract: In-context learning (ICL) enables large language model (LLM) agents to improve decisions using interaction history, yet it remains unclear whether such

17 Sept 2026

Applications

Large Language Models Develop Belief State Geometry In-Context

arXiv:2609.17376v1 Announce Type: cross Abstract: Large language models (LLMs) trained on next-token prediction exhibit remarkable in-context learning (ICL) abilities, yet the representations that sup

applicationsarxiv-cs-cl

16 Sept 2026

Convergent Emergence of In-Context Learning Across Modalities

arXiv:2609.14011v1 Announce Type: new Abstract: Few-shot in-context learning (ICL), the capacity of a model to infer abstract patterns from input-output examples provided in its prompt and apply them

Efficient On-Device Agents via Adaptive Context Management

arXiv:2511.03728v2 Announce Type: replace Abstract: On-device AI agents offer the potential for personalized, low-latency assistance, but their deployment is fundamentally constrained by limited memor

Feasibility and Memory Mechanisms of Chern-Simons Context Reservoir Computation

arXiv:2609.13315v1 Announce Type: cross Abstract: We investigate whether a Chern-Simons (CS) context reservoir is a viable computational substrate and whether evolving its gauge connection provides a

LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers

arXiv:2502.15007v2 Announce Type: replace-cross Abstract: We introduce methods to quantify how Large Language Models (LLMs) encode and store contextual information, revealing that tokens often seen as

Understanding In-Context Multimodal Jailbreaks via Posterior Reweighting

arXiv:2609.10613v1 Announce Type: cross Abstract: In-context learning (ICL) jailbreaks reveal a critical vulnerability in multimodal large language models (MLLMs): harmful demonstrations in the prompt

safetyarxiv-cs-lg

11 Sept 2026

An open-source context layer for building AI on top of company data

We’ve been building PipesHub for a while now, and I’d love to get more teams to try it and tell us where it breaks. The problem we kept running into was pretty simple: Building an AI app over company

local-air-localllama

8 Sept 2026

Context-Aware Interleaved Batching for WhisperX

arXiv:2608.31170v1 Announce Type: new Abstract: While WhisperX accelerates speech transcription via intra-audio batching, it isolates audio segments, losing the historical context needed for coherent

researcharxiv-cs-cl

KV Admission: Learning What to Write for Efficient Long-Context LLM Inference

arXiv:2512.17452v4 Announce Type: replace-cross Abstract: Long-context LLM inference is bottlenecked by the quadratic attention complexity and linear Key-Value (KV) cache growth. Prior approaches miti

local-aiarxiv-cs-ai

SimGuide: Typed Multi-Context User Representations for Preference-Conditioned Agent Planning

arXiv:2608.24888v2 Announce Type: replace Abstract: Agents that act on a user's behalf must plan differently for different users, and increasingly do so from some structured representation of user con

TopoCompress: Long Context Compression via Graph-Wired Semantic Trajectories

arXiv:2608.30811v1 Announce Type: new Abstract: Long-context compression is essential for reducing the cost and latency of large language model inference. However, existing methods can fragment import

safetyarxiv-cs-cl

Hardware

SOMTab: Set-Order Mamba for Efficient Tabular In-Context Learning

arXiv:2608.27882v1 Announce Type: new Abstract: Tabular foundation models based on in-context learning have recently emerged as strong alternatives to task-specific model fitting. However, the current

hardwarearxiv-cs-lg

31 Aug 2026

TokenPilot: Cache-Efficient Context Management for LLM Agents

arXiv:2606.17016v2 Announce Type: replace Abstract: As LLM agents are deployed in long-horizon sessions, context accumulation drives up inference costs. Existing approaches utilize text pruning or dyn

researcharxiv-cs-cl

31 Aug 2026

Paritok-4B: Intent-Conditioned Context Compression for Coding Agents

arXiv:2608.24188v1 Announce Type: new Abstract: Coding agents re-send large file reads and tool outputs to a frontier LLM every turn, and this context dominates their token bill. General-purpose promp

26 Aug 2026

Boosting Knowledge-based Visual Question Answering with Structured Context Reasoning

arXiv:2608.21431v1 Announce Type: new Abstract: Knowledge-based Visual Question Answering aims to answer questions about an image by integrating external knowledge with visual and textual information.

researcharxiv-cs-cv

25 Aug 2026

Agree 100%. We started building agents and quickly realized we needed to build the system of record too. Agents need all the context and per…

Agree 100%. We started building agents and quickly realized we needed to build the system of record too. Agents need all the context and permissions you’d give an employee to complete work end-to-end.

agentsharrison-chase--x

24 Aug 2026

Inhibitory Attention for Clinical Long-Context Reasoning: Characterizing and Mitigating Lost-in-the-Middle Effects in EHR Processing

arXiv:2608.20348v1 Announce Type: cross Abstract: Electronic health records now routinely exceed 100,000 tokens per patient. Yet large language models exhibit the lost-in-the-middle (LitM) effect: inf

24 Aug 2026

Hardware

TurboBias 2.0: Streaming Context-Biasing for Production-Efficient ASR Systems

arXiv:2608.21343v1 Announce Type: cross Abstract: Contextualization is essential for production automatic speech recognition (ASR) systems, where user-provided phrases must be recognized accurately un

hardwarearxiv-cs-ai

24 Aug 2026

Active Inference as Context Acquisition for AI Agents

arXiv:2608.19202v1 Announce Type: new Abstract: Interactive AI agents must acquire the right context as efficiently as possible. When a user omits a constraint, preference, file, or task variable, an

21 Aug 2026

Asymmetric Attention Heads: Structured Head-Wise Context Allocation for Transformer Attention

arXiv:2608.19203v1 Announce Type: cross Abstract: Standard multi-head attention (MHA) gives every head the same full causal context span, although heads can serve different contextual roles. Some head