Search: “context”

arXiv:2604.12179v1 Announce Type: new Abstract: Recent advancements in Large Language Models (LLMs) have improved their ability to process extended conversational contexts, yet fine-tuning and evaluat

agentsarxiv-cs-cl

15 Apr 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

CoRoVA: Compressed Representations for Vector-Augmented Code Completion

DGX agent

arXiv:2510.19644v2 Announce Type: replace Abstract: Retrieval-augmented generation has emerged as one of the most effective approaches for code completion enhancement, especially when repository-level

researcharxiv-cs-cl

15 Apr 2026

DyBBT: Dynamic Balance via Bandit-inspired Targeting for Dialog Policy with Cognitive Dual-Systems

arXiv:2509.19695v3 Announce Type: replace-cross Abstract: Task oriented dialog systems often rely on static exploration strategies that do not adapt to dynamic dialog contexts, leading to inefficient

safetyarxiv-cs-ai

15 Apr 2026

Attention Sinks as Internal Signals for Hallucination Detection in Large Language Models

arXiv:2604.10697v1 Announce Type: new Abstract: Large language models frequently exhibit hallucinations: fluent and confident outputs that are factually incorrect or unsupported by the input context.

Back to Basics: Let Conversational Agents Remember with Just Retrieval and Generation

arXiv:2604.11628v1 Announce Type: new Abstract: Existing conversational memory systems rely on complex hierarchical summarization or reinforcement learning to manage long-term dialogue history, yet re

Beyond Black-Box Interventions: Latent Probing for Faithful Retrieval-Augmented Generation

arXiv:2510.12460v2 Announce Type: replace Abstract: Retrieval-Augmented Generation (RAG) systems often fail to maintain contextual faithfulness, generating responses that conflict with the provided co

BiT-MCTS: A Theme-based Bidirectional MCTS Approach to Chinese Fiction Generation

arXiv:2603.14410v3 Announce Type: replace Abstract: Generating long-form linear fiction from open-ended themes remains a major challenge for large language models, which frequently fail to guarantee g

COREY: A Prototype Study of Entropy-Guided Operator Fusion with Hadamard Reparameterization for Selective State Space Models

arXiv:2604.10597v1 Announce Type: cross Abstract: State Space Models (SSMs), represented by the Mamba family, provide linear-time sequence modeling and are attractive for long-context inference. Yet p

Cross-Cultural Value Awareness in Large Vision-Language Models

arXiv:2604.09945v1 Announce Type: cross Abstract: The rapid adoption of large vision-language models (LVLMs) in recent years has been accompanied by growing fairness concerns due to their propensity t

safetyarxiv-cs-ai

Think in Sentences: Explicit Sentence Boundaries Enhance Language Model's Capabilities

arXiv:2604.10135v1 Announce Type: cross Abstract: Researchers have explored different ways to improve large language models (LLMs)' capabilities via dummy token insertion in contexts. However, existin

Uncertainty-Aware Web-Conditioned Scientific Fact-Checking

arXiv:2604.11036v1 Announce Type: cross Abstract: Scientific fact-checking is vital for assessing claims in specialized domains such as biomedicine and materials science, yet existing systems often ha

Dynamic sparsity in tree-structured feed-forward layers at scale

arXiv:2604.08565v1 Announce Type: cross Abstract: At typical context lengths, the feed-forward MLP block accounts for a large share of a transformer's compute budget, motivating sparse alternatives to

13 Apr 2026

Mnemis: Dual-Route Retrieval on Hierarchical Graphs for Long-Term LLM Memory

model-releasesarxiv-cs-cl

arXiv:2602.15313v2 Announce Type: replace Abstract: AI Memory, specifically how models organizes and retrieves historical messages, becomes increasingly valuable to Large Language Models (LLMs), yet e

13 Apr 2026

AdaSpark: Adaptive Sparsity for Efficient Long-Video Understanding

arXiv:2604.08077v1 Announce Type: new Abstract: Processing long-form videos with Video Large Language Models (Video-LLMs) is computationally prohibitive. Current efficiency methods often compromise fi

researcharxiv-cs-cv

Blending Human and LLM Expertise to Detect Hallucinations and Omissions in Mental Health Chatbot Responses

arXiv:2604.06216v1 Announce Type: cross Abstract: As LLM-powered chatbots are increasingly deployed in mental health services, detecting hallucinations and omissions has become critical for user safet

Applications

Gaze to Insight: A Scalable AI Approach for Detecting Gaze Behaviours in Face-to-Face Collaborative Learning

arXiv:2604.03317v2 Announce Type: replace Abstract: Previous studies have illustrated the potential of analysing gaze behaviours in collaborative learning to provide educationally meaningful informati

applicationsarxiv-cs-cv

What Makes an Ideal Quote? Recommending 'Unexpected yet Rational' Quotations via Novelty

arXiv:2602.22220v2 Announce Type: replace-cross Abstract: Quotation recommendation aims to enrich writing by suggesting quotes that complement a given context, yet existing systems mostly optimize sur

safetyarxiv-cs-ai

CARE-SD: Explainable Reasoning Architecture for Local SLM Self-Disclosure Analysis in Textual Data

arXiv:2610.21151v1 Announce Type: cross Abstract: Cybersecurity interviews uncover critical security experiences, behaviors, and privacy concerns often not fully captured by conventional technical ass

DropKV: Decoupling Residual-Output Perturbation for Near-Optimal KV-Cache Eviction

arXiv:2610.22130v1 Announce Type: new Abstract: Key-value (KV) cache management has become a critical bottleneck for scaling Large Language Models (LLMs) to long-context scenarios due to linear memory

Entertain, then Cancel: How Thinking Makes Reasoning Models Read Some and Or Literally

arXiv:2610.21204v1 Announce Type: new Abstract: When a speaker says ``some students passed'', listeners infer that not all of them did. Reasoning models now let users decide how long a model thinks be

FlashAttention with Statistics: Low-Overhead Attention Features for Compact Hallucination Detectors

arXiv:2610.21483v1 Announce Type: new Abstract: Large language models can produce fluent answers that the supplied context does not support. A compact frozen proxy model can detect such answers by rea

Functional Subnetwork Localization for Efficient Continual Learning in Large Language Models

arXiv:2610.21537v1 Announce Type: new Abstract: Biological intelligence continually adapts to new information while retaining prior skills through localized plasticity. In contrast, continual learning

On-Policy Residual Learning for Diffusion Language Models

arXiv:2610.20687v1 Announce Type: new Abstract: Residual context is key to unlocking the speed-quality Pareto frontier of diffusion language models (DLMs) by carrying forward predictive distributions

safetyarxiv-cs-lg

Thinking-Free Policy Initialization Makes Distilled Reasoning Models More Effective and Efficient Reasoners

arXiv:2509.26226v3 Announce Type: replace-cross Abstract: Reinforcement Learning with Verifiable Reward (RLVR) effectively solves complex tasks but demands extremely long context lengths during traini

safetyarxiv-cs-cl

What Coding Agents Leave Unsaid: Measuring Task-State Gaps Between Execution and Reports

arXiv:2610.20003v2 Announce Type: replace Abstract: Human supervisors rely on coding agents' reports to assess progress, verify repairs, and decide when to intervene. But a supervisor cannot investiga

Copy-Paste Language Models

arXiv:2610.19247v1 Announce Type: new Abstract: Transformers are intuitively considered to be efficient at copying from their inputs. We actually show that the ability of LLMs to copy in context can b

Crossing the Gender Binary: Modelling Gendered Reference in Science Fiction and General Fiction

arXiv:2610.19028v1 Announce Type: new Abstract: Science fiction is widely credited with unsettling gender. This article asks whether that holds at the linguistic level, in how readily gendered referen

Exposing AI Inference as a Telco Network API over the 5G User Plane

arXiv:2610.15062v1 Announce Type: new Abstract: Supporting edge Artificial Intelligence (AI) inference as a network service is challenging because current mobile systems can transport tensors but do n

Hardware

JetSpec++: Foresight Parallel Drafting with Self Refinements

arXiv:2610.19792v1 Announce Type: new Abstract: Speculative decoding's effectiveness is governed by two quantities: the acceptance rate of drafted tokens and the cost of producing them. We show the tw

hardwarearxiv-cs-cl

MHWA: Multi-timescale Hierarchical World-Action Model

arXiv:2610.14727v1 Announce Type: new Abstract: Autoregressive world models have emerged as a powerful paradigm for sample efficient decision making, yet their open loop rollouts often exhibit increas

Local Ai

Remember, Revisit, Revise: Scaffold Memory for Long-Horizon 3D Geometry

arXiv:2610.19674v1 Announce Type: new Abstract: Geometry foundation models estimate camera poses and 3D scene structure from video sequences, but maintaining consistent reconstructions over long horiz

local-aiarxiv-cs-cv

Hardware

Scaling LLM Inference via Parallelism: Throughput-Latency Trade-off

arXiv:2610.19405v1 Announce Type: cross Abstract: Large Language Model (LLM) serving systems must balance latency and throughput while efficiently utilizing distributed GPU resources. This challenge a

hardwarearxiv-cs-lg

SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generation with LLMs

arXiv:2508.08742v3 Announce Type: replace-cross Abstract: Scientific literature question answering is a pivotal step towards new scientific discoveries. Recently, extit{two-stage} retrieval-augmented

Where Do LLM Ensemble Gains Come From? Decomposing Candidate Value, Diversity, and Aggregation

arXiv:2610.18786v1 Announce Type: cross Abstract: LLM ensemble gains are often measured against a single baseline, but the value attributed to additional candidates can change with the comparison used

Foundation Models for Event Prediction Across Heterogeneous Event Logs

model-releasesarxiv-cs-lg

arXiv:2610.17503v1 Announce Type: new Abstract: Event logs are ubiquitous across real-world domains, including business processes, manufacturing workflows, healthcare, and many other operational syste

InfraWorld: Motion-Aware World Modeling for Roadside 4D Occupancy Forecasting

model-releasesarxiv-cs-cv

arXiv:2610.14544v1 Announce Type: new Abstract: Roadside 4D occupancy forecasting predicts future semantic occupancy in a fixed infrastructure coordinate system. Roadside scenes are globally structure

MultiAlloc: Budget-Aware Precision Allocation for KV Cache Quantization

model-releasesarxiv-cs-lg

arXiv:2610.18642v1 Announce Type: new Abstract: The Key-Value (KV) cache constitutes a dominant source of memory consumption during large language model (LLM) inference, particularly in long-context a

RIFT: Token Influence Follows the Path of Least Resistance

model-releasesarxiv-cs-lg

arXiv:2610.16349v1 Announce Type: cross Abstract: Which context tokens drive a language model's answer? Graph-based tools such as attention rollout and attention flow answer this from a single forward

Which Trajectory Is Safer? Combining Rule and Learning for Safety Evaluation

arXiv:2610.17806v1 Announce Type: new Abstract: Collision rate remains a dominant metric for evaluating autonomous driving trajectory safety, but its binary nature obscures substantial safety differen

safetyarxiv-cs-ro

GIST: Generator-state-Informed Supervision for Tabular Foundation Models

arXiv:2610.12904v1 Announce Type: new Abstract: Tabular foundation models (TFMs) based on prior-data fitted networks typically use sampled hard query labels, leaving avoidable sampling variability in

researcharxiv-cs-lg

12 Oct 2026

KV-Repurpose: A Testbed for Evaluating Non-Prefix KV-Cache Reuse

arXiv:2610.13060v1 Announce Type: new Abstract: KV-cache reuse in large language model serving is commonly limited to exact prompt prefixes, preventing reuse when the same retrieved document appears a

12 Oct 2026

BioBigBird: A Sparse Attention Model for Long-Range Dependency Processing in Biomedical Text

model-releasesarxiv-cs-cl

arXiv:2610.11430v1 Announce Type: new Abstract: While domain-specific Large Language Models (LLMs) have encoded vast biomedical knowledge, their limited context windows often hinder a deep understandi

Look Back, Think Ahead: Visual Memory on Demand for Efficient Multimodal Reasoning

arXiv:2610.12060v1 Announce Type: new Abstract: Processing long visual token sequences from high-resolution images makes multi-step reasoning computationally expensive for multimodal Large Language Mo

researcharxiv-cs-cv

Agents

MemTrace: State-Consistent Memory for Long-Horizon Coding Agents

arXiv:2610.04838v2 Announce Type: replace Abstract: As coding agents take on long-horizon software evolution tasks spanning multiple files and stages, longer execution trajectories introduce two coupl

agentsarxiv-cs-ai

RaReCache: Bridging the Gap in Cross-Model KV Cache Reuse via Rank disagreement-based Selective Recomputation

arXiv:2610.11358v1 Announce Type: new Abstract: Cross-model KV-cache reuse remains a key challenge in modern LLM serving. Coding agents and multi-model systems increasingly route a shared context acro

Real Long-Term Memory for AI: A 50-Million-Token Window That Is Faster and Cheaper Than Recompute

arXiv:2610.10845v1 Announce Type: cross Abstract: A large language model can only use the text that fits in its context window, and it recomputes its internal key-value (KV) state for a prompt every t

VFold: Symmetry-Aware Cross-Layer Value Cache Compression

arXiv:2610.12338v1 Announce Type: new Abstract: While caching key-value (KV) states accelerates Large Language Model (LLM) decoding, this cache can dominate memory usage at long context lengths. One s

CoDR: Training-Free Confidence-Drift Remasking for Diffusion Language Models

arXiv:2610.08833v1 Announce Type: new Abstract: Masked diffusion language models (MDLMs) decode by repeatedly committing tokens to masked positions, but these commitments are usually irreversible. A t