Search: “context”

arXiv:2604.12397v1 Announce Type: new Abstract: Standard Large Language Model (LLM) pre-training typically treats corpora as flattened token sequences, often overlooking the real-world context that hu

tutorialsarxiv-cs-cl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

KumoRFM-2: Scaling Foundation Models for Relational Learning

DGX agent

arXiv:2604.12596v1 Announce Type: cross Abstract: We introduce KumoRFM-2, the next iteration of a pre-trained foundation model for relational data. KumoRFM-2 supports in-context learning as well as fi

model-releasesarxiv-cs-ai

15 Apr 2026

LIFE -- an energy efficient advanced continual learning agentic AI framework for frontier systems

arXiv:2604.12874v1 Announce Type: new Abstract: The rapid advancement of AI has changed the character of HPC usage such as dimensioning, provisioning, and execution. Not only has energy demand been am

Lyra 2.0: Explorable Generative 3D Worlds

arXiv:2604.13036v1 Announce Type: new Abstract: Recent advances in video generation enable a new paradigm for 3D scene creation: generating camera-controlled videos that simulate scene walkthroughs, t

Memory as Metabolism: A Design for Companion Knowledge Systems

arXiv:2604.12034v1 Announce Type: new Abstract: Retrieval-Augmented Generation remains the dominant pattern for giving LLMs persistent memory, but a visible cluster of personal wiki-style memory archi

Thought-Retriever: Don't Just Retrieve Raw Data, Retrieve Thoughts for Memory-Augmented Agentic Systems

model-releasesarxiv-cs-cl

arXiv:2604.12231v1 Announce Type: new Abstract: Large language models (LLMs) have transformed AI research thanks to their powerful internal capabilities and knowledge. However, existing LLMs still fai

A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation

arXiv:2508.09977v4 Announce Type: replace Abstract: In the context of novel view synthesis, 3D Gaussian Splatting (3DGS) has recently emerged as an efficient and competitive counterpart to Neural Radi

Local Ai

AtlasKV: Augmenting LLMs with Billion-Scale Knowledge Graphs in 20GB VRAM

arXiv:2510.17934v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) has shown some success in augmenting large language models (LLMs) with external knowledge. However, as a

local-aiarxiv-cs-ai

Bidirectional Learning of Facial Action Units and Expressions via Structured Semantic Mapping across Heterogeneous Datasets

arXiv:2604.10541v1 Announce Type: new Abstract: Facial action unit (AU) detection and facial expression (FE) recognition can be jointly viewed as affective facial behavior tasks, representing fine-gra

safetyarxiv-cs-cv

'bot lane noob' Towards Deployment of NLP-based Toxicity Detectors in Video Games

arXiv:2604.10175v1 Announce Type: cross Abstract: Toxicity and harassment are widespread in the video-gaming context. Especially in competitive online multiplayer scenarios, gamers oftentimes send har

researcharxiv-cs-lg

ClawVM: Harness-Managed Virtual Memory for Stateful Tool-Using LLM Agents

arXiv:2604.10352v1 Announce Type: new Abstract: Stateful tool-using LLM agents treat the context window as working memory, yet today's agent harnesses manage residency and durability as best-effort, c

EE-MCP: Self-Evolving MCP-GUI Agents via Automated Environment Generation and Experience Learning

arXiv:2604.09815v1 Announce Type: new Abstract: Computer-use agents that combine GUI interaction with structured API calls via the Model Context Protocol (MCP) show promise for automating software tas

Expect the Unexpected? Testing the Surprisal of Salient Entities

arXiv:2604.10724v1 Announce Type: new Abstract: Previous work examining the Uniform Information Density (UID) hypothesis has shown that while information as measured by surprisal metrics is distribute

researcharxiv-cs-cl

FlashMem: Distilling Intrinsic Latent Memory via Computation Reuse

model-releasesarxiv-cs-cl

arXiv:2601.05505v2 Announce Type: replace Abstract: The stateless architecture of Large Language Models inherently lacks the mechanism to preserve dynamic context, compelling agents to redundantly rep

FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Models

arXiv:2604.09651v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models are emerging as a cornerstone for robotics, with flow-matching policies like pi_0 showing great promise in generatin

GroupRank: A Groupwise Paradigm for Effective and Efficient Passage Reranking with LLMs

arXiv:2511.11653v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have emerged as powerful tools for passage reranking in information retrieval, leveraging their superior reasonin

Tutorials

INCRT: An Incremental Transformer That Determines Its Own Architecture

arXiv:2604.10703v1 Announce Type: new Abstract: Transformer architectures are designed by trial and error: the number of attention heads, the depth, and the head size are fixed before training begins,

tutorialsarxiv-cs-lg

Local Ai

Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures

arXiv:2604.03515v2 Announce Type: replace-cross Abstract: LLM-based coding agents can localize bugs, generate patches, and run tests with diminishing human oversight, yet the scaffolding code that sur

local-aiarxiv-cs-ai

KCS: Diversify Multi-hop Question Generation with Knowledge Composition Sampling

arXiv:2508.20567v2 Announce Type: replace Abstract: Multi-hop question answering faces substantial challenges due to data sparsity, which increases the likelihood of language models learning spurious

researcharxiv-cs-cl

Large Language Model as An Operator: An Experience-Driven Solution for Distribution Network Voltage Control

arXiv:2507.14800v2 Announce Type: replace-cross Abstract: With the advanced reasoning, contextual understanding, and information synthesis capabilities of large language models (LLMs), a novel paradig

Learning from Emptiness: De-biasing Listwise Rerankers with Content-Agnostic Probability Calibration

arXiv:2604.10150v1 Announce Type: new Abstract: Generative listwise reranking leverages global context for superior retrieval but is plagued by intrinsic position bias, where models exhibit structural

Applications

Leveraging Machine Learning Techniques to Investigate Media and Information Literacy Competence in Tackling Disinformation

arXiv:2604.09635v1 Announce Type: cross Abstract: This study develops machine learning models to assess Media and Information Literacy (MIL) skills specifically in the context of disinformation among

applicationsarxiv-cs-ai

LoopGuard: Breaking Self-Reinforcing Attention Loops via Dynamic KV Cache Intervention

arXiv:2604.10044v1 Announce Type: new Abstract: Through systematic experiments on long-context generation, we observe a damaging failure mode in which decoding can collapse into persistent repetition

Machine Learning-Based Detection of MCP Attacks

arXiv:2604.10534v1 Announce Type: cross Abstract: The Model Context Protocol (MCP) is a new and emerging technology that extends the functionality of large language models, improving workflows but als

MedLVR: Latent Visual Reasoning for Reliable Medical Visual Question Answering

arXiv:2604.09757v1 Announce Type: cross Abstract: Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely te

MPAC: A Multi-Principal Agent Coordination Protocol for Interoperable Multi-Agent Collaboration

arXiv:2604.09744v1 Announce Type: cross Abstract: The AI agent ecosystem has converged on two protocols: the Model Context Protocol (MCP) for tool invocation and Agent-to-Agent (A2A) for single-princi

MSA: Memory Sparse Attention for Efficient End-to-End Memory Model Scaling to 100M Tokens

arXiv:2603.23516v2 Announce Type: replace-cross Abstract: Long-term memory is a cornerstone of human intelligence. Enabling AI to process lifetime-scale information remains a long-standing pursuit in

Persistent Identity in AI Agents: A Multi-Anchor Architecture for Resilient Memory and Continuity

arXiv:2604.09588v1 Announce Type: new Abstract: Modern AI agents suffer from a fundamental identity problem: when context windows overflow and conversation histories are summarized, agents experience

RAG-KT: Cross-platform Explainable Knowledge Tracing with Multi-view Fusion Retrieval Generation

arXiv:2604.10960v1 Announce Type: new Abstract: Knowledge Tracing (KT) infers a student's knowledge state from past interactions to predict future performance. Conventional Deep Learning (DL)-based KT

RECIPER: A Dual-View Retrieval Pipeline for Procedure-Oriented Materials Question Answering

arXiv:2604.11229v1 Announce Type: cross Abstract: Retrieving procedure-oriented evidence from materials science papers is difficult because key synthesis details are often scattered across long, conte

researcharxiv-cs-ai

Resilient Write: A Six-Layer Durable Write Surface for LLM Coding Agents

arXiv:2604.10842v1 Announce Type: cross Abstract: LLM-powered coding agents increasingly rely on tool-use protocols such as the Model Context Protocol~(MCP) to read and write files on a developer's wo

See Fair, Speak Truth: Equitable Attention Improves Grounding and Reduces Hallucination in Vision-Language Alignment

arXiv:2604.09749v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) frequently hallucinate objects that are absent from the visual input, often because attention during decoding i

safetyarxiv-cs-cv

SLM Finetuning for Natural Language to Domain Specific Code Generation in Production

model-releasesarxiv-cs-lg

arXiv:2604.09952v1 Announce Type: new Abstract: Many applications today use large language models for code generation; however, production systems have strict latency requirements that can be difficul

STARS: Skill-Triggered Audit for Request-Conditioned Invocation Safety in Agent Systems

arXiv:2604.10286v1 Announce Type: new Abstract: Autonomous language-model agents increasingly rely on installable skills and tools to complete user tasks. Static skill auditing can expose capability s

Taking a Pulse on How Generative AI is Reshaping the Software Engineering Research Landscape

arXiv:2604.11184v1 Announce Type: cross Abstract: Context: Software engineering (SE) researchers increasingly study Generative AI (GenAI) while also incorporating it into their own research practices.

Applications

The embodied brain: Bridging the brain, body, and behavior with neuromechanical digital twins

arXiv:2601.08056v2 Announce Type: replace-cross Abstract: Animal behavior reflects interactions between the nervous system, body, and environment. Therefore, biomechanics and environmental context mus

applicationsarxiv-cs-ro

The Salami Slicing Threat: Exploiting Cumulative Risks in LLM Systems

arXiv:2604.11309v1 Announce Type: cross Abstract: Large Language Models (LLMs) face prominent security risks from jailbreaking, a practice that manipulates models to bypass built-in security constrain

Three Roles, One Model: Role Orchestration at Inference Time to Close the Performance Gap Between Small and Large Agents

arXiv:2604.11465v1 Announce Type: new Abstract: Large language model (LLM) agents show promise on realistic tool-use tasks, but deploying capable agents on modest hardware remains challenging. We stud

Token-Budget-Aware Pool Routing for Cost-Efficient LLM Inference

arXiv:2604.09613v1 Announce Type: cross Abstract: Production vLLM fleets provision every instance for worst-case context length, wasting 4-8x concurrency on the 80-95% of requests that are short and s

Hardware

Tree Training: Accelerating Agentic LLMs Training via Shared Prefix Reuse

arXiv:2511.00413v4 Announce Type: replace Abstract: Agentic large language model (LLM) training often involves multi-turn interaction trajectories that branch into multiple execution paths due to conc

hardwarearxiv-cs-lg

Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving

arXiv:2603.13842v3 Announce Type: replace-cross Abstract: End-to-end autonomous driving is typically built upon imitation learning (IL), yet its performance is constrained by the quality of human demo

InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptation

arXiv:2604.08646v1 Announce Type: new Abstract: Instruction-based video editing is a natural way to control video content with text, but adapting a video generation model into an editor usually appear

Lessons Without Borders? Evaluating Cultural Alignment of LLMs Using Multilingual Story Moral Generation

arXiv:2604.08797v1 Announce Type: cross Abstract: Stories are key to transmitting values across cultures, but their interpretation varies across linguistic and cultural contexts. Thus, we introduce mu

MONETA: Multimodal Industry Classification through Geographic Information with Multi Agent Systems

arXiv:2604.07956v2 Announce Type: replace Abstract: Industry classification schemes are integral parts of public and corporate databases as they classify businesses based on economic activity. Due to

MSMO-ABSA: Multi-Scale and Multi-Objective Optimization for Cross-Lingual Aspect-Based Sentiment Analysis

arXiv:2502.13718v2 Announce Type: replace Abstract: Aspect-based sentiment analysis (ABSA) garnered growing research interest in multilingual contexts in the past. However, the majority of the studies

safetyarxiv-cs-cl

Local Ai

QCFuse: Query-Centric Cache Fusion for Efficient RAG Inference

arXiv:2604.08585v1 Announce Type: cross Abstract: Cache fusion accelerates generation process of LLMs equipped with RAG through KV caching and selective token recomputation, thereby reducing computati

local-aiarxiv-cs-ai

SiMing-Bench: Evaluating Procedural Correctness from Continuous Interactions in Clinical Skill Videos

model-releasesarxiv-cs-cl

arXiv:2604.09037v1 Announce Type: cross Abstract: Current video benchmarks for multimodal large language models (MLLMs) focus on event recognition, temporal ordering, and long-context recall, but over

Streaming Video Instruction Tuning

arXiv:2512.21334v2 Announce Type: replace Abstract: We present Streamo, a real-time streaming video LLM that serves as a general-purpose interactive assistant. Unlike existing online video models that