Search: “arxiv-cs-ai”

Kronecker Product Attention: Memory-Efficient KV Compression via Structured Factorization

arXiv:2610.12657v1 Announce Type: cross Abstract: Efficient autoregressive generation is increasingly limited by the memory footprint of the key-value (KV) cache, which grows linearly with sequence le

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

LAPT-Scale: Scaling Embodied Policies with Latent Action Pre-Training on Human Videos

DGX agent

arXiv:2610.13732v1 Announce Type: cross Abstract: Scaling generalist robotic policies is limited by the high cost of collecting embodied interaction data. Large-scale egocentric human videos offer a r

safetyarxiv-cs-ai

12 Oct 2026

Learning More by Training Less: Uncertainty-Guided Progressive Contraction for Efficient Reasoning Post-Training

arXiv:2610.12933v1 Announce Type: new Abstract: Large language models have achieved remarkable advances in complex reasoning. However, scaling reasoning post-training with ever-larger corpora can subs

Learning Size Independent Constraint Models from Input Data and Positive and Negative Example Solutions

arXiv:2610.13640v1 Announce Type: new Abstract: In this paper we describe a Constraint Acquisition Tool that generates size independent constraint programs from input data and positive and negative ex

Learning to Report Unsafe Tasks in a Multi-Agent Game

arXiv:2610.09002v2 Announce Type: replace Abstract: When a team of agents shares a reward for completed tasks, reporting and stopping unsafe work reduces the team's reward. Random audits that penalize

Let Large Language Models Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering

arXiv:2606.15419v2 Announce Type: replace-cross Abstract: Objective: To enhance the accuracy, interpretability, and robustness of large language models (LLMs) in medical question answering (MedQA). Me

LeWAM: End-to-End World and Action Modeling with JEPAs

arXiv:2610.12818v1 Announce Type: cross Abstract: Joint-embedding predictive architectures (JEPAs) learn compact latent world models without pixel reconstruction. Existing JEPA pipelines typically tra

LLMail-Inject: A Dataset from a Realistic Adaptive Prompt Injection Challenge

arXiv:2506.09956v2 Announce Type: replace-cross Abstract: Indirect prompt injection attacks exploit a fundamental weakness of LLMs: executing unauthorized tasks from untrusted sources. Despite the pra

Local Diagnostics of Learned Event Representations for Anomaly Detection at the HL-LHC

arXiv:2610.13437v1 Announce Type: new Abstract: Anomaly detection, the identification of collision events that deviate from Standard Model expectations, is one of the most promising model-agnostic str

Localized Generative Design of Ship Hulls with Diffusion Models and High-Fidelity Assessment

arXiv:2610.12870v1 Announce Type: cross Abstract: Practical ship design requires localized refinement and performance evaluation. This paper presents a reward-directed diffusion framework for localize

Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA

arXiv:2610.13128v1 Announce Type: new Abstract: Question answering over large heterogeneous document collections requires first finding the right passages and then reading them, yet current retrieval-

LongHarness: Advancing Agentic Reasoning over 100M-Token Corpora via Stateful Evidence Management

arXiv:2610.13075v1 Announce Type: new Abstract: Corpus-level long-context reasoning requires agents to acquire and integrate evidence across document collections that exceed their context windows. Exi

Looking Ahead and Back: Anticipatory Generative Modeling for Road-Network Trajectories

arXiv:2610.13131v1 Announce Type: new Abstract: Trajectory generation underpins urban applications such as traffic management and urban planning. Within road networks, vehicle movement along road segm

Machine Learning and Time-Series Foundation Models for Day-Ahead Electricity Forecasting in a University Building

arXiv:2610.12638v1 Announce Type: cross Abstract: Day-ahead electricity forecasts can help building operators schedule heating, ventilation, and other services around anticipated demand. Choosing a fo

MagicBeanStalk: Escaping the RLVR Zero Advantage Trap with Recursive Data Synthesis

arXiv:2610.12659v1 Announce Type: new Abstract: Data-centric scaling of RLVR has focused on collecting or generating verifiable training problems. However, corpus size alone does not determine whether

MAGMA-Bench: Evaluating Long-Horizon Embodied Agents under Dynamic Tasks and Execution Failures

arXiv:2610.13534v1 Announce Type: new Abstract: Long-horizon embodied agents must maintain task-relevant information, coordinate heterogeneous robots, and adapt their decisions as execution unfolds. E

Masked Diffusion Language Agents for Tool-Integrated Chemical Reasoning

arXiv:2610.13330v1 Announce Type: new Abstract: Designing tool-integrated reasoning agent systems for complex chemical tasks remains a fundamental challenge. Although recent chemical agents have demon

Matched-Context Group Policy Optimization for LLM Agent Training

arXiv:2610.13755v1 Announce Type: cross Abstract: Training long-horizon language model agents requires assigning credit to intermediate decisions from sparse terminal feedback. Within a finite group o

MathVis: Can AI Reason through Drawing? A Benchmark for Mathematical Figure Generation

arXiv:2610.12954v1 Announce Type: new Abstract: This paper introduces MathVis, a benchmark designed to evaluate LLMs' ability to visualize frontier mathematical problems and perform diagram-assisted r

MC-EvoBench: Auditing Experience-Driven Self-Improvement in Minecraft Agents

arXiv:2610.13829v1 Announce Type: cross Abstract: A central challenge in embodied recursive self-improvement is enabling agents to convert interaction history into capabilities that persist beyond one

MENTOR: Learning from Failure with On-Policy Pedagogical Intervention

arXiv:2610.13594v1 Announce Type: new Abstract: Reinforcement Learning from Verifiable Rewards (RLVR) is a key driver for Large Reasoning Models, but it is vulnerable to 'zero-reward collapse', a trai

Mesh-Native Tokenisation: Retrofitting Foundation Models to Unstructured Data

arXiv:2610.12618v1 Announce Type: cross Abstract: Physics foundation models are an increasingly popular approach for building versatile emulators for spatiotemporal systems. They require tokenisation

Meta-Reflective Evolution Effectively Improves Production AI Systems

arXiv:2610.12794v1 Announce Type: cross Abstract: Large Language Model (LLM)-guided evolutionary optimization has successfully improved prompts, programs, and even entire AI systems. Most optimization

Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editing

arXiv:2610.12881v1 Announce Type: new Abstract: Understanding and manipulating spatial relations is fundamental to AI systems that reason about physical environments and construct grounded world model

Mitigating Capability Degradation in LLM Self-Improvement via Representation Geometry Regularization

arXiv:2610.12855v1 Announce Type: new Abstract: On-Policy Self-distillation is a self-improvement paradigm that enables large language models (LLMs) to improve their capabilities by leveraging the sam

Model-agnostic Knowledge Augmented Machine Learning for Weakly Annotated Bioimaging Data

arXiv:2610.13637v1 Announce Type: cross Abstract: Machine learning models are increasingly used for automated feature extraction from weakly annotated bioimaging data, such as microscopy and cytomorph

MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing

arXiv:2610.12963v1 Announce Type: cross Abstract: Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Bey

MS-GLA: Multi-Scale Gated Linear Attention for Addressing Representational Bottlenecks via Multi-Temporal Resolution

arXiv:2609.35664v2 Announce Type: replace-cross Abstract: Gated Linear Attention (GLA) Transformers advance linear recurrent models through data-dependent gating, but face a core limitation: the fixed

Neural networks are more modular than single neurons suggest

arXiv:2610.12842v1 Announce Type: new Abstract: Neural networks routinely develop representations in which individual neurons contribute to multiple distinct functions, leading to the widespread view

NeuronSpark: Selective Spiking State Space Models with Adaptive Computation for Language Modeling

arXiv:2603.16148v2 Announce Type: replace Abstract: Spiking neural networks promise brain-inspired neural dynamics, yet native large-scale spiking language-model pretraining remains largely unexplored

Not All Dimensions Are Equal: Outlier-Aware Attention Linearization with Grouped Quadratic Kernels

arXiv:2610.13674v1 Announce Type: cross Abstract: Linearizing softmax attention offers a route to efficient Transformer inference, but preserving pretrained attention remains challenging. We identify

OGPO: Offline Goal-conditioned Policy Optimization for Recoverable Vision-Language-Action Models

arXiv:2610.12914v1 Announce Type: new Abstract: Vision-language-action (VLA) models have shown strong promise in robotic manipulation, yet their post-training still predominantly relies on trajectory-

On the Rate of Convergence of GD in Non-linear Neural Networks: An Adversarial Robustness Perspective

arXiv:2603.02095v2 Announce Type: replace-cross Abstract: We study the convergence dynamics of Gradient Descent (GD) in a minimal binary classification setting, consisting of a two-neuron ReLU network

Tutorials

One-Step Text Generation by Seq-Drifting

arXiv:2610.12879v1 Announce Type: new Abstract: Diffusion language models generate tokens in parallel, but still require multiple sampling steps to produce high-quality text. In this paper, we investi

tutorialsarxiv-cs-ai

Applications

Orthros: Phase-Aware Heterogeneous Attention for Efficient Transformers

arXiv:2610.13735v1 Announce Type: cross Abstract: Efficient attention mechanisms, such as linear and sliding window attention, aim to reduce the computational complexity of Transformers from quadratic

applicationsarxiv-cs-ai

PACT: Privileged Trace Co-Training for Multi-Turn Tool-Use Agents

arXiv:2606.16215v2 Announce Type: replace-cross Abstract: Multi-turn tool-use agents must reason, call tools, and adapt to observations across several interaction turns. Post-training such agents is c

Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion

arXiv:2505.22193v2 Announce Type: replace-cross Abstract: Quantum Diffusion Models (QDMs) are an emerging paradigm in Generative AI that aims to use quantum properties to improve the performances of t

Pretraining and Test-Time Training Budgets Matter for ARC: A Controlled Study of VARC and TRM

arXiv:2610.13660v1 Announce Type: cross Abstract: The Abstraction and Reasoning Corpus (ARC) is increasingly used to evaluate whether neural networks can infer task-specific transformations from few d

PRIME: Pre-Retrieval Index Modeling Enhancement for Structured Document Retrieval-Real

arXiv:2610.13296v1 Announce Type: cross Abstract: High-precision retrieval over external knowledge bases is essential for LLM agents to operate effectively. However, existing Information Retrieval (IR

ProgramGym: Scaling Training Environments for Long-Horizon Program Reproduction Agents

arXiv:2610.13395v1 Announce Type: cross Abstract: Coding agents are increasingly used to build programs from scratch as software engineers do rather than to resolve issues within a repository or to ge

Provably Accurate Shapley Value Estimation via Leverage Score Sampling

arXiv:2410.01917v3 Announce Type: replace-cross Abstract: Originally introduced in game theory, Shapley values have emerged as a central tool in explainable machine learning, where they are used to at

Provenance-Aware Belief Updating in Human-AI Feedback Loops

arXiv:2610.13008v1 Announce Type: new Abstract: In repeated human-AI interaction, a single observation can be quoted, summarized, and returned to a model as multiple reports, making repetition look li

Quality, Not Just Outcome: A Structural Scoring Framework for Selecting Coding-Agent Trajectories for Supervised Fine-Tuning

arXiv:2610.13152v1 Announce Type: new Abstract: Open coding agents are commonly trained through supervised fine-tuning on interaction trajectories whose final patches pass the benchmark test suite. Ho

RATED: Reliability-Aware AI Agent Tool Retrieval via Execution Dynamics

arXiv:2610.13889v1 Announce Type: new Abstract: As AI agents increasingly rely on external tools, accurate retrieval is essential for reliable behavior. Existing methods optimize semantic relevance bu

ReasoningShield: Safety Detection over Reasoning Traces of Large Reasoning Models

arXiv:2505.17244v3 Announce Type: replace-cross Abstract: Large Reasoning Models (LRMs) leverage explicit reasoning traces, known as Chain-of-Thought (CoT) reasoning, to decompose complex problems int

Recurrent Harness for Agentic Continual Learning

arXiv:2610.12668v1 Announce Type: cross Abstract: Language model agents increasingly operate over long interaction streams, requiring online adaptation to distribution shifts through continual learnin

REDaCT: Collapse-Free Unlearning in Large Reasoning Models

arXiv:2610.12769v1 Announce Type: cross Abstract: Unlearning in large reasoning models (LRMs) requires removing forget-set information from both the reasoning trace and the final answer. Existing appr

Regression-adjusted Monte Carlo Estimators for Shapley Values and Probabilistic Values

arXiv:2506.11849v3 Announce Type: replace-cross Abstract: With origins in game theory, probabilistic values like Shapley values, Banzhaf values, and semi-values have emerged as a central tool in expla