Search: “arxiv-cs-ai”

Matched-Context Group Policy Optimization for LLM Agent Training

arXiv:2610.13755v1 Announce Type: cross Abstract: Training long-horizon language model agents requires assigning credit to intermediate decisions from sparse terminal feedback. Within a finite group o

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

MathVis: Can AI Reason through Drawing? A Benchmark for Mathematical Figure Generation

DGX agent

arXiv:2610.12954v1 Announce Type: new Abstract: This paper introduces MathVis, a benchmark designed to evaluate LLMs' ability to visualize frontier mathematical problems and perform diagram-assisted r

model-releasesarxiv-cs-ai

12 Oct 2026

MC-EvoBench: Auditing Experience-Driven Self-Improvement in Minecraft Agents

arXiv:2610.13829v1 Announce Type: cross Abstract: A central challenge in embodied recursive self-improvement is enabling agents to convert interaction history into capabilities that persist beyond one

MENTOR: Learning from Failure with On-Policy Pedagogical Intervention

arXiv:2610.13594v1 Announce Type: new Abstract: Reinforcement Learning from Verifiable Rewards (RLVR) is a key driver for Large Reasoning Models, but it is vulnerable to 'zero-reward collapse', a trai

Mesh-Native Tokenisation: Retrofitting Foundation Models to Unstructured Data

arXiv:2610.12618v1 Announce Type: cross Abstract: Physics foundation models are an increasingly popular approach for building versatile emulators for spatiotemporal systems. They require tokenisation

Meta-Reflective Evolution Effectively Improves Production AI Systems

arXiv:2610.12794v1 Announce Type: cross Abstract: Large Language Model (LLM)-guided evolutionary optimization has successfully improved prompts, programs, and even entire AI systems. Most optimization

Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editing

arXiv:2610.12881v1 Announce Type: new Abstract: Understanding and manipulating spatial relations is fundamental to AI systems that reason about physical environments and construct grounded world model

Mitigating Capability Degradation in LLM Self-Improvement via Representation Geometry Regularization

arXiv:2610.12855v1 Announce Type: new Abstract: On-Policy Self-distillation is a self-improvement paradigm that enables large language models (LLMs) to improve their capabilities by leveraging the sam

Model-agnostic Knowledge Augmented Machine Learning for Weakly Annotated Bioimaging Data

arXiv:2610.13637v1 Announce Type: cross Abstract: Machine learning models are increasingly used for automated feature extraction from weakly annotated bioimaging data, such as microscopy and cytomorph

MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing

arXiv:2610.12963v1 Announce Type: cross Abstract: Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Bey

MS-GLA: Multi-Scale Gated Linear Attention for Addressing Representational Bottlenecks via Multi-Temporal Resolution

arXiv:2609.35664v2 Announce Type: replace-cross Abstract: Gated Linear Attention (GLA) Transformers advance linear recurrent models through data-dependent gating, but face a core limitation: the fixed

Neural networks are more modular than single neurons suggest

arXiv:2610.12842v1 Announce Type: new Abstract: Neural networks routinely develop representations in which individual neurons contribute to multiple distinct functions, leading to the widespread view

NeuronSpark: Selective Spiking State Space Models with Adaptive Computation for Language Modeling

arXiv:2603.16148v2 Announce Type: replace Abstract: Spiking neural networks promise brain-inspired neural dynamics, yet native large-scale spiking language-model pretraining remains largely unexplored

Not All Dimensions Are Equal: Outlier-Aware Attention Linearization with Grouped Quadratic Kernels

arXiv:2610.13674v1 Announce Type: cross Abstract: Linearizing softmax attention offers a route to efficient Transformer inference, but preserving pretrained attention remains challenging. We identify

OGPO: Offline Goal-conditioned Policy Optimization for Recoverable Vision-Language-Action Models

arXiv:2610.12914v1 Announce Type: new Abstract: Vision-language-action (VLA) models have shown strong promise in robotic manipulation, yet their post-training still predominantly relies on trajectory-

On the Rate of Convergence of GD in Non-linear Neural Networks: An Adversarial Robustness Perspective

arXiv:2603.02095v2 Announce Type: replace-cross Abstract: We study the convergence dynamics of Gradient Descent (GD) in a minimal binary classification setting, consisting of a two-neuron ReLU network

Tutorials

One-Step Text Generation by Seq-Drifting

arXiv:2610.12879v1 Announce Type: new Abstract: Diffusion language models generate tokens in parallel, but still require multiple sampling steps to produce high-quality text. In this paper, we investi

tutorialsarxiv-cs-ai

Applications

Orthros: Phase-Aware Heterogeneous Attention for Efficient Transformers

arXiv:2610.13735v1 Announce Type: cross Abstract: Efficient attention mechanisms, such as linear and sliding window attention, aim to reduce the computational complexity of Transformers from quadratic

applicationsarxiv-cs-ai

PACT: Privileged Trace Co-Training for Multi-Turn Tool-Use Agents

arXiv:2606.16215v2 Announce Type: replace-cross Abstract: Multi-turn tool-use agents must reason, call tools, and adapt to observations across several interaction turns. Post-training such agents is c

Physics-inspired Generative AI models via real hardware-based noisy quantum diffusion

arXiv:2505.22193v2 Announce Type: replace-cross Abstract: Quantum Diffusion Models (QDMs) are an emerging paradigm in Generative AI that aims to use quantum properties to improve the performances of t

Pretraining and Test-Time Training Budgets Matter for ARC: A Controlled Study of VARC and TRM

arXiv:2610.13660v1 Announce Type: cross Abstract: The Abstraction and Reasoning Corpus (ARC) is increasingly used to evaluate whether neural networks can infer task-specific transformations from few d

PRIME: Pre-Retrieval Index Modeling Enhancement for Structured Document Retrieval-Real

arXiv:2610.13296v1 Announce Type: cross Abstract: High-precision retrieval over external knowledge bases is essential for LLM agents to operate effectively. However, existing Information Retrieval (IR

ProgramGym: Scaling Training Environments for Long-Horizon Program Reproduction Agents

arXiv:2610.13395v1 Announce Type: cross Abstract: Coding agents are increasingly used to build programs from scratch as software engineers do rather than to resolve issues within a repository or to ge

Provably Accurate Shapley Value Estimation via Leverage Score Sampling

arXiv:2410.01917v3 Announce Type: replace-cross Abstract: Originally introduced in game theory, Shapley values have emerged as a central tool in explainable machine learning, where they are used to at

Provenance-Aware Belief Updating in Human-AI Feedback Loops

arXiv:2610.13008v1 Announce Type: new Abstract: In repeated human-AI interaction, a single observation can be quoted, summarized, and returned to a model as multiple reports, making repetition look li

Quality, Not Just Outcome: A Structural Scoring Framework for Selecting Coding-Agent Trajectories for Supervised Fine-Tuning

arXiv:2610.13152v1 Announce Type: new Abstract: Open coding agents are commonly trained through supervised fine-tuning on interaction trajectories whose final patches pass the benchmark test suite. Ho

RATED: Reliability-Aware AI Agent Tool Retrieval via Execution Dynamics

arXiv:2610.13889v1 Announce Type: new Abstract: As AI agents increasingly rely on external tools, accurate retrieval is essential for reliable behavior. Existing methods optimize semantic relevance bu

ReasoningShield: Safety Detection over Reasoning Traces of Large Reasoning Models

arXiv:2505.17244v3 Announce Type: replace-cross Abstract: Large Reasoning Models (LRMs) leverage explicit reasoning traces, known as Chain-of-Thought (CoT) reasoning, to decompose complex problems int

Recurrent Harness for Agentic Continual Learning

arXiv:2610.12668v1 Announce Type: cross Abstract: Language model agents increasingly operate over long interaction streams, requiring online adaptation to distribution shifts through continual learnin

REDaCT: Collapse-Free Unlearning in Large Reasoning Models

arXiv:2610.12769v1 Announce Type: cross Abstract: Unlearning in large reasoning models (LRMs) requires removing forget-set information from both the reasoning trace and the final answer. Existing appr

Regression-adjusted Monte Carlo Estimators for Shapley Values and Probabilistic Values

arXiv:2506.11849v3 Announce Type: replace-cross Abstract: With origins in game theory, probabilistic values like Shapley values, Banzhaf values, and semi-values have emerged as a central tool in expla

Applications

RegulaTutor: A Theory-Informed Framework for Long-Term Personalized Learning

arXiv:2610.13399v1 Announce Type: new Abstract: Long-term personalized tutoring requires language models to translate a learner's evolving history into appropriate instructional support. Existing LLM-

applicationsarxiv-cs-ai

ReplaySSM: Cache SSM Inputs, Not State

arXiv:2610.13778v1 Announce Type: cross Abstract: State-space models (SSMs) maintain a fixed-size recurrent state, but reading and writing it at every decoding step can bottleneck hybrid models. This

Representation Alignment from a Few Paired Data via Distilled Optimal Transport

arXiv:2610.12781v1 Announce Type: new Abstract: Aligning two independently pretrained unimodal encoders typically demands millions of paired examples. In this paper, we study the regime where only N s

RESCUE: Is This Alarm Worth Acting On? Counterfactual Evaluation of VLA Runtime Monitors

arXiv:2610.13516v1 Announce Type: cross Abstract: Runtime failure monitors for robot policies are typically evaluated by how accurately they distinguish failed from successful executions. Yet an accur

Applications

ReSFlow: Rectifying Categorical Flows on Statistical Manifolds for One-Step Generation

arXiv:2610.13225v1 Announce Type: cross Abstract: Generative modeling for discrete data has been significantly advanced by learning continuous vector fields on the statistical manifolds to transport s

applicationsarxiv-cs-ai

Retrieval-Augmented Multimodal Language Model with Heterogeneous Evidence Integration for Clinical Prognosis

arXiv:2610.13510v1 Announce Type: new Abstract: Clinical prognosis requires integrating structured measurements, physiological waveforms, longitudinal history, and population context. We introduce PRI

Revisiting Tabular Deep Regression: Objectives and the Limits of Global Early Stopping

arXiv:2610.13909v1 Announce Type: cross Abstract: While deep learning models for tabular data have recently received significant research attention, the choice of objective functions for regression ta

Reward Hacking as a Transmissible Strategy in Multi-Agent Coding Systems

arXiv:2610.12822v1 Announce Type: new Abstract: Multi-agent systems are increasingly used to solve coding tasks by coordinating agents that share code and plans. These agents are often optimized with

Robustness of Reinforcement Learning-Based Congestion Management in Low-Voltage Grids

arXiv:2607.16004v2 Announce Type: replace-cross Abstract: Increases in photovoltaic generation, charging of electric vehicles and heat-pump demand challenge operating limits in low-voltage distributio

RoleWorld: Knowledge Transfer in World Modeling with Functional Role Abstractions

arXiv:2610.13172v1 Announce Type: new Abstract: World models enable large language model (LLM) agents to anticipate action effects and make informed decisions. For generalization, it is desirable for

Rollout-Time Intervention: Unlocking Agentic Reinforcement Learning Beyond Policy Limits

arXiv:2610.13438v1 Announce Type: new Abstract: Reinforcement learning (RL) has emerged as a key paradigm for improving large language model (LLM) agents, enabling stronger reasoning, planning, and to

SafeDiSTL: Decomposing Joint Constraints for Safe Multi-Agent Reinforcement Learning

arXiv:2610.13737v1 Announce Type: cross Abstract: Cooperative multi-agent tasks often impose constraints on a shared objective or collective safety. A team level violation cost function can measure th

Same Query, Different Answer: Run-to-Run Variance in Semantic Query Processing

arXiv:2610.13823v1 Announce Type: cross Abstract: Semantic query engines ask a large language model (LLM) to judge individual rows, and benchmarks compare these engines on the quality of a few executi

Scalable Circuit Learning for Interpreting Large Language Models

arXiv:2606.16939v2 Announce Type: replace-cross Abstract: A prominent research direction in mechanistic interpretability is learning sparse circuits over LLM components to reveal how they jointly prod

Scaling Empowered Agents

arXiv:2610.13002v1 Announce Type: new Abstract: Empowerment measures the capacity of an agent to actively control its environment. In this work, we explain the connection between skill learning and em

SelectArena: A Modern Benchmark for Feature Selection on Real-world Tabular Data

arXiv:2610.13644v1 Announce Type: cross Abstract: Selecting a subset of features (columns) from a tabular dataset is a ubiquitous challenge in real-world applications. Industry experts seek to minimiz

Self-Preservation in Language Models

arXiv:2610.12602v1 Announce Type: cross Abstract: Continual learning (CL) seeks to adapt pretrained models while preserving prior capabilities. Yet the tasks supplied for preservation cover only part