Search: “benchmark”

Sentry: Learning to Recover from LLM Agent Failures at Test Time

arXiv:2610.02994v1 Announce Type: cross Abstract: LLM agents often fail mid-task due to invalid tool calls, repeated actions, or poorly grounded reasoning, and learning from these failures is a path t

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

VDOT++: Unified Few-Step Video Generation via Unbalanced Optimal Transport Distillation

DGX agent

arXiv:2610.03221v1 Announce Type: new Abstract: Video creation spans text-to-video (T2V), image-to-video (I2V), and condition-based generation, yet video diffusion models remain costly because they re

model-releasesarxiv-cs-cv

5 Oct 2026

VisAudit: Evaluating Multimodal Agents for Visual Diagnosis and Repair

arXiv:2610.02399v1 Announce Type: new Abstract: Multimodal agents are increasingly used for data visualization tasks but remain limited in autonomous review. Unlike humans, they may fail to recognize

VTBench: Evaluating Visual Tokenizers for Autoregressive Image Generation

arXiv:2505.13439v2 Announce Type: replace-cross Abstract: Autoregressive (AR) models have recently shown strong performance in image generation, where a critical component is the visual tokenizer (VT)

Local Ai

When Does Synthetic Relational Data Teach Models to Use Relations? Tracing Predictive Structure from Pretraining Data to Model Behavior

arXiv:2610.03057v1 Announce Type: new Abstract: Relational foundation models are increasingly pretrained on synthetic databases, yet downstream benchmarks reveal little about why one synthetic corpus

local-aiarxiv-cs-lg

World Editing: Intervening on Executable Worlds at Increasing Depth

arXiv:2610.02331v1 Announce Type: new Abstract: Interactive world models are increasingly capable of generating environments and acting within them, yet deliberately editing an existing executable wor

ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild

arXiv:2610.01314v1 Announce Type: new Abstract: Dynamic scenes may be captured by a moving camera, multiple video streams, or images taken at different times. These observations reveal complementary a

AstroAgentBench: Evaluating Agentic Planning on Space Mission Planning Tasks

arXiv:2601.11354v2 Announce Type: replace Abstract: Recent LLM-for-Space systems address mission planning, scheduling, operations support, simulator control, and autonomy, but their evaluations use di

Research

Attention Kernels for Learning Maps Between Heavy-Tailed Measures

arXiv:2610.00564v1 Announce Type: new Abstract: Operator learning on probability measures can be accomplished with transformers. For measures with polynomial tails, the exponential weighting in softma

researcharxiv-cs-lg

Autoregressive Drillhole Modelling Under Distribution Shift

arXiv:2610.01204v1 Announce Type: new Abstract: Autoregressive modelling has achieved remarkable success in language and sequence tasks by learning to predict future states from previous observation.

AVSD-Scenes: A Dataset for Audio-Visual Description of Urban Scenes

arXiv:2610.01861v1 Announce Type: new Abstract: Natural language descriptions can provide rich semantic representations of audio-visual urban scenes, yet datasets that jointly describe both auditory a

Beyond Pointwise Error: A Multi-Metric Evaluation of Spatial Climate Downscaling

arXiv:2610.01579v1 Announce Type: cross Abstract: Climate downscaling aims to reconstruct fine scale spatial fields from coarse resolution inputs. Evaluating the quality of these reconstructions is ch

CHILLGuard: Towards Fine-Grained Chinese LLM Safety Guardrail with Scalable Data Construction and Model-aware Preference Alignment

arXiv:2606.15396v2 Announce Type: replace-cross Abstract: Malicious content generated from large language models (LLMs) could pose severe safety risks and ethical concerns. While existing LLM safety g

CineMR: Tool-Integrated Vision-Language Reasoning for Quantitative Cardiac MRI Assessment

arXiv:2610.01166v1 Announce Type: cross Abstract: Cardiovascular magnetic resonance (CMR), including cine imaging, is a reference standard for the noninvasive assessment of cardiac morphology and vent

Clock Diffusion: Efficient Semi-Autoregressive Continuous Diffusion Language Models

arXiv:2610.00894v1 Announce Type: new Abstract: Recent works on continuous diffusion for discrete data have demonstrated performance on par with comparable discrete diffusion models. However, these co

Dataset Identity, Not Novelty: The Source of an Inflated OOD Detection Gain

arXiv:2610.01096v1 Announce Type: cross Abstract: A post-hoc out-of-distribution (OOD) detector reads the activations of a trained classifier and returns a score. It fits that score on in-distribution

Divide-and-Remember: Recursive Action-Relevant Memory for Long-Horizon VLA Policies

arXiv:2610.00982v1 Announce Type: cross Abstract: Vision-language-action (VLA) models struggle on history-dependent manipulation tasks, where the current observation alone does not determine the actio

Encoded but Disconnected: Decomposing Vision-Language Model Failures under a Patching Null

arXiv:2610.00024v1 Announce Type: new Abstract: Across three vision-language model architectures (LLaVA-1.5-7B, Qwen2.5-VL-7B, InternVL3-8B), we report a universal negative finding for mid-layer inter

EviGraph: Proof-Carrying Selective Recommendation over Temporal Public-Service Knowledge Graphs

arXiv:2610.00212v1 Announce Type: new Abstract: Public-service recommendations require evidence that matches the requested service, scope, and date. Yet treating every missing detail as decisive can w

FFBL-Coop: Association-Decoupled Cooperative 3D Multi-Object Tracking

arXiv:2610.01750v1 Announce Type: new Abstract: Cooperative 3D tracking must integrate complementary observations across agents and time while maintaining consistent identities. When evidence integrat

FORALL-LEAN-AGENT for Auditable Reasoning in Formal Mathematics and Software Verification

arXiv:2610.00885v1 Announce Type: cross Abstract: Coding agents increasingly automate Lean proof development, but successful compilation alone does not establish that a candidate proves the intended s

Applications

Foundations without Fundamentals: Zero-Shot Blind Spots in Time Series FMs

arXiv:2610.02058v1 Announce Type: new Abstract: Despite the success of Time Series Foundation Models (TSFMs) on broad benchmarks, their ability to internalize basic temporal logic, especially in setti

applicationsarxiv-cs-lg

Research

FourierQK: Filter Shape, Admissibility and the Leakage-Coverage Law

arXiv:2610.00009v1 Announce Type: new Abstract: Frequency-collapse attention [Zeris, 2026e] achieves large gains over standard dot-product attention by replacing the Q/K dot product with a bandpass-fi

researcharxiv-cs-lg

Safety

From Image Latent Space to Fuzzy Rules: Interpretable Analysis of Gastrointestinal Foundation Model

arXiv:2610.00414v1 Announce Type: new Abstract: Foundation models pretrained on large-scale datasets demonstrate strong transferability to medical imaging tasks. However, understanding how their laten

safetyarxiv-cs-cv

Applications

Generalist Representation, Specialist Detection: TS-Router for Time-Series Anomaly Detection

arXiv:2610.00978v1 Announce Type: cross Abstract: Time-series anomaly detection (TSAD) is difficult to generalize across datasets because heterogeneous temporal dynamics imply different notions of nor

applicationsarxiv-cs-ai

Generalized Design Choices for Deepfake Detectors

arXiv:2511.21507v2 Announce Type: replace Abstract: The effectiveness of deepfake detection methods often depends less on their core design and more on implementation details such as data preprocessin

Have an LLM Write Your Anomaly Detector: Autonomous Discovery of Compact, Interpretable Detectors for Time Series

arXiv:2610.01223v1 Announce Type: cross Abstract: Time-series anomaly detection trades off predictive accuracy, computational efficiency, and interpretability. We use a large language model not as the

HydroJEV: A one-second, training-free screen for cyber-attack and fault attribution in water distribution networks

arXiv:2610.02048v1 Announce Type: new Abstract: When a SCADA alarm is raised in a water distribution network, operators must decide quickly whether it reflects a cyberattack, a physical fault, a norma

Interpretable Synthetic Medical Tabular Data Generation for Clinical Decision Support Using Fuzzy Cognitive Maps

arXiv:2610.00391v1 Announce Type: cross Abstract: Synthetic medical tabular data generation has become essential for developing and validating computer-based medical systems (CBMSs) when real clinical

Invent a Dataset: Measuring dataset generation abilities with zero seed

arXiv:2610.01674v1 Announce Type: new Abstract: Building datasets remains one of the most manual and brittle parts of AI development. In this technical report, we focus on the most extreme but also mo

Measuring Iterative Temporal Reasoning with Time Puzzles

arXiv:2601.07148v4 Announce Type: replace-cross Abstract: Tool use, such as web search, has become a standard capability even in freely available large language models (LLMs). However, existing benchm

Measuring the Microtask Eligibility Gap: When Is an Off-the-Shelf SLM Enough for an Agent Harness?

arXiv:2610.00025v1 Announce Type: new Abstract: Agent harnesses increasingly want to run small language models (SLMs) on the microtasks around a frontier large language model (LLM) planner: auto-appro

Measuring the Stability Assumption Behind Action Chunking

arXiv:2610.01626v1 Announce Type: new Abstract: Action chunking improves the performance of policies learned by behavioural cloning, and several mechanisms have been proposed to explain why, including

Hardware

MINCE: Shrinking LLM Evaluation Datasets via Few-Model Monte Carlo Calibration

arXiv:2606.22826v2 Announce Type: replace Abstract: Evaluating LLMs across many model variants---quantized, fine-tuned, or deployment-specific---requires running large benchmarks repeatedly, a process

hardwarearxiv-cs-ai

OpenMTB-Audit: Exposing Over-Refusal and Clinical Expert Perspectives in LLM-Based Molecular Tumor Board Safety Evaluation

arXiv:2610.01497v1 Announce Type: new Abstract: Molecular tumor boards integrate genomic findings, clinical context, and therapeutic evidence to support precision oncology. As AI enters this workflow,

PACT: End-to-End Learning of Human Pose, Contacts, and Forces from Video

arXiv:2610.00451v1 Announce Type: cross Abstract: Human motion, environmental contacts, and interaction forces are governed by common physical laws, yet existing approaches typically separate visual p

Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimization

arXiv:2610.01017v1 Announce Type: new Abstract: Large language models (LLMs) increasingly construct multi-agent workflows that decompose a complex task and assign specialist agents from a pool. Howeve

Personalized Image Generation with Reasoning and Reflection

arXiv:2610.00737v1 Announce Type: cross Abstract: Personalized image generation has remained narrowly focused on conditional synthesis from curated visual exemplars, rather than capturing who a user i

PG-SFT: Balancing Capability Acquisition and Retention in Offline Agent Fine-Tuning

arXiv:2610.00949v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) on offline agent trajectories is the standard approach for training specialized tool-using agents, but forcing models to im

PRISM: A Category-Theoretic Framework for Measuring and Refining Multimodal Analogies

arXiv:2610.01383v1 Announce Type: new Abstract: Analogical reasoning involves identifying and preserving relational structures across domains. However, existing approaches to AI-driven multimodal anal

Q-Learning for Reachability in MEC-Free MDPs

arXiv:2610.01781v1 Announce Type: new Abstract: Reinforcement learning (RL) for reachability specifications is fundamental to sequential decision-making. Prior work establishes asymptotic convergence

Real-time Appearance-based Gaze Estimation for Open Domains

arXiv:2603.26945v2 Announce Type: replace Abstract: Appearance-based gaze estimation (AGE) has achieved remarkable performance in constrained settings, yet we reveal a significant generalization gap w

Reputation, Strategy, and Emotion Effects on Generative AI Cooperation: A Comparison Across Reasoning and Non-Reasoning Models

arXiv:2610.01222v1 Announce Type: new Abstract: As generative AI (Gen AI) systems take on increasingly autonomous roles in economically and socially consequential interactions, understanding their pro

Retrospective Open-Vocabulary Memory for Long-Term Object Search

arXiv:2610.00330v1 Announce Type: cross Abstract: Long-term object search requires learning where objects usually appear from repeated but uneven observations of a changing environment. We formulate r

REVEAL: Robust Evolution of Vision-Language Models for Explainable AI-Video Detection

arXiv:2502.14994v2 Announce Type: replace Abstract: The rapid advancement of AI-generated video poses challenges to digital authenticity and security. Current detection methods, often trained on speci

Revisiting Cross-Reconstruction for Generalizable Deepfake Detection

arXiv:2610.01544v1 Announce Type: new Abstract: Existing image forgery detectors often suffer from generalization to unseen manipulation methods due to the limited ability to capture transferable fore

Skin-Deep: A Geometric Diagnostic for Alignment Fragility in Large Language Model Representations

arXiv:2606.22676v2 Announce Type: replace Abstract: Refusal on a safety benchmark does not reveal how stable that behavior will remain after model updates. Benign downstream fine-tuning can weaken ref

SLIM: Simplex-Lattice Interpolation Merging

arXiv:2610.01037v1 Announce Type: new Abstract: Optimizing merging coefficients for large language models can require many costly benchmark evaluations. We propose extbf{Simplex-Lattice Interpolation