Search: “benchmark”

ROAR: Unifying Runs across Heterogeneous AI-Driven Research Systems

arXiv:2610.03966v2 Announce Type: replace Abstract: Each run of an AI-driven research system (ADRS) is an expensive search over a vast solution space, and dependable evaluation requires many runs, mak

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

SkillHorizon: Constructing Long-Horizon Agent Tasks through Skill Composition

DGX agent

arXiv:2610.14966v1 Announce Type: new Abstract: Long-horizon agents must complete workflows in which later activities depend on earlier outputs and changes to shared state. A key challenge for evaluat

model-releasesarxiv-cs-ai

15 Oct 2026

SolBehave: Evaluating the Behavioural Correctness of LLM-Generated Smart Contracts

arXiv:2610.18745v1 Announce Type: cross Abstract: Large language models increasingly generate Solidity smart contracts that, once deployed, can never be patched, making a single latent fault permanent

StartLux-Decision: AutoThink Decision Models with Reinforcement Learning for Calibrated Deliberative Decisions

arXiv:2610.17309v1 Announce Type: cross Abstract: We introduce StartLux-Decision, decision models from 0.8B to 27B parameters that combine efficient single-pass prediction with adaptive, confidence-gu

The Invisible Leash: Why RLVR May or May Not Escape Its Origin

model-releasesarxiv-cs-cl

arXiv:2507.14843v5 Announce Type: replace-cross Abstract: Recent advances highlight Reinforcement Learning with Verifiable Rewards (RLVR) as a promising approach to enhancing LLM capabilities. However

The Reasoning Trap -- Logical Reasoning as a Mechanistic Pathway to Situational Awareness

model-releasesarxiv-cs-cl

arXiv:2603.09200v2 Announce Type: replace-cross Abstract: Situational awareness, the capacity of an AI system to recognize its own nature, understand its training and deployment context, and reason st

Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models

model-releasesarxiv-cs-cl

arXiv:2610.19108v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have been widely applied in embodied agents and robotics for vision tasks. However, MLLMs suffer from limitat

Tutorials

What Does LALM Post-training Learn? Rethinking Audio Understanding and Reasoning Capabilities

arXiv:2610.19476v1 Announce Type: cross Abstract: Post-training often improves the performance of large audio-language models on audio understanding and reasoning benchmarks. However, these improvemen

tutorialsarxiv-cs-cl

3D-VITAL: Visibility-aware Identity Training from Artificial Liftings of 3D Reconstruction model for Cross-View Object Re-Identification

arXiv:2610.16692v1 Announce Type: new Abstract: We address the Cross-View Object Re-Identification (ReID) task, aiming to match identities across drastically different viewpoints. We focus on Single-V

AI Discovery in Combinatorics: From Problems to Solutions and Back to Bigger Problems

arXiv:2610.16555v1 Announce Type: cross Abstract: We introduce qtBench, a benchmark of 29 open problems in algebraic combinatorics. These problems ask for a simple combinatorial algorithm that explain

Artificiality's First Exam: An LLM-Referenced C-test for Supraintelligence

arXiv:2610.14005v1 Announce Type: cross Abstract: Under the accelerated pace of AI development, any benchmark whose difficulty is calibrated with humans or current AI systems becomes circular, or satu

AURORA-KITTI: Any-Weather Depth Completion and Denoising

arXiv:2603.14701v2 Announce Type: replace Abstract: Robust depth completion is fundamental to real-world 3D scene understanding, yet existing RGB--LiDAR fusion methods degrade significantly under adve

Beyond a Better Score: Long-Horizon Agentic ML Development and Evaluation Protocol for Physics Time Series

arXiv:2610.14024v1 Announce Type: new Abstract: Physics time-series data are central to fundamental discoveries involving dark matter, neutrinos, and gravitational waves. Machine learning has shown st

Can a Frontier VLM Serve as a Robot Policy for Memory-Dependent Manipulation?

model-releasesarxiv-cs-ro

arXiv:2610.17350v1 Announce Type: new Abstract: We use a frozen frontier vision-language model, GPT-6-Astra, directly as the robot policy on RoboMME, a benchmark of 16 memory-dependent manipulation ta

CAST: Real-Time Motion Capture for Any Skeleton Topology

arXiv:2610.14856v1 Announce Type: new Abstract: This paper studies the problem of recovering motion from monocular video, even when the target skeleton topology differs from the subject observed in th

Code2Worlds-2: Physically Plausible Agent Harness for Embodied World Simulation

arXiv:2610.17651v1 Announce Type: cross Abstract: Recent coding large language models (LLMs) can synthesize dynamic 4D worlds from natural language, but the resulting content remains a visual artifact

DDVR-Net: Degradation-Aware Decoupling and Visibility-Guided Restoration for Historical Document Recognition

arXiv:2610.16956v1 Announce Type: new Abstract: Historical document analysis is crucial for cultural heritage preservation and low-resource language digitization. However, real historical documents of

Diagnosing Generalization Boundaries in AI-Based Vulnerability Detection via Calibrated Embedding Distances

arXiv:2610.14296v1 Announce Type: cross Abstract: High benchmark scores in learning-based vulnerability detection mask severe degradation under distribution shifts. This paper demonstrates that calibr

Efficient Scene-Text Refinement via Pixel-Space Grouped Image Generation

arXiv:2610.18284v1 Announce Type: new Abstract: Generated images often have coherent layouts and visual content, yet local errors in small text and complex characters still limit their readability and

EmoTrace-Bench: Diagnosing Emotional Expression in Text-to-Video Generation through Controlled Cues and Intensity

arXiv:2610.15452v1 Announce Type: new Abstract: Text-to-video (T2V) models are increasingly used to generate videos with targeted emotional expressions, yet existing evaluation methods mainly rely on

Evaluating Long-Horizon Robot Planning under Uncertainty

model-releasesarxiv-cs-ro

arXiv:2610.17326v1 Announce Type: new Abstract: Household robots must successfully navigate im-perfect circumstances, both in their internal models and the external world. We introduce a benchmark of

Explicitly Aligned Multi-View Breast Cancer Risk Prediction from Variable-Length Screening Histories

arXiv:2610.16329v1 Announce Type: new Abstract: Accurate breast cancer risk prediction from screening mammography is essential for improved risk stratification and personalized screening. It can benef

Fitting Every Hint Is Not Enough: Premature Floods in Recurrent Algorithmic Reasoners

arXiv:2610.14982v1 Announce Type: new Abstract: Recurrent algorithmic reasoners are trained with per-step hints on small graphs and run for many more steps on large ones. On breadth-first search in SA

From Classification to Cross-Modal Understanding: Leveraging Vision-Language Models for Fine-Grained Renal Pathology

arXiv:2511.11984v2 Announce Type: replace Abstract: Fine-grained glomerular subtyping is essential for kidney biopsy interpretation, yet it presents a harder setting than the broad organ- or disease-l

InfoVis: Unified Slide Image Generation and Editing

arXiv:2610.16784v1 Announce Type: new Abstract: Generating and editing presentation slides requires models to combine accurate text rendering, instruction following, visual grounding, aesthetic design

IsoVRBench: Video Reward Modeling Without Human Feedback

arXiv:2610.17234v1 Announce Type: cross Abstract: Video reward models are trained and evaluated on human preferences between videos that often differ simultaneously on properties such as prompt alignm

Mean Accuracy Is the Wrong Estimand for a Release Decision

arXiv:2610.16825v1 Announce Type: new Abstract: A release decision about a fine-tuned model is an operational commitment about the next rerun of its training recipe. Yet standard benchmark reporting g

Overcoming Catastrophic Forgetting: Continual Learning for Radar Waveform Classification

arXiv:2610.18404v1 Announce Type: cross Abstract: Automated radar waveform recognition classifies the waveform and modulation type of a received signal. As new waveform variants appear over time, a de

Q-Save: Towards Scoring and Attribution for Generated Video Evaluation

arXiv:2511.18825v3 Announce Type: replace Abstract: Evaluating AI-generated video (AIGV) quality hinges on three crucial dimensions: visual quality, dynamic quality, and text-video alignment. While nu

RAIN: Robotic Task Generalization with Region-Aware Interaction Networks

arXiv:2610.14039v1 Announce Type: cross Abstract: Existing vision-language-action (VLA) models benefit from large-scale vision-language pretraining, but tend to memorize training trajectories, limitin

RIECNN: Real-Time Image Enhanced CNN for Traffic Sign Recognition

arXiv:2610.15127v1 Announce Type: new Abstract: Traffic sign recognition plays a crucial role in the development of autonomous cars to reduce the accident rate and promote road safety. It has been a n

RootSLAM: Square Root Bundle Adjustment for Visual-Inertial SLAM

arXiv:2610.15157v1 Announce Type: cross Abstract: Efficient perception is a prerequisite for the small, low-power devices targeted by robotics, mixed reality, autonomous driving, and drone application

SEAR: Self-Evolving Agentic Robotics

model-releasesarxiv-cs-ro

arXiv:2610.18792v1 Announce Type: new Abstract: Frontier language-model agents can now improve robots on their own: they write control code, test it, and keep what works as skills and memories for the

ShoeFit: A New Dataset and Dual-image-stream DiT Framework for Virtual Footwear Try-On

arXiv:2610.18325v1 Announce Type: new Abstract: Virtual footwear try-on (VFTON), a critical yet underexplored area in virtual try-on (VTON), aims to synthesize faithful try-on results given diverse fo

SliderEdit++: Improved Slider Trajectories in Instruction-Based Image Editing

arXiv:2610.14253v1 Announce Type: new Abstract: Slider-based control aims to give users continuous, fine-grained control over the intensity of individual edits in instruction-based image editing. Howe

ST-GRU PredRNN-V2: A GRU-Based Reformulation of PredRNN-V2 for Video Prediction

arXiv:2610.18645v1 Announce Type: new Abstract: Video prediction requires models to capture complex spatiotemporal dependencies and to retain relevant information over long sequences. PredRNN and its

Local Ai

The Federated Tumor Segmentation and Classification (FeTS++) Challenge

arXiv:2610.18771v1 Announce Type: new Abstract: International challenges have become the standard for developing and benchmarking biomedical image analysis methods using centralized multi-institutiona

local-aiarxiv-cs-cv

Research

Token-Budgeted Candidate Retrieval for 3D Scene-Grounded VLMs: Category Names vs. Pairwise Geometry

arXiv:2610.14207v1 Announce Type: new Abstract: Under a fixed context budget, which objects and relations should a 3D scene-grounded VLM see first? On ScanNet indoor referring benchmarks (Dai et al.,

researcharxiv-cs-cv

Research

Unsupervised Data Drift Monitoring for Deployed Deepfake Speech Detectors

arXiv:2610.16826v1 Announce Type: cross Abstract: Deepfake speech detectors are typically evaluated as binary classifiers on fixed benchmarks, but deployed systems face evolving attacks, codecs, speak

researcharxiv-cs-cv

VideoEvoHarness: Self Evolving Agent Harness from Unlabeled Videos for Video Understanding

arXiv:2610.15389v1 Announce Type: new Abstract: Video understanding agents rely on a harness to acquire evidence, use tools, and reason, but improving it requires substantial effort. Recent self evolu

VisualCoding: Learning Executable Skills for Reliable Visual Reasoning

arXiv:2610.14403v1 Announce Type: new Abstract: Learning reusable skills can improve visual reasoning agents, yet applying a skill still requires the agent to implement or invoke a procedure and produ

Research

When Repeated Measurements Hurt Tabular Foundation Models

arXiv:2610.16801v1 Announce Type: cross Abstract: Tabular foundation models (TFMs) achieve state-of-the-art performance on IID benchmarks, but how do they respond to repeated measurements at the same

researcharxiv-cs-lg

World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models

arXiv:2610.17434v1 Announce Type: new Abstract: Recent advances in video world models have enabled plausible interactive environments, yet long-horizon generation places a fundamental demand on visual

A Categorical Atlas of Parameter-Efficient Fine-Tuning: Cones, Orbits, and Gauges

arXiv:2610.12728v1 Announce Type: new Abstract: Parameter-efficient fine-tuning has hundreds of methods, usually compared by parameter count and benchmark score. We compare them as maps. A pretrained

AlphaNIST: Emergent Assembly Skills from Binary Task Rewards

arXiv:2610.13354v1 Announce Type: new Abstract: The NIST Assembly Task Board #1 remains a challenging benchmark for learning-based methods in robotic manipulation. Over short horizons, it demands prec

Safety

AutoControl Arena: Synthesizing Executable Test Environments for Frontier AI Risk Evaluation

arXiv:2603.07427v3 Announce Type: replace Abstract: As Large Language Models (LLMs) evolve into autonomous agents, existing safety evaluations face a fundamental trade-off: manual benchmarks are costl

safetyarxiv-cs-ai

Behind-the-Meter Photovoltaic Visibility from Net Smart Meters: Deployment Regimes and Operational Insights

arXiv:2610.12527v1 Announce Type: new Abstract: Distribution operators need visibility of behind-the-meter photovoltaic (PV) generation, yet most residential customers are observed only through net sm

Cross-Behavior Policy Optimization: Unified Learning from Offline Demonstrations and On- and Off-Policy Rollouts via a Shared Regression Target

arXiv:2610.12830v1 Announce Type: new Abstract: Reasoning post-training draws on offline demonstrations and policy-generated rollouts, yet conventional supervised fine-tuning (SFT) followed by reinfor