Search: “benchmark”

DABACO: A Multi-Camera Dataset and Benchmark for Screen Localization and Pointing Estimation

arXiv:2610.03928v1 Announce Type: new Abstract: Screen localization and pointing estimation are key to low-cost interactive devices. Yet developing and evaluating these algorithms requires realistic d

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Does Neural Complexity Improve Health Misinformation Detection? A Leakage-Controlled Cross-Corpus Benchmark

DGX agent

arXiv:2610.04636v1 Announce Type: cross Abstract: Increasing architectural complexity is often assumed to improve health misinformation detection, yet reported gains are difficult to interpret when st

model-releasesarxiv-cs-lg

6 Oct 2026

EXHIB: A Benchmark for Realistic and Diverse Evaluation of Function Similarity in the Wild

arXiv:2604.01554v2 Announce Type: replace-cross Abstract: Binary Function Similarity Detection (BFSD) is a core problem in software security, supporting tasks such as vulnerability analysis, malware c

RMMBench: A Comprehensive Benchmark for Robotic Mobile Manipulation

model-releasesarxiv-cs-ro

arXiv:2610.05414v1 Announce Type: new Abstract: Although the advancement of vision-language models (VLMs) has endowed robots with enhanced environmental understanding and task reasoning, a comprehensi

Same Pieces, Different Servers: A Tetris Benchmark for AI Agents as Served

arXiv:2603.02348v2 Announce Type: replace Abstract: An agent meets a model as served: through an endpoint with a price card, a shared cache and other tenants, or on whatever hardware a self-hosted mod

SkillScriptBench: Benchmarking Self-Evolution of Executable Agent Skill Packages Beyond Markdown

arXiv:2610.04008v1 Announce Type: cross Abstract: Executable Agent Skills combine natural-language instructions and scripts into reusable packages for LLM agents, and revising them requires fixing err

A Benchmark for Spatially Grounded Gesture Generation

arXiv:2610.03105v1 Announce Type: new Abstract: Communication in shared space interweaves verbal and non-verbal signals, and pointing gestures anchor language to the environment: 'put the cup on that

Benchmarking Candidate Coverage in Typed Decision Models

arXiv:2610.03387v1 Announce Type: new Abstract: Typed decision models return choices or distributions over answer options supplied at request time. Accuracy with complete options does not establish wh

RNADyn: A Benchmark for Generating and Understanding RNA Dynamics

arXiv:2610.03712v1 Announce Type: new Abstract: Ribonucleic acid (RNA) functions through conformational changes that are not fully captured by static structures. However, large-scale standardized RNA

TPBench: A Turning-Point Benchmark for Dialogue Compression

arXiv:2610.02736v1 Announce Type: cross Abstract: A compressor can keep the facts of a dialogue and still drop the turn that changed them. A user corrects a price, reverses a choice, or adds a constra

Research

Benchmarking System One decision models against trained classifiers and language models for automated decision gates

arXiv:2610.00346v1 Announce Type: new Abstract: Software that hands branching decisions to a model needs a declared option and a probability it can threshold. Typed decision models, also called System

researcharxiv-cs-lg

Bounded-Fidelity Sim-as-Demo-Stage: Mocap Handoff for Governance Benchmarks

arXiv:2610.00008v1 Announce Type: cross Abstract: Sim-to-real research pursues physics fidelity as a primary objective: simulators are judged by how closely they reproduce real-world contact dynamics.

DuplexSpeechBench-Document Grounding: Benchmarking Document Grounding and Hallucinations in Voice Agents

arXiv:2610.00316v1 Announce Type: cross Abstract: Voice agents enable low-latency, natural interaction, yet their ability to faithfully ground responses in external documents remains underexplored. We

HumanoidToolBench: Benchmarking Humanoid Tool Use from Selection to Mobile Execution

arXiv:2610.02089v1 Announce Type: cross Abstract: As robotic hardware and learning methods advance, humanoids need tools to perform tasks beyond their inherent physical limits. Successful tool use req

TrueMuse: A Benchmark for Data Attribution in Text-to-Music Models

arXiv:2610.00835v1 Announce Type: new Abstract: Text-to-music generation models are trained on massive music collections, creating a growing need for data attribution methods that can quantify the con

VoxelSynth3D: Interpretable Volumetric Image-Domain Metal Artifact Reduction with a Paired Synthetic CLINIC-Metal Benchmark

arXiv:2610.01512v1 Announce Type: new Abstract: Metal artifacts in postoperative musculoskeletal CT obscure bone-implant and adjacent soft-tissue interfaces. Many metal artifact reduction (MAR) method

A Comprehensive Benchmark of Source-Free Universal Domain Adaptation on Time Series Representations

arXiv:2609.39810v1 Announce Type: new Abstract: Source-Free Universal Domain Adaptation (SF-UniDA) extends Universal Domain Adaptation by removing access to source data at adaptation time while still

1 Oct 2026

Trustworthy Runtime Error Healing in Real-World Repositories: A Benchmark and Guardrail

arXiv:2609.39086v1 Announce Type: cross Abstract: Runtime error healing lets a crashed program continue by generating code that repairs its live runtime state. Recent work shows that LLMs can generate

1 Oct 2026

A Benchmark & Dataset for Detecting AI-Manipulated Visual Evidence in the Court System

arXiv:2609.37783v1 Announce Type: cross Abstract: Photographic evidence is becoming increasingly vulnerable to forms of alteration and fabrication that existing legal and technical workflows are not w

A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding

arXiv:2603.14733v2 Announce Type: replace Abstract: Multimodal Large Language Models have achieved strong performance in single-video understanding, yet their ability to reason across multiple videos

Benchmarking Automatic Speech Recognition Tools for Iberian Languages

model-releasesarxiv-cs-cl

arXiv:2609.36920v1 Announce Type: new Abstract: Comprehensive evaluations of automatic speech recognition (ASR) for Iberian languages remain limited, and low-resource languages, biases, and efficiency

Tutorials

Benchmarking graph-based models for in-silico toxicity prediction in drug discovery

arXiv:2609.37555v1 Announce Type: new Abstract: Drug discovery is a costly and high-risk process, where toxicity-related failures remain a major cause of attrition in both preclinical and clinical sta

tutorialsarxiv-cs-lg

Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

arXiv:2609.37938v1 Announce Type: cross Abstract: Embodied systems must make knowledge acquired during one encounter usable in another despite changes in viewpoint, motion, and illumination. Yet aggre

Evaluation Choices Shape Biomedical ML Claims: A Pediatric Pneumonia Benchmark Case Study

arXiv:2609.37848v1 Announce Type: new Abstract: Biomedical machine learning papers often compress model performance into one headline number. That number can look like a property of the model even whe

Event-Only Wingbeat Counting under Camera Motion: A Controlled MuJoCo Benchmark

arXiv:2609.37465v1 Announce Type: new Abstract: Counting completed wingbeats requires identifying individual cycles, including during frequency changes and pauses; estimating a dominant frequency alon

From Laboratory to Real World: A New Benchmark Towards Privacy-Preserved Visible-Infrared Person Re-Identification

arXiv:2503.12232v3 Announce Type: replace Abstract: Aiming to match pedestrian images captured under varying lighting conditions, visible-infrared person re-identification (VI-ReID) has drawn intensiv

OmniVCBench: Benchmarking Evidence-Grounded Multimodal Reasoning Towards AI Virtual Cells

arXiv:2609.37773v1 Announce Type: new Abstract: Artificial Intelligence Virtual Cells (AIVCs) are envisioned as scientific agents that simulate cellular responses, explain underlying mechanisms, and s

PowerMarketJax: A JAX Benchmark Suite for Multi-Agent Reinforcement Learning in Power Markets

arXiv:2609.37321v1 Announce Type: cross Abstract: Power markets are a natural testbed for multi-agent reinforcement learning (MARL), where multiple self-interested participants repeatedly submit bids.

PowerZooJax: A JAX-based Power System Benchmark for Reinforcement Learning

arXiv:2609.36052v1 Announce Type: new Abstract: Power system operation is a safety-critical sequential decision-making problem, making it a natural testbed for reinforcement learning (RL). However, ex

RoboChrono: A Real Robot Benchmark for Streaming Task Understanding

model-releasesarxiv-cs-ro

arXiv:2609.36605v1 Announce Type: new Abstract: Understanding ongoing robot manipulation requires models to interpret visual observations in relation to interaction history and task progress. We intro

VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubrics

arXiv:2609.37287v1 Announce Type: cross Abstract: Image translation is a fundamental capability of multimodal models for multilingual applications, requiring visual understanding and meaning preservat

VLM4Cluster: Benchmarking Deep Clustering In the Era of Vision-Language Pre-training

arXiv:2609.36648v1 Announce Type: new Abstract: Vision-language pre-training has reshaped image clustering, giving rise to language-assisted image clustering (LaIC), which leverages textual semantics

A Large-Scale Benchmark and Risk Assessment of Traffic Analysis Attacks on Cloud LLM Services

arXiv:2609.31877v1 Announce Type: cross Abstract: Cloud-based Large language model (LLM) services create a network-level traffic side channel that can expose model, prompt, and task behavior despite e

A Multi-Dataset Benchmark of YOLO-Based Weed Detection in Precision Agriculture

arXiv:2609.33991v1 Announce Type: new Abstract: Weed detection is an important component of precision agriculture, enabling site-specific weed management and reducing unnecessary herbicide use. Althou

AevaScenes: An FMCW LiDAR Dataset and Benchmark for Long-Range Perception

arXiv:2609.33230v1 Announce Type: new Abstract: FMCW LiDAR measures per-point radial Doppler velocity alongside range, providing a motion cue unavailable in conventional time-of-flight sensors. Exploi

Are We Making Progress in Multimodal Domain Generalization? A Comprehensive Benchmark Study

arXiv:2605.06643v2 Announce Type: replace Abstract: Despite the growing popularity of Multimodal Domain Generalization (MMDG) for enhancing model robustness, it remains unclear whether reported perfor

Benchmarking EEG Foundation Models at Scale: Lessons from 20,000 Evaluations

arXiv:2609.32743v1 Announce Type: new Abstract: Electroencephalography (EEG) foundation models (FMs) promise transferable neural representations, yet their advantages over strong supervised baselines

CLIMB: A Clinical Multimorbidity Benchmark for Diagnosing Co-occurring Conditions through Multiturn Conversations

arXiv:2609.35462v1 Announce Type: new Abstract: Patients often have several co-occurring clinical conditions, and the findings needed to identify and disambiguate them emerge over the course of a cons

ECG-Scroll: A Long-Horizon, Streaming Benchmark and Agent Environment for Interpretation of Ambulatory Electrocardiograms

arXiv:2609.33117v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) can now interpret a standard ten-second, twelve-lead electrocardiogram (ECG) with clinically grounded, reward-v

ForVis: An In-Field Dataset and Benchmark for VIO Using Under-Canopy UAV Flights in Forests

model-releasesarxiv-cs-ro

arXiv:2609.35482v1 Announce Type: new Abstract: Visual-inertial Simultaneous Localization and Mapping (VI-SLAM) for UAVs remains difficult to evaluate in real forest environments, where motion, illumi

Long Time No See: Benchmarking VLMs for Out-of-Sight Spatiotemporal Reasoning in Egocentric Videos

arXiv:2609.34630v1 Announce Type: new Abstract: Real-world AI systems must reason about objects that are no longer visible: an AR assistant guiding a user back to an object used earlier, a household r

MixBench-TS: A Multivariate Time Series Forecasting Benchmark Where Channel Mixing Pays Off

arXiv:2609.32656v1 Announce Type: cross Abstract: Multivariate Time Series Forecasting (MTSF) models that mix information across channels assume that the past of one channel carries information about

OmniSmartHome: A Multimodal Reasoning Benchmark for Smart-Home Agents

arXiv:2609.32569v1 Announce Type: new Abstract: Smart-home assistants are expected to handle diverse, realistic requests that arise in daily life. In such interactions, users often rely on the surroun

PolyTopoBench: A Benchmark for Complex Vector Polygon Generation from Remote Sensing Imagery

arXiv:2609.32856v1 Announce Type: new Abstract: Vector polygon generation converts visual inputs, e.g., remote sensing (RS) images, into vectorized polygonal geometries, supporting applications such a

SleuthBench: Benchmarking Statistical LLM Evaluation Using Tabular Hidden Signals

arXiv:2609.34228v1 Announce Type: new Abstract: Evaluating statistical discovery by large language model (LLM) agents requires verifiable analytical ground truth. Establishing such ground truth for re

SolveEdit: Benchmarking Visual Problem Solving in Generative Models

arXiv:2609.35504v1 Announce Type: new Abstract: Machine intelligence is often evaluated through abstract reasoning problems, yet many real-world problems are visual, such as arranging objects, repairi

TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care

arXiv:2609.34088v1 Announce Type: new Abstract: TRACE (Text-Reinforced Analysis of Cardio ECGs) is a multimodal electrocardiogram (ECG) representation model that learns clinically grounded signal embe

VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation

arXiv:2609.35028v1 Announce Type: new Abstract: Large language models (LLMs) have made misinformation inexpensive to produce but not to verify, creating a growing asymmetry in the information ecosyste