Search: “evaluation”

DF26: We Cannot Tell Fake From Real Anymore

arXiv:2609.07369v1 Announce Type: new Abstract: We introduce DF26, a novel benchmark for detecting AI-generated videos containing fully synthetic clips produced by recent text-to-video and image-to-vi

Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2609.06809v1 Announce Type: new Abstract: Modern stereo matching models fail when disparity crosses zero, with end-point error (EPE) rising by 4.6-37imes. Yet stereoscopic content, from cinema 3

model-releasesarxiv-cs-cv

9 Sept 2026

Dynamic-Programming-Guided Hierarchical BPE and Empirical Analysis of Vocabulary Pruning

arXiv:2609.06898v1 Announce Type: cross Abstract: Byte Pair Encoding (BPE) constructs vocabularies through greedy pair merging, but the resulting merge order does not necessarily allocate a fixed mode

researcharxiv-cs-lg

GIF: Agentic Generation of Interactive and Functional Object Compositions for Robot Learning

arXiv:2609.05927v1 Announce Type: new Abstract: Robot manipulation foundation models require scalable evaluation and data generation across diverse scenarios, with simulation providing an environment

GRAN-TED: Generating Robust, Aligned, and Nuanced Text Embedding for Diffusion Models

arXiv:2512.15560v3 Announce Type: replace Abstract: The text encoder is a critical component of text-to-image and text-to-video diffusion models, fundamentally determining the semantic fidelity of the

Harnessing CLIP and DINO: An Uncertainty-Aware Cascaded Fusion Network for Generalizable Deepfake Image Detection

arXiv:2609.07670v1 Announce Type: new Abstract: The growing realism and accessibility of manipulated and generated faces threaten the trustworthiness of digital media. To detect such forgeries, deepfa

Human-Centric Image Captioning with Subject-Centered Spatial Understanding

arXiv:2609.08300v1 Announce Type: new Abstract: While multimodal large language models (MLLMs) achieve remarkable performance on generic image captioning, they frequently suffer from structural halluc

Image-Scale Robustness and Visual Recognition Performance: A Cross-Architecture Analysis

arXiv:2609.06051v1 Announce Type: new Abstract: The sensitivity of visual recognition models to changes in image scale is well established, yet the factors governing this sensitivity across heterogene

Kairos: A Dataset for Fine-Grained Video-Language Modeling over Space, Time, and Dynamics

arXiv:2609.08755v1 Announce Type: new Abstract: Many emerging video language modeling tasks require systems to move beyond clip-level abstraction and model visual content as it unfolds over extended t

safetyarxiv-cs-cv

LANTERN: A Closed-Loop Benchmark for VLM-Based Cooperative Driving with Temporally Grounded Warnings

arXiv:2609.06368v1 Announce Type: new Abstract: We present LANTERN, a closed-loop benchmark for temporally grounded cooperative warnings. LANTERN separates warning onset, hazard onset, warning termina

LatentMD: Benchmarking Markdown Boundary Failures in LLM-Generated Text

arXiv:2609.06993v1 Announce Type: cross Abstract: Large language models (LLMs) increasingly generate Markdown that is consumed by renderers, agents, code extractors, and structured downstream pipeline

Measuring Language Transfer in Robot Policies: Adding Greek to a Cosmos3 Vision-Language-Action Policy

arXiv:2609.07470v1 Announce Type: new Abstract: Robot foundation models are trained and evaluated predominantly in English, and robot demonstration corpora do not exist for most languages. We study th

MOAE: Multi-Objective Agent Evolution with Pareto-Preserving Search

arXiv:2609.05992v1 Announce Type: cross Abstract: As LLM-based agents continue to advance, their evaluation has become increasingly multifaceted: a capable agent must not only achieve high task comple

NEO-BENCH: A New Multi-Source Benchmark for Generalizable Astronomical Streak Detection

arXiv:2609.06774v1 Announce Type: cross Abstract: Near-Earth Objects (NEOs) can appear as faint streaks in long-exposure astronomical images. Detecting these streaks across diverse observatories requi

NEST: Narrative Event Structures in Time for Long Video Understanding

arXiv:2606.19706v2 Announce Type: replace Abstract: Recent progress in vision-language models has enabled processing of increasingly long video sequences, but handling extended token streams does not

OdysSim: Building Foundation Models for Human Behavior Simulation

arXiv:2606.14199v2 Announce Type: replace-cross Abstract: Large language models are increasingly deployed as human simulators for interactive evaluation and social simulation. Yet helpfulness-driven p

On the Recall Scaling Laws in Mamba: A Theoretical and Mechanistic Study via Hashing

arXiv:2609.07681v1 Announce Type: new Abstract: Associative Recall (AR) is the cognitive ability to learn and retrieve links between items in memory. In NLP, AR is used as a benchmark for evaluating t

Applications

OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining

arXiv:2609.07398v1 Announce Type: new Abstract: World-Action Models inherit world knowledge from video-generative priors, and channel it into executable control signals through embodied experience. Ex

applicationsarxiv-cs-ro

SAEScientist-Bench: Can AI Agents Conduct Autonomous SAE Interpretability Research?

arXiv:2609.09113v1 Announce Type: cross Abstract: While research on recursive self-improvement (RSI) has predominantly automated model training pipelines, reliable autonomous development demands a mis

SciFigure2Code: An AI-Reconstructed Benchmark for Scientific Figure-to-Code

arXiv:2609.08155v1 Announce Type: new Abstract: Scientific figures are the interface through which research claims are inspected and reused, but final published panels rarely expose the data or plotti

SynthRCT: Scalable Conditional Deformation Synthesis for Synthetic Repeat CT Generation

arXiv:2609.08627v1 Announce Type: new Abstract: In proton therapy, plans are typically optimized on a single planning CT, making robustness evaluation essential under anatomical changes. However, curr

researcharxiv-cs-cv

The Art of Hierarchical Competing Patterns: Gaussian Process Optimization of Hyphenation

arXiv:2609.07638v1 Announce Type: cross Abstract: Hyphenation patterns remain a compact and widely deployed solution for word breaking in typesetting systems, text processors, and web rendering engine

The Oversight Gap: What LLM Safety Monitors Miss, and Why It Is Not Capability

arXiv:2609.07162v1 Announce Type: new Abstract: Several properties safety monitors are asked to certify, among them cross-tenant noninterference, sandbagging and evaluation awareness, are 2-safety hyp

Agents

Tracking-by-detection in Multi-object Tracking: Survey and Experiments

arXiv:2609.08265v1 Announce Type: new Abstract: Multi-object tracking (MOT) is an essential computer vision task that simultaneously tracks multiple objects in video sequences, with various applicatio

agentsarxiv-cs-cv

VEX-Bench: Benchmarking LLM Agents for Assessing Exploitability of Software Supply Chain Vulnerabilities

arXiv:2609.08040v1 Announce Type: cross Abstract: The software supply chain has become an increasingly exposed attack surface because of its reliance on intricate yet fragile dependencies. Existing de

VI-Bench: Benchmarking Prompt Inversion from AIGC Videos

arXiv:2609.08079v1 Announce Type: new Abstract: Recent advances in video generation have made prompt-based control increasingly central to AIGC video generation. Prompts specify what a video should de

What Are You Doing? A Closer Look at Controllable Human Video Generation

arXiv:2503.04666v2 Announce Type: replace Abstract: High-quality benchmarks are crucial for driving progress in machine learning research. However, despite the growing interest in video generation, th

Brain4FMs: A Benchmark of Foundation Models for Electrical Brain Signal

arXiv:2602.11558v2 Announce Type: replace Abstract: Brain foundation models (BFMs) are advancing neurotechnology by learning transferable representations from neural signals, with broad potential in c

Candidate Comparability Before Promotion: Conditional Validation in Adaptive Network Intrusion Detection

arXiv:2609.04388v1 Announce Type: cross Abstract: Adaptive network intrusion detection systems retrain classifiers after drift alarms, but an alarm detects change; it does not establish that a challen

CoLMIN: LLM-based Multi-Decision Path Negotiation for Cooperative Autonomous Driving

arXiv:2609.04807v1 Announce Type: cross Abstract: Multi-vehicle cooperative autonomous driving enhances the safety and reliability of autonomous driving systems through information sharing among conne

safetyarxiv-cs-cv

Hardware

Compact Neural Appearance Models for Efficient Gaussian Splatting

arXiv:2609.05255v1 Announce Type: new Abstract: Explicit primitive-based radiance fields such as 3D Gaussian Splatting typically model view-dependent appearance using low-order spherical harmonics (SH

hardwarearxiv-cs-cv

Hardware

Compute-in-Memory Attention: A Time-Domain Analog Softmax Circuit with RC-Tunable Temperature

arXiv:2609.04266v1 Announce Type: cross Abstract: Softmax is a key operation in Transformer attention, but its exponentiation and normalization add significant overhead in compute-in-memory (CIM) acce

hardwarearxiv-cs-lg

Cultural Misalignment in Large Language Models: Detection, Measurement, and Mitigation Through Targeted Fine-Tuning

arXiv:2609.04485v1 Announce Type: cross Abstract: We evaluate three open-weight LLMs (Gemma3-12B from the USA, Bielik-11B-v3 from Poland, and Qwen3-4B from China) against World Values Survey Wave 7 da

safetyarxiv-cs-ai

Do LLMs Exhibit Coherent Knowledge Structures in Mathematical Reasoning? A Perspective from Knowledge Space Theory

arXiv:2609.05245v1 Announce Type: new Abstract: Human knowledge is inherently structured and interdependent: mastery of a concept requires prior mastery of its prerequisites, a principle formalized by

researcharxiv-cs-ai

From Vision to Language: Investigating Causal Information Flow in Multimodal Decision-Making

arXiv:2609.05149v1 Announce Type: new Abstract: Vision-Language Models are commonly evaluated through their final predictions, but understanding whether these decisions are grounded in visual evidence

researcharxiv-cs-cl

GLOW: Graph-Language Co-Encoding for Agentic Workflow Performance Prediction

arXiv:2512.15751v2 Announce Type: replace-cross Abstract: Agentic Workflows (AWs) have emerged as a promising paradigm for solving complex tasks. However, automatically generating high-quality AWs rem

LIBERO-RECOVER: Beyond Task Success Towards Failure Recovery in Robotic Manipulation Models

arXiv:2609.05178v1 Announce Type: new Abstract: Vision-Language-Action (VLA) or World Action (WAM) models have recently demonstrated remarkable performance in robotic manipulation. On LIBERO, SOTA met

Applications

Long Horizon Transformer Quantile Fault Prediction for Multi Site Industrial Predictive Maintenance

arXiv:2609.04840v1 Announce Type: new Abstract: Long-horizon predictive maintenance requires models to distinguish slowly evolving degradation from normal operating-regime variation over planning wind

applicationsarxiv-cs-ai

Mitra-v2 Technical Report

arXiv:2609.04540v1 Announce Type: new Abstract: We introduce Mitra-v2, a tabular foundation model that delivers state-of-the-art performance on real-world classification and regression problems, from

MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domain

arXiv:2609.04842v1 Announce Type: cross Abstract: Time-series data in clinical settings is crucial for capturing dynamic changes in a patient's health over time, enabling timely diagnosis, personalize

Molecular Deja Vu: Digit-Level Retrieval of Published Values in Frontier Language Models

arXiv:2609.05381v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly evaluated on molecular property benchmarks, but accuracy cannot distinguish a model that predicts a proper

Nepali Passport Question Answering: A Low-Resource Dataset for Public Service Applications

arXiv:2603.13320v2 Announce Type: replace-cross Abstract: Nepali, a low-resource language, faces significant challenges in building an effective information retrieval system due to the unavailability

researcharxiv-cs-lg

On Epistemic Diversity in Large Language Models

arXiv:2609.04835v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used not only to retrieve information, but to answer questions, explain, teach, and support inquiry. In su

safetyarxiv-cs-cl

One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation

arXiv:2609.04921v1 Announce Type: cross Abstract: Diffusion probabilistic models can capture the multi-modal, interaction-rich distribution of joint future trajectories in driving scenes. We show that

Local Ai

Privacy Failure in Split-LLM Training, The Returned Gradient Nullifies the Decoys

arXiv:2609.04382v1 Announce Type: cross Abstract: We present a systems-security case study of a two-node split-LLM training system whose privacy evaluation passed while leaving an observable channel u

local-aiarxiv-cs-lg

QoNext: Towards Next-generation QoE for Foundation Models

arXiv:2509.21889v3 Announce Type: replace Abstract: Existing evaluations of foundation models predominantly focus on output correctness, treating interaction as a static exchange of information. Howev

researcharxiv-cs-cl

TRILOGUE: A Trilingual Spoken Dialogue Fact-Checking Benchmark with Evidence and Paired Audio

model-releasesarxiv-cs-cl

arXiv:2609.04452v1 Announce Type: new Abstract: Modern misinformation is often heard before it is read, yet fact-checking systems are still evaluated mainly on clean written claims. Spoken dialogue re

Unifying ICL, SFT, KL-Regularized RL Through a Bayesian Lens

arXiv:2609.05111v1 Announce Type: new Abstract: Large language models are now trained and evaluated under a diverse set of paradigms: supervised fine-tuning (SFT), few-shot in-context learning (ICL),