Search: “benchmark”

DeepForestVisionV2: Ecology-Driven Taxonomy Expansion for Camera-Trap Monitoring in African Tropical Forests

arXiv:2606.20223v2 Announce Type: replace Abstract: Camera-trap monitoring in African tropical forests increasingly extends beyond closed-canopy interiors to riverbanks, clearings, and park edges. Amo

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

From Dead Code and Static Requirements to Working Engines: Software Revival with Coding Agents

DGX agent

arXiv:2609.36161v1 Announce Type: cross Abstract: Can coding agents restore software that no longer runs while preserving its underlying methods, and reconstruct industrial software engines from open

model-releasesarxiv-cs-ai

30 Sept 2026

From Dissonance to Orchestration: Teacher Intervention in On-Policy Distillation

model-releasesarxiv-cs-cl

arXiv:2609.37510v1 Announce Type: new Abstract: On-policy distillation (OPD) trains a student on its own reasoning trajectories using feedback from a stronger teacher. Teacher interventions can improv

HERO: Histology Encoder for Robust Representation in Oncology

arXiv:2609.35943v1 Announce Type: new Abstract: Foundation models trained on large pathology image corpora now provide strong, transferable representations for computational pathology. Over the past f

Large-scale factor analysis shows machine intelligence is only partially interpretable

arXiv:2609.36515v1 Announce Type: cross Abstract: A common assumption in language model development is that cognitive abilities are organized around a general, domain-free intelligence factor, like fl

safetyarxiv-cs-ai

Replication Failure and Trivial Baselines in Road-Level Crash Prediction

arXiv:2609.35917v1 Announce Type: new Abstract: Graph neural networks are increasingly applied to road-level crash prediction, but the stability of their reported gains has received little scrutiny. W

SafeLLM4SE: Statistical Evaluation and Reporting for LLM-based Software Engineering Systems

arXiv:2609.37294v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used for software engineering tasks, yet their stochastic behavior challenges the validity, reproducibil

TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models

arXiv:2609.37989v1 Announce Type: new Abstract: Tabular foundation models achieve strong zero-shot accuracy on structured data by pretraining on synthetic tables, but they ignore the column names, tas

Transolver-sigma: Joint Spectral-Physical Subspace Modeling for Neural PDE Solving

arXiv:2609.37279v1 Announce Type: new Abstract: Neural solvers offer efficient surrogates for numerical simulation of partial differential equations (PDEs). For time-dependent problems, strong one-ste

VehicleArena: A Realistic Urban Environment for Multi-Agent Driving

model-releasesarxiv-cs-cl

arXiv:2609.35916v1 Announce Type: cross Abstract: Real-world embodied agents often pursue independent objectives within a shared physical environment, where their actions can alter the conditions face

VIF-Bench: Evaluating Visual Instruction Following in Multi-Reference Image Generation

arXiv:2609.37709v1 Announce Type: cross Abstract: Recent multimodal image generation models can take multiple images and textual instructions as input, enabling reference-based generation guided not o

A Free Knob: Decoupling Calibration and Predictive Skill in Threshold-Based Evaluation

arXiv:2609.33457v1 Announce Type: new Abstract: Many dense-prediction benchmarks evaluate rare events by pooling prediction and target over spatial blocks, thresholding each, and scoring the contingen

Before Answering: Evidence Sufficiency under Size-Matched Memory Construction

arXiv:2609.32269v1 Announce Type: cross Abstract: Agents that answer questions from compressed or retrieved memory must recognize when the evidence a query needs is no longer in memory. Benchmarks for

ConvCue: Complementary Visual Inductive Biases for Vision-Language Models

arXiv:2609.34196v1 Announce Type: new Abstract: Modern vision-language models (VLMs) achieve strong performance across a broad range of multimodal tasks, yet still struggle with visual questions that

FIDAL: Diversity-Aware Federated Active Learning Under Real-World Distribution Shifts

arXiv:2609.31637v1 Announce Type: cross Abstract: Federated learning enables collaborative model training across institutions without centralizing data, yet high annotation costs, domain shifts, and c

Handwritten Text Recognition Lives in the High-Pixel Variance Subspace

arXiv:2609.35473v1 Announce Type: new Abstract: In self-supervised pretraining for Handwritten Text Recognition (HTR), pixel reconstruction methods outperform contrastive methods, unlike in natural-im

InfoEdit: Probing Global Layout Reasoning in Infographic Editing

arXiv:2609.33286v1 Announce Type: new Abstract: Multimodal foundation models edit natural photographs at production quality, yet the same models struggle with structured visual content such as infogra

Learning High-Risk High-Precision Motion Control

arXiv:2609.34851v1 Announce Type: new Abstract: Deep reinforcement learning (DRL) algorithms for movement control are typically evaluated and benchmarked on sequential decision tasks where imprecise a

safetyarxiv-cs-lg

Learning Steadily: Accumulating Relative Point Margin Scores for Face Image Quality Assessment

arXiv:2609.31662v1 Announce Type: new Abstract: Face Image Quality Assessment determines the suitability of captured face images for automated face recognition (FR), a critical capability for reliable

Learning to Act under Visual Interruptions with Vision-Language-Action Models

model-releasesarxiv-cs-ro

arXiv:2609.35003v1 Announce Type: new Abstract: Vision-language-action (VLA) models have demonstrated strong capabilities in robotic manipulation, but they are typically developed and evaluated with a

Prioritizing Repeated LLM Evaluation for Hidden Failure Discovery

arXiv:2609.32547v1 Announce Type: new Abstract: Large language models are commonly evaluated by generating a small number of stochastic responses for each prompt in a benchmark. Because inference budg

RAGWarrant: Evidence-Preserving Governance for RAG Policy Promotion Under Quality, Cost, Latency, and Risk Constraints

arXiv:2609.34179v1 Announce Type: cross Abstract: Retrieval-augmented generation systems are extensively instrumented with metrics, benchmarks, traces, and automated judges, but these tools do not dec

safetyarxiv-cs-lg

Rate-Adaptive One-Step Diffusion Compression for AIGC Images

arXiv:2609.31795v1 Announce Type: new Abstract: We describe our entry to the LoViF 2026 AIGC Image Compression Challenge, a benchmark for ultra-low-bitrate coding of AI-generated images under a strict

Agents

Same Winners, Different Success Rates: Evaluating How LLM Agents Recover from Failures

arXiv:2609.34215v1 Announce Type: cross Abstract: Evaluating how LLM agents recover from mid-task failures is central to deploying reliable agentic systems. Existing checkpoint-based benchmarks measur

agentsarxiv-cs-lg

Scaling Versatile 3D Assets Editing with a Million-Scale Dataset

arXiv:2609.34271v1 Announce Type: new Abstract: Although recent 3D generative models produce increasingly realistic assets, controllable 3D asset editing remains challenging. Existing methods are limi

ThinkNet: Compact Architecture Selection and Validation-Gated Ensembles for Subject-Independent MI-EEG Decoding

arXiv:2609.33967v1 Announce Type: cross Abstract: Practical assistive and rehabilitative brain--computer interfaces require subject-independent motor-imagery EEG (MI-EEG) decoders that generalize to n

Unsupervised spiking feature learning for event-based pedestrian crossing detection: approaching supervised accuracy without labelled training data

arXiv:2609.31671v1 Announce Type: new Abstract: Event cameras are well suited to pedestrian crossing detection, and spiking neural networks (SNNs) can process their output natively, but current SNN de

Vision--Language Signals in Constrained RL: Safety Gains Without Anticipation

arXiv:2609.34041v1 Announce Type: new Abstract: Safe reinforcement learning seeks policies that maximise task performance while satisfying safety constraints. In driving benchmarks, however, collision

safetyarxiv-cs-lg

What Does a Stream Model Buy You in Flow Matching?

arXiv:2609.34123v1 Announce Type: new Abstract: Stream-level flow matching replaces the linear interpolant of conditional flow matching (CFM) by a Gaussian-process (GP) stream connecting each source--

What Paired Evaluations Reveal under Visual Perturbations

arXiv:2609.35583v1 Announce Type: new Abstract: Robustness evaluation must examine diverse visual perturbations, while benchmarks cover only some real-world conditions and physical testing is costly.

safetyarxiv-cs-cv

When Does Domain Adaptation Help on Physical Vibration Sensors? A Held-Out-Bearing Study of Neural-Operator and Convolutional Models

arXiv:2609.31639v1 Announce Type: new Abstract: Diagnosing rolling-element bearing faults from vibration is a canonical physical-sensing task and a widely used benchmark for domain adaptation under op

When the Score Becomes the Target: Rethinking Metric Validity in Autonomous Driving

arXiv:2609.34440v1 Announce Type: new Abstract: Driving benchmark scores are increasingly used not only for evaluation but also as optimization targets. This raises a fundamental question: do score ga

BabelCoder: Agentic Code Translation with Specification Alignment

arXiv:2512.06902v2 Announce Type: replace-cross Abstract: As software systems evolve, developers increasingly work across multiple programming languages and often face the need to migrate code from on

Backbone-Adaptive Evidence Routing for Robust Pairwise LLM Judging

arXiv:2609.30751v1 Announce Type: new Abstract: Pairwise language-model judges can gather evidence through direct comparison, reasoning, or reference-based verification, but no single protocol is best

Research

Beyond Bag-of-Words: Diagnosing Compositional Binding Failures in Vision-Language Models

arXiv:2602.02043v2 Announce Type: replace-cross Abstract: Modern vision-language models struggle with basic compositional reasoning, failing to bind attributes to objects or relations to their referen

researcharxiv-cs-ai

Can Pixels Alone Reveal Image Origin? Minimax Limits and Learnable Interfaces for Passive Provenance

arXiv:2609.30997v1 Announce Type: cross Abstract: Passive image provenance asks whether pixels alone can reveal where an image came from: a human, an aggregate AI class, or a particular generator. Thi

CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models

arXiv:2609.30979v1 Announce Type: new Abstract: Vision-language models (VLMs) have demonstrated excellent performance in visual tasks, but their visual causal reasoning capabilities still lack reliabl

CytoSPM: Open-Vocabulary Cytopathology Detection with Structured Prompt Bank

arXiv:2609.31314v1 Announce Type: new Abstract: Cytopathology detection requires open-vocabulary recognition because cellular categories are fine-grained, long-tailed, and continuously evolving across

Applications

HARDEN: Constrained Evolutionary Search for Harder, Answer-Preserving Evaluation Cases

arXiv:2609.30571v1 Announce Type: new Abstract: Language models are often evaluated on curated benchmarks that underrepresent the complexity of enterprise deployments. We introduce HARDEN, a constrain

applicationsarxiv-cs-ai

Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding

arXiv:2609.31382v1 Announce Type: cross Abstract: Long-context understanding requires large language models (LLMs) to reason over lengthy documents, conversations, and code, yet task-relevant evidence

Hardware

KuaFu: Compressing Long User Behavior into Understanding at Billion Scale

arXiv:2609.31045v1 Announce Type: cross Abstract: Conversational agents, generative recommenders, and personalized advertising all rest on one capability: understanding each user from raw behavior. Pr

hardwarearxiv-cs-cl

Learning Polarization Image Restoration with General Restoration Priors

arXiv:2609.30728v1 Announce Type: new Abstract: Polarization imaging captures distinctive surface and geometric cues that benefit a wide range of vision tasks. However, real-world polarization acquisi

LensDesigner: A Self-Improving Agent for Optical Lens Design

arXiv:2609.30450v1 Announce Type: new Abstract: Optical lens design is a complex, non-convex optimization challenge that relies heavily on human experience and intuition. Existing optimized-based auto

PixSim: a calibrated open-source simulator of instant-payment fraud, recovery and interdiction under analyst capacity constraints

arXiv:2609.30684v1 Announce Type: new Abstract: Brazil's Pix settles about 5.9 billion instant, irreversible transfers a month. A fraudulent transfer can be recovered only while the funds remain in a

Robust to Which Model Change? A Unified Evaluation of Robust Counterfactual Explanations

arXiv:2609.30918v1 Announce Type: cross Abstract: Robust counterfactual explanations promise recourse that still works after the model behind it changes. Whether they keep that promise depends on what

RupeeBias: Auditing Demographic Bias in Indian Economic Guidance from Large Language Models

model-releasesarxiv-cs-cl

arXiv:2609.31245v1 Announce Type: new Abstract: Individuals turn to large language models (LLMs) for guidance across a wide range of economic tasks, from comparing loan options and planning savings to

Self-Supervised Perceptually Interpretable Monocular Depth Estimation

arXiv:2609.30987v1 Announce Type: new Abstract: Self-supervised monocular depth estimation (MDE) enables depth prediction from monocular images without requiring ground-truth supervision, making it at

Stealth Apart, Harm Together: Skill Cascading Attacks on Skill-Based Agent Systems

arXiv:2609.30383v1 Announce Type: new Abstract: A skill is a modular package of natural-language instructions, executable scripts, and reference resources that an agent can load at runtime to extend i