Search: “benchmark”

InterView-C: A Synchronized Multimodal Corpus of VR Avatar-Mediated Survey Interviews

arXiv:2610.10145v1 Announce Type: new Abstract: We present InterView-C, a German multimodal corpus of 27 survey interviews conducted entirely in virtual reality, with both interlocutors represented by

safetyarxiv-cs-cl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

MultiFly: A Real-World Multimodal Aerial Dataset with Annotation-Efficient Label Transfer and Cross-Modal Semantic Consistency

DGX agent

arXiv:2610.10359v1 Announce Type: cross Abstract: We introduce MultiFly, a real-world, low-altitude UAV dataset for semantic perception across RGB, thermal, LiDAR, and radar modalities. MultiFly provi

model-releasesarxiv-cs-cv

8 Oct 2026

PVSync: A Unified Lip-Sync Expert for Timing and Articulation

arXiv:2610.09223v1 Announce Type: new Abstract: Lip movements can match the timing of speech without matching the spoken sounds. We introduce PVSync, a unified model for audio-visual offset estimation

Quantifying Volumetric Risk: Class-Aware Asymmetric Weighted Conformal Prediction for 3D Medical Image Segmentation

arXiv:2610.09392v1 Announce Type: new Abstract: Reliable volumetric segmentation is critical for clinical diagnostics, yet foundation models such as MedSAM remain deterministic and lack calibrated unc

Route-Verify-Vote: Procedure-Conditioned Self-Consistency for Mixed-Domain Reasoning

arXiv:2610.08814v1 Announce Type: cross Abstract: Compositional generalization remains challenging when language models must combine familiar reasoning operations in unfamiliar ways. The Scenario-Base

SEER: Self-Enhancing Chain-of-Thought Compression for Reasoning Models

arXiv:2509.14093v3 Announce Type: replace-cross Abstract: Chain-of-Thought (CoT) prompting can substantially improve the reasoning ability of large language models (LLMs), but it often comes with high

SoccerNet-FoulRet: Retrieving Semantically Similar Soccer Foul Videos

arXiv:2610.09742v1 Announce Type: new Abstract: Refereeing decisions in professional soccer remain inconsistent because referees cannot easily compare a contentious foul against similar past cases. We

Tokka-Bench: Evaluating Tokenizers Across 100 Natural and 20 Programming Languages

arXiv:2610.08794v1 Announce Type: new Abstract: Large language models rely on subword tokenizers whose quality varies across languages, yet no standardized multi-metric framework exists for broad comp

Training Advisors for LLM Agents from Task Outcomes

arXiv:2610.09858v1 Announce Type: new Abstract: Large language model agents tackle multi-step tasks by interleaving reasoning and tool calls with observations from the environment. Prior work has show

Video Prediction Policy 2: Predict Better, Act Better

arXiv:2610.10270v1 Announce Type: new Abstract: World action models (WAMs) have emerged as an important class of generalist robot policies, aiming to transfer video prediction priors to action learnin

A Novel Sentence Stress Detection Framework Leveraging Auxiliary Word-Stress Modeling and Loss Optimization

arXiv:2610.07626v1 Announce Type: cross Abstract: Prosodic stress is a crucial aspect of automatic pronunciation assessment (APA), encompassing both sentence stress detection (SSD) and word stress det

AgentMemGate: Addressing Speculation Contamination in Conversational Assistant Memory

arXiv:2610.07707v1 Announce Type: new Abstract: Conversational AI assistants with long-term memory extract facts from user messages into a store consulted in later conversations. A stated plan can ent

Agents

AgSpec: Pushing the Limits of Retrieval-Based Speculative Decoding in Coding Agent Pipelines

arXiv:2610.01108v2 Announce Type: replace Abstract: Retrieval-based speculative decoding (SD) drafts tokens by copying continuations from existing text, which suits coding agents that repeatedly repro

agentsarxiv-cs-cl

Research

Ariadne's Thread of LipSync: Unraveling Forgeries via Inconsistency between Lip Motions and Head Poses

arXiv:2610.08417v1 Announce Type: new Abstract: Recent advances in LipSync generation technology have led to the creation of highly realistic videos, posing severe societal risks. However, existing de

researcharxiv-cs-cv

Bayesian Optimization on Function Spaces via Sparse RKHS Manifolds

model-releasesarxiv-cs-lg

arXiv:2610.07417v1 Announce Type: cross Abstract: Bayesian Optimization (BO) has become an established methodology for minimizing black-box functions of a vector input. Often, however, this parameter

Beyond Marginal Monitoring: Distributed Joint-Distribution Testing for Data Concept Drift in Large Scale E-Commerce Operations

model-releasesarxiv-cs-lg

arXiv:2610.08132v1 Announce Type: cross Abstract: Concept drift threatens production machine learning, yet the empirical behavior of multivariate two-sample drift detectors at scale remains under-char

CheckerBench: Can Long-Horizon Agents Synthesize Static-Analysis Checkers?

arXiv:2610.07557v1 Announce Type: cross Abstract: Static-analysis checker synthesis requires agents to interpret a defect specification, inspect a repository, implement analyzer-specific logic, and re

Research

COMPASS: Finding Where Reasoning Lives in Language Models

arXiv:2610.07469v1 Announce Type: new Abstract: Explicitly eliciting reasoning substantially improves LLM performance. Existing approaches require a predefined characterization of reasoning, whether t

researcharxiv-cs-ai

Defense-in-Depth for LLMs: Evaluating Memory Gates Against Activation-Induced and Memory-Induced Sycophancy

arXiv:2610.07403v1 Announce Type: new Abstract: Long-term memory allows Large Language Models (LLMs) to maintain personalized context across interactions, but retrieved user history can induce memory-

Early Memory Selection for Balanced Adam

arXiv:2610.08624v1 Announce Type: cross Abstract: We propose a method for choosing the shared memory parameter eta_1=eta_2=eta in Adam from a short pilot training. The selected eta remains fixed durin

Evaluating Inference Compute for Generative AI: A Framework for Enterprise Workloads

model-releasesarxiv-cs-lg

arXiv:2610.07094v1 Announce Type: cross Abstract: LLM deployment is shifting from single-turn completion to agentic trajectories in which a model plans, calls tools, reads results and reasons at test

Forensic Reserve: Eliciting Latent Knowledge for Image Forgery Detection

arXiv:2610.08639v1 Announce Type: new Abstract: As generated images become increasingly realistic, reliable forgery detection is essential for maintaining trust in visual information. However, existin

GIVE-KWS: Gated Injection of Visual Evidence for Noise-Robust Query-by-Example Keyword Spotting

arXiv:2610.07046v1 Announce Type: cross Abstract: Visual speech promises noise-robust keyword spotting, yet a visual stream is not necessarily used. On a tri-modal query-by-example keyword spotting (Q

Graph-Based Recognition of Simulated Train-Driver States From Facial and Upper-Body Keypoints

arXiv:2610.07083v1 Announce Type: cross Abstract: Driver fatigue poses a significant challenge to railway safety, with traditional systems like the dead-man switch offering limited and basic alertness

safetyarxiv-cs-ai

Large Pretraining Datasets Don't Guarantee Robustness after Fine-Tuning in Image Classification

arXiv:2410.21582v4 Announce Type: replace-cross Abstract: Large-scale pretrained models are widely leveraged as foundations for learning new specialized tasks via fine-tuning, with the goal of maintai

Latent space bias directions in LLMs capture confidence, not fairness

arXiv:2610.08559v1 Announce Type: cross Abstract: Activation steering has gained popularity as a lightweight inference-time debiasing technique for large language models. However, prior work reports t

safetyarxiv-cs-ai

Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?

arXiv:2610.08215v1 Announce Type: new Abstract: Learning from experience is essential for LLM agents to adapt to unfamiliar and dynmaic environments. Evaluating this ability is therefore important for

Learning When to Refine: Long-Horizon Reinforcement Learning for Budgeted Neural-Operator PDE Solvers

arXiv:2610.06883v1 Announce Type: cross Abstract: Neural operators provide fast surrogates for time-dependent PDEs, but autoregressive deployment creates a refinement-allocation problem: prediction er

MASC: A Multi-Agent Self-Calibration Framework with Latent Construct Alignment for Consistent Client Role-Playing in Psychological Counseling

arXiv:2610.08250v1 Announce Type: new Abstract: Large language models are increasingly used to simulate clients for counselor training and psychological counseling research, but reliable simulation re

MedHorizon: Towards Long-context Medical Video Understanding in the Wild

arXiv:2605.06537v2 Announce Type: replace Abstract: Medical multimodal large language models (MLLMs) have advanced image understanding and short-video analysis, but real clinical review often requires

MINDSET: Energy-based Schema Evolution for Long Conversational Agent Memory

arXiv:2610.08586v1 Announce Type: new Abstract: Long conversational agents have become essential in our daily lives. They must remember what was said long back in order to help us efficiently complete

Navigation with RF Cues: Embodied Perception Action under Multipath Uncertainty

model-releasesarxiv-cs-ro

arXiv:2610.08105v1 Announce Type: new Abstract: Smart factory inspection requires robots to reach connected equipment without a prior map or known target coordinates. Radio frequency (RF) signals from

OMIT the Action: Measuring Framing-Invariant Omission Bias under Philosophical Disagreement

arXiv:2610.07847v1 Announce Type: new Abstract: As LLMs increasingly assist in moral reasoning, omission bias, the tendency to prefer inaction even when equivalent framings reverse substantive outcome

On Open-Ended Information Seeking for Information Elicitation Agents

arXiv:2610.07509v1 Announce Type: new Abstract: Information elicitation is an open-ended information-seeking problem in which an interaction can unfold in many potentially valuable directions, requiri

OOPMAS: Object-Oriented Multi-Agent Systems for Query-Level Workflow Generation

arXiv:2610.07787v1 Announce Type: new Abstract: Multi-agent systems (MAS) powered by large language models have shown strong performance across code generation, mathematical reasoning, and question an

Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Rendering

arXiv:2610.08137v1 Announce Type: cross Abstract: AI systems create images and videos with image/video generation models or by writing code and graphics descriptions that are then rendered. These rout

SAE++: Cascaded Sparse Autoencoders Learn Multi-Level Visual Concepts in Multimodal LLMs

arXiv:2606.16193v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong performance on vision-language tasks, yet their internal visual representati

Same Feedback, Different Answer: Measuring Run-to-Run Instability in Frontier-Model Customer Feedback Analysis

arXiv:2610.08036v1 Announce Type: new Abstract: AI agents are increasingly being programmed to automate knowledge work over large collections of unstructured data. Such automation requires repeatabili

SCOPE: Certified Theorem Proving with a Language Model as the Policy Planner

arXiv:2610.08319v1 Announce Type: new Abstract: In proof assistants such as Lean, a generated proof must pass machine compilation checks, so evaluation needs no human scoring. Direct generation fails

SpeedrunBench: Challenging LLM Agents with Video Game Speedrunning

arXiv:2610.08076v1 Announce Type: new Abstract: Frontier LLM agents have been shown to be capable of solving increasingly complex tasks for which humans have measurable solutions. This begs the pertin

SquidAgent: Parallelize Wisely, Coordinate Efficiently

arXiv:2610.08647v1 Announce Type: new Abstract: LLM-based agents solve complex multi-step tasks, but sequential execution incurs substantial latency. In principle, parallelizing work across multiple a

Structure-Aware Graph Abstention for Reliable Selective Forecasting

arXiv:2610.08322v1 Announce Type: new Abstract: Selective forecasting abstains on high-risk test windows under a retained-coverage budget. Existing gates such as TEM (Brusokas et al., 2025) score each

safetyarxiv-cs-lg

Thin Evidence, Thick Priors: How Language Models Substitute Identity for Missing Financial Facts

arXiv:2610.07798v1 Announce Type: new Abstract: People increasingly ask large language models what to do with their money, yet seldom describe their finances in full. This paper asks what a model does

Agents

Token-Efficient Multi-Agent Collaboration via System One-Guided Computational Division of Labor

arXiv:2610.08155v1 Announce Type: cross Abstract: Large language model (LLM)-based multi-agent systems (MAS) have become a promising paradigm for complex information-seeking and reasoning tasks by ena

agentsarxiv-cs-ai

UniCounting: Instance-Aware Proposal Consolidation for Image-Query-Free Multi-Category Counting

arXiv:2610.08379v1 Announce Type: new Abstract: Visual counting is commonly formulated as counting a single specified target, with a model receiving an image-specific exemplar, text query, or target c

Universe of Thoughts: A Computational Framework for Creative Reasoning in Large Language Models

arXiv:2511.20471v3 Announce Type: replace Abstract: Recent advances in Large Language Model (LLM) reasoning have improved conventional problem solving, but creative reasoning remains comparatively und

Visual Abstention in Unified Multimodal Models

arXiv:2610.07887v1 Announce Type: cross Abstract: Unified multimodal models (UMMs) integrate understanding and generation, yet their generative behavior is rarely governed by what they understand abou

WareFly-VLA: A Vision-Language-Action Framework for UAV Navigation and Human Tracking in Smart Warehouses

arXiv:2610.08526v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have achieved impressive results in robotic manipulation and ground-mobile navigation, yet language-conditioned co