Search: “benchmark”

REVEAL: Reasoning-Enhanced Forensic Evidence Analysis for Explainable AI-Generated Image Detection

arXiv:2511.23158v2 Announce Type: replace-cross Abstract: The rapid progress of visual generative models has made AI-generated images increasingly difficult to distinguish from authentic ones, posing

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Revisiting Radar Perception With Spectral Point Clouds

DGX agent

arXiv:2604.08282v1 Announce Type: new Abstract: Radar perception models are trained with different inputs, from range-Doppler spectra to sparse point clouds. Dense spectra are assumed to outperform sp

model-releasesarxiv-cs-cv

10 Apr 2026

Temporally Phenotyping GLP-1RA Case Reports with Large Language Models: A Textual Time Series Corpus and Risk Modeling

arXiv:2604.06197v1 Announce Type: cross Abstract: Type 2 diabetes case reports describe complex clinical courses, but their timelines are often expressed in language that is difficult to reuse in long

The Geometry of Forgetting

arXiv:2604.06222v1 Announce Type: cross Abstract: Why do we forget? Why do we remember things that never happened? The conventional answer points to biological hardware. We propose a different one: ge

When Personalization Tricks Detectors: The Feature-Inversion Trap in Machine-Generated Text Detection

arXiv:2510.12476v2 Announce Type: replace Abstract: Large language models (LLMs) have grown more powerful in language generation, producing fluent text and even imitating personal style. Yet, this abi

AI Knows Where You Are: Exposure, Bias, and Inference in Multimodal Geolocation with KoreaGEO

arXiv:2506.03371v2 Announce Type: replace Abstract: Recent advances in vision-language models (VLMs) have enabled accurate image-based geolocation, raising serious concerns about location privacy risk

Asynchronous Indulgent Gathering of Opaque Robots

arXiv:2509.10711v2 Announce Type: replace-cross Abstract: We consider the benchmarking problem of gathering in an (N,f)-fault system consisting of N robots, of which at most f may fail at any executio

researcharxiv-cs-ro

AVC-Reward: Event-Centric Audio-Video Consistency Evaluation

arXiv:2610.22321v1 Announce Type: cross Abstract: As joint audio-video generation models become more capable, they can generate audio-visual scenes exhibiting three forms of complexity: multi-event co

Agents

CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness

arXiv:2610.21910v1 Announce Type: new Abstract: As Vision-Language Models (VLMs) advance, they are increasingly expected to perform spatiotemporal reasoning over motion, actions, and view changes beyo

agentsarxiv-cs-ai

DialFork: Going Beyond Factuality to Evaluate Procedural Hallucination in Conversational Agents

arXiv:2610.21561v1 Announce Type: cross Abstract: Large language models (LLMs) deployed as conversational agents are increasingly expected to follow procedural logic. While factual hallucination has r

MemCut: Every Secret Leaves a Trail in the Long-Term Memory of LLM Agents

arXiv:2610.21405v1 Announce Type: new Abstract: Long-term memory has become a crucial component of large language model (LLM) agents, with most research focusing on retrieving relevant information acc

Memorilla: Latent Semantic Memory for LLMs

arXiv:2610.21375v1 Announce Type: cross Abstract: Memory enables large language models (LLMs) to use information beyond their parameters, such as past user conversations, long documents, or an agent's

MindEval2: Clinically Grounded Patients and Rubrics for Evaluating Language Models in Mental Health Support

arXiv:2610.22314v1 Announce Type: new Abstract: With people increasingly turning to AI chatbots for mental health support, the need to evaluate these tools is becoming more pressing. Recent benchmarks

researcharxiv-cs-cl

Orbia: Do Generated Videos Form a Consistent 3D World?

arXiv:2610.20693v1 Announce Type: new Abstract: Video generators serve as interactive worlds for exploration and simulation, yet realistic and visually appealing frames do not necessarily depict a con

Shortcut Sensitivity in Agent-Safety Evaluations

arXiv:2610.22243v1 Announce Type: new Abstract: AI agents take actions through tools. Some actions are sensitive, so guards that supervise them must themselves be evaluated reliably. Yet the data used

SSR: Structural Signal Retriever for Scalable Agent Discovery in LLM-Orchestrated Multi-Agent Systems

arXiv:2610.21113v1 Announce Type: cross Abstract: Large-scale multi-agent ecosystems require mechanisms for discovering suitable agents without exposing entire registries to a large language model (LL

A Diagnostic Study of World-Space Human Recovery Under High Camera Dynamics

arXiv:2610.19729v1 Announce Type: new Abstract: Monocular world-space human recovery methods excel on current benchmarks, but these rarely include fast camera motion. We introduce the K-Pop stress tes

researcharxiv-cs-cv

Action Jets: Learning the Local Shape of the Action-conditioned Data Manifold

arXiv:2610.19007v1 Announce Type: new Abstract: World models are a powerful means of reasoning and planning, but many of these action-conditioned predictive models are high dimensional and computation

ActMOF: Mapping Reticular Synthesis through Active Learning

arXiv:2610.19404v1 Announce Type: cross Abstract: Reticular chemistry allows metal-organic frameworks (MOFs) to be designed from their building units, yet their synthesis remains constrained by sparse

Adaptive Computation with Conformal Certification

arXiv:2610.19189v1 Announce Type: new Abstract: Scientific imaging data involving medical (e.g., 3D radiographic, microscopic images) and astronomical sensors pose different challenges from natural im

Aligning Faithfulness for Theory-Scale Autoformalization

arXiv:2610.18498v1 Announce Type: cross Abstract: Autoformalization (AF) requires more than compilation: formal statements must preserve the meaning of their informal sources, a property known as fait

ANCHOR: Assessing Naturalistic Constraint Hierarchies and Ordering in Repository-Grounded Agentic Coding

arXiv:2610.16859v2 Announce Type: replace Abstract: For repository-grounded coding agents, a functionally correct patch is not necessarily an acceptable one: developers also constrain how the task mus

Agents

Autonomous Science Bench: Evaluating AI Agents for Autonomous Scientific Discovery

arXiv:2610.18449v1 Announce Type: new Abstract: AI agents for autonomous scientific discovery must decide which experiments to run under a limited budget. Most benchmarks for science agents provide fi

agentsarxiv-cs-ai

Can LLMs Access their World Knowledge for Event Prediction?

arXiv:2610.19021v1 Announce Type: new Abstract: Recent work has questioned whether large language models (LLMs) can be useful for temporal event prediction. Despite vast pretrained world knowledge, LL

Confidently Wrong: Detecting Hallucinations in Financial Question Answering from LLM Internal States

arXiv:2607.11414v2 Announce Type: replace Abstract: Large language models (LLMs) in financial applications fail most consequentially when they are confidently wrong. Hedged, uncertain answers invite s

Conformalized Physics-Informed Weak Regression for Parameter Estimation in Epidemic Models

arXiv:2610.19058v1 Announce Type: cross Abstract: Compartment models of infectious diseases are often linear in coefficients that are physical parameters or products or ratios of them. We exploit this

Continuous Risk-Based Scheduling for Food Safety Inspection: Integrating Historical Decay with Event-Driven Consumer Review Signals

arXiv:2610.15191v1 Announce Type: new Abstract: Batch risk-based inspection scheduling struggles to detect a critical failure class: food facilities with recent clean inspections that subsequently dev

CoWear: Towards Collaborative Wearable Inertial Localization with Multiple Smart Devices

arXiv:2610.20596v1 Announce Type: new Abstract: Consumer smart devices observe the same human motion from different body locations, yet existing inertial-localization benchmarks rarely provide synchro

researcharxiv-cs-ro

ELARSpeech: A 30K-Hour Dataset Across 675 Underrepresented Languages for Long-Tail Multilingual Speech Technologies

arXiv:2610.19388v1 Announce Type: new Abstract: Massively multilingual speech modeling has made remarkable progress in recent years, yet existing training resources and benchmarks still underrepresent

researcharxiv-cs-cl

Evaluating Large Language Models for Multilingual Abstractive Summarization: A Comprehensive Study of English and Bengali

arXiv:2610.19003v1 Announce Type: new Abstract: Abstractive summarization remains challenging across languages, where linguistic quality and factual consistency may diverge, particularly in low-resour

Exhaustive Canonical Skeletons Generation: A Formal Dataset for Decomposable Symbolic Regression

arXiv:2610.20108v1 Announce Type: new Abstract: Neural symbolic regression (SR) models require diverse datasets of mathematical expressions for robust training. However, existing datasets rely predomi

Applications

Generating Synthetic Doctor-Patient Conversations for Long-form Audio Summarization

arXiv:2604.06138v2 Announce Type: replace-cross Abstract: Long-context audio reasoning is underserved in both training data and evaluation. Existing benchmarks target short-context tasks, and the open

applicationsarxiv-cs-ai

How Far Can Coding Agents Go in Visual Generation?

arXiv:2610.19025v1 Announce Type: new Abstract: Modern image generation largely relies on specialized generative models that leave the process of image construction implicit in learned parameters. We

Instructions Are Evidence, Not Objectives: Measuring Outcome Alignment of Agents

arXiv:2610.17757v1 Announce Type: new Abstract: Large language model agents can follow complex human instructions to solve real-world tasks. In practice, however, initial instructions are often incomp

KiToke: Distribution-Aware Token Compression for Video Large Language Models

arXiv:2604.03414v2 Announce Type: replace Abstract: Video Large Language Models (Video LLMs) achieve strong performance on video understanding tasks but suffer from high inference costs due to the lar

Learning What to Keep: Transfer-Aware Personal Skill Learning from User Feedback

arXiv:2610.19380v1 Announce Type: new Abstract: User feedback enables LLMs to refine reusable personalized skills, but often mixes persistent preferences with request-specific corrections. Indiscrimin

MCPDisCo: Seesaw-Mitigated Tuning for MCP-Native Agents

arXiv:2610.14956v1 Announce Type: new Abstract: The Model Context Protocol provides a shared interaction substrate for the agentic web, allowing heterogeneous services to expose capabilities through a

More Methods, Better Agents? A Reality Check on Self-Distillation in Agentic Reinforcement Learning

arXiv:2610.19789v1 Announce Type: new Abstract: Self-distillation in agentic reinforcement learning has produced a growing number of methods. However, existing evaluations often reuse published baseli

NavAble: A Large-Scale Dataset and Synthetic Data Generation Pipeline for Blind Navigation

arXiv:2610.19330v1 Announce Type: new Abstract: Reliable recognition of accessibility-critical objects (e.g., audible pedestrian signals, door-activation buttons, and handrails) is essential for assis

Neural POS Tagging for the Low-Resource Saraiki

arXiv:2610.20279v1 Announce Type: new Abstract: Part-of-speech tagging is a fundamental sequence labeling task and an important component for many downstream natural language processing applications.

PhyMetric: Diagnosing Physical Plausibility in Text-to-Video Generation via Scene-Level QA

arXiv:2610.19823v1 Announce Type: new Abstract: Text-to-video (T2V) generation models can produce visually realistic videos that nevertheless violate the physical consequences implied by the prompt an

ProCARE: Real-World Study Automation via Profile-Grounded Evidence Contracts

arXiv:2610.16175v1 Announce Type: new Abstract: Real-world studies (RWS) analyze routinely collected healthcare data, such as electronic health records and insurance claims, to estimate treatment effe

PseudoBench: Measuring How Agentic Auto-Research Fuels Pseudoscience

arXiv:2606.18060v2 Announce Type: replace Abstract: As Large Language Model based agents enter autonomous scientific research, their ability to resist pseudoscience becomes increasingly important. Oth

Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation

arXiv:2610.20335v1 Announce Type: new Abstract: Document understanding systems are typically evaluated as separate components via layout analysis, optical text recognition, reading-order prediction, a

Recognizing Dialogue Ambiguity via Candidate Set Visual Grounding

arXiv:2610.19723v1 Announce Type: new Abstract: Interpreting an ambiguous utterance in real-world interactions often requires context beyond a single utterance. When the utterance refers to objects in

Recursive Improvement of a Differentiable Scientific Software Ecosystem

arXiv:2610.04561v2 Announce Type: replace Abstract: Differentiable programming connects scientific computation with gradient-based inference, learning and design. Extending these capabilities across a

Reels-RSI: Program-Level Self-Improvement for Code-Rendered Explainer Videos

arXiv:2610.14495v1 Announce Type: new Abstract: Explainer videos -- a worked geometry problem, why the sky is blue, how a dynasty fell -- are usually one more target for pixel video generation. We arg

Reliable Text-to-SQL in Resource-Constrained Settings with Small LLMs via Iterative Retry Workflows

arXiv:2610.17305v1 Announce Type: new Abstract: Large Language Models (LLMs) have recently improved Text-to-SQL generation, but their computational cost can hinder deployment in resource-constrained s