Search: “evaluation”

PhysioBench: A Unified Benchmark for Physiological Signal Question Answering

arXiv:2609.20836v1 Announce Type: new Abstract: Physiological signals support diverse clinical and monitoring tasks, yet existing physiological signal foundation models typically require task-specific

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Refining Ground Truth Poses in Autonomous Driving Datasets via Neural Rendering

DGX agent

arXiv:2504.15776v2 Announce Type: replace Abstract: Public autonomous driving datasets underpin the training and benchmarking of perception, mapping, and localization algorithms, yet residual inaccura

local-aiarxiv-cs-cv

21 Sept 2026

Agents

Value-Sensitive Delegation in Everyday AI Agent Use: Evidence from OpenClaw

arXiv:2609.22067v1 Announce Type: cross Abstract: Users increasingly delegate work to autonomous AI agents, yet evaluations typically measure task completion rather than the values users prioritize. U

agentsarxiv-cs-ai

VIRGA: Virtual-Agent-Intermediated Riemannian Geometry for Active-Sensing Air-Ground Coordination

arXiv:2609.21883v1 Announce Type: new Abstract: Air-ground autonomy becomes harder when the unmanned aerial vehicle (UAV) must remain observable by a gimbal light detection and ranging (LiDAR) mounted

safetyarxiv-cs-ro

VLA-Scope: Shift-Aware Failure Prediction for Vision-Language-Action Models

arXiv:2609.21246v1 Announce Type: cross Abstract: Vision-language-action (VLA) models map visual observations and natural-language instructions to robotic actions, but distribution shifts can compromi

Voice-Light: A Full-Duplex Cascaded Voice Agent with Causal Turn-Taking and Speculative Generation

arXiv:2609.20995v1 Announce Type: cross Abstract: Natural spoken interaction requires more than streaming ASR, language generation, and speech synthesis: a system must react to overlap without canceli

safetyarxiv-cs-cl

Architectural Design, Not Only Model Intelligence, Governs Multi-Agent LLM Performance

arXiv:2602.03128v2 Announce Type: replace Abstract: Multi-agent LLM frameworks are data-intensive systems that govern how agents orchestrate tasks, manage state, and coordinate decisions. These archit

BioPhys-Bridge: A Benchmark for Interdisciplinary Scientific Reasoning in Physics-Grounded Biological Research

arXiv:2609.19180v1 Announce Type: new Abstract: Language models face unique challenges in analyzing interdisciplinary scientific research literature. In biophysics research, faithful answers require g

Can 4D Foundation Models Remember?

arXiv:2609.20819v1 Announce Type: new Abstract: Perceiving and remembering the visual world is fundamental to navigating and interacting with our environment. Current 4D foundation models, such as cam

researcharxiv-cs-cv

Can Vision-Language Models Judge Olympic Diving? From Reasoning to Scores in Zero-Shot Action Quality Assessment

arXiv:2609.19354v1 Announce Type: cross Abstract: Automated action quality assessment (AQA) in Olympic sports remains a challenging task due to the complexity of human motion and the subjectivity inhe

CARE-VI: Conservative Adaptive Reliability Estimation for Value Improvement in Off-Policy Actor-Critic Learning

arXiv:2609.20098v1 Announce Type: new Abstract: Reliable temporal-difference targets are central to off-policy actor-critic learning. Direct value improvement refines the next-state target with altern

safetyarxiv-cs-lg

CliniCIRCA: A Modular LLM Framework for Constructing Longitudinal Mental Health Patient Journeys from Raw EHR Narratives

arXiv:2609.19585v1 Announce Type: cross Abstract: In mental health care, reasoning over patient journeys is a key task for clinicians. Yet these journeys, encompassing a longitudinal progression of bi

CounselReflect: Opportunities and Challenges for Designing Tools to Support Self-Reflection on Mental Health and Well-Being Conversations with AI

arXiv:2603.29429v2 Announce Type: replace Abstract: AI is increasingly used for mental health and well-being support, creating an urgent need for safer engagement, while design, evaluation, and govern

researcharxiv-cs-cl

DART: Distillation-Aware Reparameterization for Training-Free LoRA Reuse in Few-Step Video Diffusion Models

arXiv:2609.20051v1 Announce Type: new Abstract: Step distillation reduces the cost of video generation, but reusing a LoRA trained for a longer trajectory can alter its functional effect or degrade ta

DeliveryGym: An RL Environment for Long-Horizon Embodied Agent Planning with Adaptive Curriculum

arXiv:2609.19801v1 Announce Type: new Abstract: Executable environments enable LLM agents to learn from the consequences of their actions. For embodied agents, those consequences extend beyond whether

safetyarxiv-cs-lg

greCAPTCHA: Assessing Understanding as Evidence of Research Authorship Under Generative AI

arXiv:2609.20481v1 Announce Type: cross Abstract: Conferences, journals, funders, schools, and universities are struggling with a surge of potentially AI-generated submissions from ostensibly human au

Grounded Product Understanding in Livestream Videos

model-releasesarxiv-cs-cv

arXiv:2609.20508v1 Announce Type: new Abstract: E-commerce livestreams have emerged as an important channel for presenting products to online consumers, containing multiple products whose information

Harm Laundering in GPT Models: Evidence That Gender Discrimination Is Transformed Rather Than Reduced Across Safety-Trained Generations

arXiv:2609.20779v1 Announce Type: cross Abstract: Safety evaluations for large language models rely on surface-form classifiers that report declining harm scores across model generations. We provide e

Improving Cross-embodiment Transfer in Latent Action Models with Action-Similarity Supervision

arXiv:2609.19846v1 Announce Type: cross Abstract: As generalist robot policies gain vision and language from web-scale pretraining, demonstrations remain costly to collect and tied to the robot that r

safetyarxiv-cs-ai

Agents

Kinematics-Grounded Agentic AI for Robotic Additive Manufacturing Process Planning

arXiv:2609.19347v1 Announce Type: cross Abstract: Robotic additive manufacturing (AM) extends material-extrusion printing beyond gantry kinematics but makes process planning robot-dependent. A slicer-

agentsarxiv-cs-ai

KoUniTalk: A Lightweight Articulation-Centered Korean-English 3D Talking Face Benchmark

model-releasesarxiv-cs-cv

arXiv:2609.19840v1 Announce Type: new Abstract: High-quality 3D talking face datasets remain largely English- centric, and Korean 3D facial motion data are difficult to combine with standard English b

Learning Slope-Adaptive Whole-Body Locomotion for Humanoid Robots in Roofing Construction

arXiv:2609.20558v1 Announce Type: new Abstract: Roofing requires workers to coordinate locomotion, balance, and work-related body motions on pitched surfaces, creating a challenging application for hu

safetyarxiv-cs-ro

LinePilot Digitizer: Line-Plot Recovery with Manual and Automatic Calibration

arXiv:2609.19377v1 Announce Type: cross Abstract: Recovering numerical series from line plots requires accurate axis calibration and reliable curve extraction. We present LinePilot Digitizer (LinePilo

Tutorials

Perspective of Software Engineering Researchers on Machine Learning Practices Regarding Research, Review, and Education

arXiv:2411.19304v2 Announce Type: replace-cross Abstract: Context: Machine Learning (ML) significantly impacts Software Engineering (SE), but studies mainly focus on practitioners, neglecting research

tutorialsarxiv-cs-lg

RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents

arXiv:2609.20754v1 Announce Type: new Abstract: Effective troubleshooting agents in enterprise customer support depend on retrieving actionable guidance from similar historical cases, yet existing ret

Hardware

S4R: Scaling for Rigid-Body Interpenetration Resolution

arXiv:2609.20524v1 Announce Type: cross Abstract: Rigid-body interpenetration frequently occurs in procedurally assembled and generated scenes and must be removed before downstream applications such a

hardwarearxiv-cs-ro

Small Enough to Know Everything: The Fully-Enumerable Transformer as an Instrument for the Science of Delayed Generalization

arXiv:2609.20166v1 Announce Type: new Abstract: Tiny transformers trained on fully-enumerable tasks occupy an unusual position in the study of grokking: every input can be evaluated, every generalizat

researcharxiv-cs-lg

To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archives

arXiv:2609.19167v1 Announce Type: new Abstract: As AI systems evolve into personalized digital companions, a central capability is reasoning over a user's long-term personal history: not merely storin

Agents

UnifiedPlayers: Enhance Tool-Integrated Reasoning in Agentic Reinforcement Learning

arXiv:2609.20089v1 Announce Type: new Abstract: Self-evolving methods reduce the need for human-annotated trajectories by allowing tool-using agents to generate their own training data. Yet existing m

agentsarxiv-cs-ai

Accelerating Diffusion Sampling via Speculative Draft Trees

arXiv:2609.17691v1 Announce Type: cross Abstract: Speculative sampling accelerates diffusion model generation by drafting inexpensive candidate states and correcting them under a coupling that preserv

ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models

arXiv:2609.18487v1 Announce Type: cross Abstract: Action tokenizers play a central role in autoregressive vision-language-action (VLA) models, determining both the targets for policy training and the

safetyarxiv-cs-ai

AI and Human Approaches to Mathematical Problem Solving

arXiv:2609.17779v1 Announce Type: cross Abstract: AI systems have begun to report solutions, disproofs, and substantive advances on long-standing mathematical problems, raising questions about whether

Tutorials

Anomaly Detection in General Ledger Data: Results from a Hybrid Approach

arXiv:2609.18228v1 Announce Type: new Abstract: Journal Entry Tests (JETs) are a mandatory part of annual audits to evaluate and assess both highrisk audit areas and potential material misstatements.

tutorialsarxiv-cs-lg

Behavioral Fingerprinting and Navigation Prediction in Web Browsing

arXiv:2609.18273v1 Announce Type: new Abstract: Web browsing often appears ephemeral: users visit a few websites, complete a task, and move on. However, even short fragments of browsing activity can c

researcharxiv-cs-lg

Benchmarking Large Language Models for Biomedical Relation Extraction

arXiv:2609.19071v1 Announce Type: new Abstract: Extracting SNP-phenotype associations from biomedical literature is vital but challenging. We benchmarked diverse NLP models, including MLMs, hybrid arc

BOOM: Benchmarking Out-Of-distribution Molecular Property Predictions of Machine Learning Models

arXiv:2505.01912v3 Announce Type: replace-cross Abstract: Data-driven molecular discovery leverages artificial intelligence/machine learning (AI/ML) and generative modeling to filter and design novel

Clueing up LLMs with Tool-Augmented Deductive Reasoning

arXiv:2609.18736v1 Announce Type: new Abstract: Despite recent advances in large language models (LLMs), performing logically consistent deductive reasoning over extended interactions remains challeng

Collective Loss of Control in LLM Agent Systems: An Epidemic Account of Mutation, Contagion, and Recovery

arXiv:2609.18460v1 Announce Type: new Abstract: How does a multi-agent system evolve from a local deviation into collective loss of control? We propose an epidemic explanation organized around acciden

Compiled Agency: Frontier General-Purpose Coding Agents Build Winning Game Players from Bare Interaction - from Flappy Bird to StarCraft II and Civilization

arXiv:2609.18996v1 Announce Type: new Abstract: LLM agents have repeatedly struggled to convert knowledge of a game into competent play, even when researchers build the agent around the model - supply

safetyarxiv-cs-ai

Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models

arXiv:2609.18041v1 Announce Type: cross Abstract: Multi-encoder fusion extends Large Audio-Language Models (LALMs) beyond speech-centric recognition, but selecting encoders via intuition or exhaustive

Decodable but Misrouted: Sparse Features Uncover a Readout Gap in Vision-Language Models for Harmful Meme Detection

arXiv:2609.18860v1 Announce Type: cross Abstract: When a large vision-language model misclassifies a harmful meme, the failure may reflect missing internal evidence or an inability to route represente

Echo: Learning-based Matching Decompilation using Trusted Back Translation

arXiv:2609.18706v1 Announce Type: cross Abstract: Neural decompilers can recover readable and recompilable source code from binaries, but their predictions remain difficult to trust. Matching decompil

Applications

Examining the Difference in Human Behavior Between Virtual and Real-World Human-Robot Teaming

arXiv:2609.18900v1 Announce Type: new Abstract: Prototyping and evaluating human-robot teaming (HRT) scenarios in the real-world is costly. Virtual simulation of HRT scenarios has been adopted as an a

applicationsarxiv-cs-ro

Applications

Extracting Probabilistic Knowledge from Large Language Models for Bayesian Network Parameterization

arXiv:2505.15918v3 Announce Type: replace-cross Abstract: In this work, we evaluate the potential of Large Language Models (LLMs) in building Bayesian Networks (BNs) by approximating domain expert pri

applicationsarxiv-cs-ai

From Pixels to Pairs: A Comprehensive Benchmark of LLM-Based Key-Value Extraction in Noisy Document Settings

arXiv:2609.17538v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for structured information extraction from documents, yet their behavior under realistic OCR noise re

GraphEcho: Structural Redundancy and Evidence Provenance in LLM Graph Agents

arXiv:2609.17695v1 Announce Type: new Abstract: A large language model (LLM) agent can follow more graph paths without acquiring more independent evidence. GraphEcho tests whether agents mistake these

How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards

arXiv:2609.18908v1 Announce Type: new Abstract: Existing legal benchmarks cover diverse tasks, while continuous monetary remedies remain comparatively underexplored. We introduce ECtHR-NPD, to the bes

iMINDBench: iEEG Multi-Institution Neural Decoding Benchmark

model-releasesarxiv-cs-lg

arXiv:2609.18104v1 Announce Type: new Abstract: Intracranial electroencephalography (iEEG) is widely used to record electrical activity directly from electrodes inside the human brain, making it an at