Search: “evaluation”

ReTrace: Cross-Stage Failure Attribution for Self-Improving Robotic Manipulation

arXiv:2610.15814v1 Announce Type: new Abstract: General-purpose multimodal foundation models are increasingly capable of directly controlling robots, yet improving their manipulation capabilities thro

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Tutorials

Siam-ALS: An Explainable Siamese Deep Learning Framework for Early ALS Detection Using EEG and Eye-Tracking Signals

DGX agent

arXiv:2610.15351v1 Announce Type: new Abstract: Amyotrophic lateral sclerosis (ALS) diagnosis remains challenging due to heterogeneous symptoms and reliance on clinical assessment, underscoring the ne

tutorialsarxiv-cs-lg

14 Oct 2026

SidewalkBench: Benchmarking Visual Navigation on Urban Sidewalks

arXiv:2606.16953v2 Announce Type: replace Abstract: Urban sidewalk navigation presents significant challenges due to complex structural layouts, dynamic pedestrian behaviors, and long distances. While

Towards Dependable Optical Flow: Benchmarks for Real-World Spatiotemporal Corruptions

arXiv:2411.14865v2 Announce Type: replace-cross Abstract: Optical flow estimation is a fundamental task in dynamic scene understanding and computer vision. While recent deep models achieve impressive

Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark

arXiv:2610.13947v2 Announce Type: replace Abstract: In this paper, we study physically grounded articulated 3D asset generation---moving the goal from reproducing how objects look to capturing how the

Trust Before Autonomy: Rethinking Agentic Remote Sensing for Crisis Response

arXiv:2610.18789v1 Announce Type: new Abstract: Agentic remote sensing is evaluated on how many questions it can answer, whereas crisis response depends on whether its answers can be relied on and how

TwinPrune: Density-Aware Two-Phase Token Pruning for Vision-Language Models

arXiv:2610.17530v1 Announce Type: new Abstract: We propose a unified spatial-density signal to score token importance for both inference phases: bipartite merge for prefill and KV eviction for decode,

researcharxiv-cs-cv

Vision-Predictor-Action: Towards Efficient Embodied AI via Neuro-Symbolic JEPA Predictors

arXiv:2610.15556v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models commonly generate robot actions token by token through Large Language Model (LLM) decoders, causing inference late

Tutorials

We Have Been Interpreting Diffusion Transformer Backbone Behaviors Wrong

arXiv:2610.14517v1 Announce Type: new Abstract: During a network forward call, diffusion backbones naturally produce many intermediate activations. If we evaluate each activation against an identical

tutorialsarxiv-cs-cv

WorkRover: Scaling Long-Horizon Cowork Agent Training Via Recursive Environment Evolution

arXiv:2610.18067v1 Announce Type: cross Abstract: Scaling interactive environments is important for training long-horizon agents through reinforcement learning. These environments often require furthe

agentsarxiv-cs-lg

XForecast: The KDD 2026 Finance Day Challenge on News-Grounded Financial Forecasting

arXiv:2610.16131v1 Announce Type: new Abstract: Financial forecasting has traditionally relied on numerical time-series (TS) signals, while textual information such as news remains largely underutiliz

Applications

Auditing Prompt Injection Defenses Before They Reach Users: What Strong Adversaries Reveal

arXiv:2505.15738v3 Announce Type: replace-cross Abstract: Large language models are increasingly deployed in user-facing products that handle sensitive personal data while interacting with untrusted e

applicationsarxiv-cs-ai

Beyond the Snowflakes: Disentangling Weather Effects from Confounding Meta-Factors in LiDAR Object Detection

arXiv:2610.13891v1 Announce Type: cross Abstract: Light Detection and Ranging (LiDAR) is critical for autonomous perception, yet its performance is known to degrade in adverse weather. While existing

agentsarxiv-cs-ro

CoGameReg: Cooperative-Game-Based Collaborative Semi-Supervised Regression for Seismic Reservoir Property Prediction

arXiv:2610.12884v1 Announce Type: new Abstract: Accurate estimation of reservoir properties from seismic data remains challenging when well-log labels are sparse but three-dimensional seismic observat

Equality, Equity, and Causality in Fairness Research: A Commentary on Cheng (2026)

arXiv:2607.17679v2 Announce Type: replace-cross Abstract: This is an invited commentary on the Psychometrika focus article 'Fairness Issues and Evaluation in Psychometrics and AI/ML: What Can We Learn

safetyarxiv-cs-lg

From Benchmark to Bench: Can Agents Survive Real-World Drug Discovery?

arXiv:2610.06411v2 Announce Type: replace Abstract: Agentic systems increasingly coordinate molecular-design tools, but it is unclear which layer of the stack limits outcomes on real projects. We deve

Incremental Retrieval-Augmented Generation for Human-in-the-Loop Decision Support

arXiv:2610.12666v1 Announce Type: cross Abstract: We introduce iRAG, a human-in-the-loop decision-support system combining Retrieval-Augmented Generation (RAG) with Hybrid Decision-Making. Unlike conv

agentsarxiv-cs-ai

Instance-Level Difficulty: A Missing Perspective in Machine Unlearning

arXiv:2410.03043v3 Announce Type: replace Abstract: Current research on deep machine unlearning primarily focuses on improving or evaluating the overall effectiveness of unlearning methods while overl

researcharxiv-cs-lg

JoyInside-VLM-Agent: Product-Conditioned Multimodal Policy Learning for Embodied Agents

arXiv:2610.12957v1 Announce Type: cross Abstract: Embodied agents must translate multimodal observations and user requests into executable actions while adapting to product constraints, changing goals

LLMail-Inject: A Dataset from a Realistic Adaptive Prompt Injection Challenge

arXiv:2506.09956v2 Announce Type: replace-cross Abstract: Indirect prompt injection attacks exploit a fundamental weakness of LLMs: executing unauthorized tasks from untrusted sources. Despite the pra

Machine Learning and Time-Series Foundation Models for Day-Ahead Electricity Forecasting in a University Building

arXiv:2610.12638v1 Announce Type: cross Abstract: Day-ahead electricity forecasts can help building operators schedule heating, ventilation, and other services around anticipated demand. Choosing a fo

MADS: Multi-Agent Dialog Simulation for Robust Conversational Agents

model-releasesarxiv-cs-cl

arXiv:2610.12757v1 Announce Type: new Abstract: Task-oriented conversational agents remain fragile under realistic conditions, especially when users exhibit non-cooperative behavior. Existing function

Multimodal Image-based Robotic Assistance and Guidance Environment (MIRAGE): A Novel Unified Framework for Surgical Navigation and Visualization

arXiv:2610.12780v1 Announce Type: new Abstract: This paper presents the computational architecture and quantitative preclinical evaluation of MIRAGE, a multimodal image-guided robotic surgery framewor

researcharxiv-cs-ro

Proactive Agentic Orchestration

arXiv:2610.13485v1 Announce Type: new Abstract: Agentic orchestration delegates tasks to sub-agents with independent contexts, providing a key path to extending the effective execution horizon of larg

safetyarxiv-cs-cl

Reward Hacking as a Transmissible Strategy in Multi-Agent Coding Systems

arXiv:2610.12822v1 Announce Type: new Abstract: Multi-agent systems are increasingly used to solve coding tasks by coordinating agents that share code and plans. These agents are often optimized with

SWE-Critix: Post-Training Generalist Verifiers for Assessing Coding-Agent Trajectories

arXiv:2610.13356v1 Announce Type: new Abstract: Coding agents are increasingly deployed for end-to-end software engineering tasks, where a readily available oracle evaluator that defines the success c

agentsarxiv-cs-ai

SWE-DeceptionBench: Benchmarking Deceptive Behaviors of LLMs Across the Software Development Lifecycle

arXiv:2610.13626v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly used throughout the software development lifecycle. This growing reliance on LLMs raises concerns about

When LiDAR Fades, Radar Takes Over: LiDAR Reliability-Aware Adaptive Localization Under Airborne Obscurants

arXiv:2610.13788v1 Announce Type: new Abstract: LiDAR-inertial odometry (LIO) is widely used for real-time localization and mapping, but its reliability can degrade substantially in subterranean envir

When Simulation Lies: A Sim-to-Real Benchmark and Domain-Randomized RL Recipe for Tool-Use Agents

arXiv:2605.11928v2 Announce Type: replace Abstract: Tool-use language agents are evaluated on benchmarks that assume clean inputs, unambiguous tool registries, and reliable APIs. Real deployments viol

WoundAmbit: Bridging State-of-the-Art Semantic Segmentation and Real-World Wound Care

arXiv:2504.06185v3 Announce Type: replace-cross Abstract: Chronic wounds affect a large population, particularly the elderly and diabetic patients, who often exhibit limited mobility and co-existing h

A 3D Characterization Framework for Intelligent Sequential Decision Making

arXiv:2610.11696v1 Announce Type: new Abstract: Puzzles are widely used to evaluate the reasoning capabilities of artificial intelligence (AI) systems for sequential decision making, yet approaches or

ASPIRE: Saddle-Point Discovery through Set Prediction and Physical Refinement

arXiv:2610.10969v1 Announce Type: new Abstract: Predicting thermally activated diffusion and defect evolution with event-driven models requires identifying atomic rearrangement mechanisms and their ac

AuraLuxMuse: Adaptive Fusion Modeling for Aesthetic Stage Lighting Design with Music and Expert Guidance

arXiv:2610.11792v1 Announce Type: cross Abstract: We present AuraLuxMuse, a novel system for automated aesthetic stage lighting design that integrates expert knowledge, representation learning, and pr

Back in Style: A Sociolinguistic Approach to Authoring and Measuring Persona Fidelity in User Simulation

arXiv:2610.10988v1 Announce Type: new Abstract: As agentic systems gain commercial popularity, user simulators increasingly serve as measurement instrument for their evaluation. However, the fidelity

agentsarxiv-cs-cl

BeliefScope: Diagnosing Evidence-Driven Revision and Pressure-Induced Shifts in Large Language Models

model-releasesarxiv-cs-cl

arXiv:2610.11305v1 Announce Type: new Abstract: A language model may revise the same proposition after receiving genuinely relevant evidence or after receiving directional user pressure that adds no r

Can LLMs Fix It Without Code? Toward Automated Verification of No-Code Bug Fixes

arXiv:2610.11963v1 Announce Type: cross Abstract: A no-code fix resolves an invalid bug report by directing the user to change a setting, update to a version where the problem is already fixed, or adj

Chronos Enables Code Agents to Reason over Software Evolution

arXiv:2610.11578v1 Announce Type: cross Abstract: Historical pull requests record the design decisions, compatibility constraints, and implementation patterns behind a codebase's current state. Experi

agentsarxiv-cs-cl

Continuous Ground-Truth Construction and a Recovery Policy for Air--Water Robotic Tracking

arXiv:2610.11096v1 Announce Type: cross Abstract: Visual tracking across the air-water interface is challenged by splashes, bubbles, refraction, reflections, and abrupt appearance changes that can tem

Conversational Task Disambiguation over Tabular Data: Leakage-Aware Formulation, Benchmark Suite, and Training

arXiv:2610.10740v1 Announce Type: cross Abstract: Conversational task disambiguation over tabular data uses dialogue to resolve missing information about a user's intended task before producing a solu

Coverage, Not Difficulty, Sets How Much Synthetic Data an Activation Probe Needs

arXiv:2610.10594v1 Announce Type: new Abstract: Activation probes that monitor deployed language models are trained on synthetic conversations, and how many a probe needs is open. We trace learning cu

DataVista: Diagnosing Multimodal LLMs on Data Video Understanding

arXiv:2610.11993v1 Announce Type: cross Abstract: Data video is a media form that integrates data visualization with video narrative, widely adopted in news reporting and business analysis. Compared w

Demonstrating Arena 5.0: A Photorealistic ROS2 Simulation Framework for Developing and Benchmarking Social Navigation

arXiv:2610.11220v1 Announce Type: new Abstract: Building upon the foundations laid by our previous work, this paper introduces Arena 5.0, the fifth iteration of our framework for robotics social navig

Expression-Diverse References for Identity-Preserving Video Generation

arXiv:2610.11023v1 Announce Type: new Abstract: Identity-preserving video generation aims to maintain a subject's identity while synthesizing realistic videos. Yet a single reference portrait captures

Limited Stereotype Control Through Routing Reweighting in MoE Language Models

arXiv:2603.27141v2 Announce Type: replace Abstract: Demographic prompts are routed differently from neutral prompts in Mixture-of-Experts (MoE) language models, motivating tests of routing-level stere

safetyarxiv-cs-cl

Machine Learning Optimization for Enhanced OS Fingerprinting

arXiv:2610.11133v1 Announce Type: new Abstract: Operating System (OS) Fingerprinting is a technique that can be used to identify a network's operating systems by evaluating network traffic in the form

researcharxiv-cs-lg

ManiUnit: A Manipulation Skill Dataset and Benchmark for Long-Horizon Tasks

arXiv:2610.12089v1 Announce Type: new Abstract: Long-horizon mobile manipulation requires a robot to navigate multi-room environments and execute a sequence of manipulation skills under a single natur

Mine Odyssey: Benchmarking Spatial Agentic Intelligence in the Wild

arXiv:2610.11328v1 Announce Type: new Abstract: Advances in foundation models are driving efforts to introduce agents to assist people in the physical world. Such agents require agentic spatial intell

More Than Meets the Eye? Uncovering the Reasoning-Planning Disconnect in Training Vision-Language Driving Models

arXiv:2510.04532v2 Announce Type: replace Abstract: Vision-Language Model (VLM) driving agents promise explainable end-to-end autonomy by first producing natural-language reasoning and then predicting