Search: “evaluation”

Words to World: Benchmarking LLMs in Interactive Physical Environments

model-releasesarxiv-cs-ai

arXiv:2610.15228v1 Announce Type: new Abstract: Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that aff

15 Oct 2026

Safety

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

A Few More Tokens Ahead: Reinforcing Parallelism in Diffusion LLMs

DGX agent

arXiv:2610.18200v1 Announce Type: new Abstract: Parallel generation is widely regarded as an inherent advantage of diffusion large language models. Yet our fixed-quota evaluation of four representativ

safetyarxiv-cs-lg

14 Oct 2026

Benchmarking Interaction-Oriented Aerial Mobility across Heterogeneous Environments

arXiv:2610.18381v1 Announce Type: new Abstract: Aerial mobile manipulation requires unmanned aerial vehicles (UAVs) to traverse heterogeneous environments such as indoor and outdoor domains, and conne

Benchmarking Self-Supervised 3D Medical Vision Foundation Models and Transferability Estimation

arXiv:2610.17573v1 Announce Type: new Abstract: Self-supervised pretraining has expanded the pool of 3D medical foundation models, but published evaluations use different datasets, endpoints and fine-

Calibrated alpha-Barycenters for Multiobjective f-Divergence Optimization

arXiv:2610.16819v1 Announce Type: cross Abstract: Matching one distribution to many targets can require repeated evaluations of every target. CAL-alpha-MODM aggregates a nonlinear predictor into one b

Certified Robustness via Sparse Second-Order Cone Relaxations

arXiv:2610.16016v1 Announce Type: new Abstract: Certified robustness is critical for deploying neural networks in safety-sensitive settings, but computing exact certificates typically requires solving

ChronoScribe: Semantic-Numerical Specialization for Instruction-Driven Time Series Forecasting

arXiv:2610.16345v1 Announce Type: cross Abstract: Recent advances in instruction-driven time series forecasting highlight a fundamental tension: systems must simultaneously master natural-language ins

CoCA: Criterion-Aware Credit Assignment for Rubric-Based Reinforcement Learning

arXiv:2610.17733v1 Announce Type: new Abstract: Rubric-based reinforcement learning (RL) evaluates responses against explicit criteria to construct rewards, offering a viable way to train large langua

Decoupling Knowledge Forgetting and Refusal Learning in MLLM Unlearning

arXiv:2610.14605v1 Announce Type: cross Abstract: Current evaluations of multimodal unlearning typically focus on whether a model stops outputting target information. This surface-level criterion, how

DiffGA: Steering Frozen Diffusion Models for Materials Design via Evolutionary Search

arXiv:2610.14999v1 Announce Type: cross Abstract: Steering candidate generation toward user-defined objectives is central to inverse materials design, yet remains difficult when objectives are black-b

DTA-GT: Direction- and Topology-Aware Graph Transformer for Neural Network Representation Learning

arXiv:2610.16822v1 Announce Type: new Abstract: Architecture attribute predictors reduce the cost of neural architecture search by estimating accuracy or latency from a small set of evaluated candidat

Evidence-First Agentic Verification

arXiv:2610.17724v1 Announce Type: cross Abstract: Long-horizon, semi-verifiable agentic tasks often rely on rubric-based evaluation, but the evidence needed to assess these tasks can be spread across

ExeWorldBench: Benchmarking Code-Based Executable 3D World Modeling

arXiv:2610.15166v1 Announce Type: new Abstract: Coding agents are increasingly evolving beyond reproducing what a world looks like toward constructing executable worlds that capture how a world works.

Genesis: Visual Augmentation Primitives for Multimodal Chain-of-Thought Reasoning

arXiv:2610.15565v1 Announce Type: new Abstract: Recent multimodal large language models achieve promising results on visual reasoning tasks, approaching human-level performance on existing STEM benchm

Geometric Parrots: Rule Absence vs. Rule Fragility in Spatial and Physical Reasoning for Vision-Language Models

arXiv:2610.16170v1 Announce Type: new Abstract: Vision-language models (VLMs) can answer many geometric and physical reasoning questions correctly, yet still behave inconsistently in interaction, for

Local Ai

GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learning

arXiv:2610.17845v1 Announce Type: new Abstract: Functional near-infrared spectroscopy (fNIRS) provides portable and spatially localized measurements of cortical hemodynamics, but differences in channe

local-aiarxiv-cs-lg

HALLMARK: How to Diagnose LLM Citation Verifiers and When to Deploy Them

arXiv:2607.18360v2 Announce Type: replace-cross Abstract: GPTZero found 53 NeurIPS 2025 accepted papers with hallucinated citations, and venues now screen submissions with automated reference checkers

Local Ai

HybridDualPathNet: Cross-Fusion Attention of EfficientNetV2 and Swin Transformer for Brain MRI Classification of Alzheimer's and Parkinson's Disease

arXiv:2610.17251v1 Announce Type: new Abstract: Separating Alzheimer's Disease (AD), Parkinson's Disease (PD), and Healthy Controls (HC) using structural MRI remains challenging because disease signat

local-aiarxiv-cs-cv

I2O2I-Nav: A Benchmark with a Modular Agent for Long-Horizon Indoor-to-Outdoor-to-Indoor Navigation

arXiv:2610.18307v1 Announce Type: new Abstract: Service and delivery robots often need to complete long-horizon navigation missions spanning indoor and outdoor environments. Existing embodied navigati

Safety

Inference on the Value of Policy Improvement in Adaptive Experiments

arXiv:2610.15789v1 Announce Type: cross Abstract: In this paper, we develop an asymptotically normal estimator for the value of policy improvement (VPI) under adaptively collected data. This value, wh

safetyarxiv-cs-lg

InfoVis: Unified Slide Image Generation and Editing

arXiv:2610.16784v1 Announce Type: new Abstract: Generating and editing presentation slides requires models to combine accurate text rendering, instruction following, visual grounding, aesthetic design

IsoVRBench: Video Reward Modeling Without Human Feedback

arXiv:2610.17234v1 Announce Type: cross Abstract: Video reward models are trained and evaluated on human preferences between videos that often differ simultaneously on properties such as prompt alignm

Applications

LensErase: A Foundation Model for Erase Anything

arXiv:2610.18072v1 Announce Type: new Abstract: We introduce LensErase, a general-purpose mask-based Erase Anything foundation model designed to cover a broad spectrum of real-world erase scenarios. L

applicationsarxiv-cs-cv

LynxScenes: A Large-Scale Real-World Benchmark for Outdoor Wheel-Legged Robot Perception, Navigation, Imagination and Reconstruction

arXiv:2610.18093v1 Announce Type: new Abstract: Wheel-legged robots operating in outdoor spaces shared with humans require accurate perception, socially compliant navigation, future-scene reasoning, a

Tutorials

Manifold Navigation Learning Using Recurrent Networks: Efficient Training Techniques

arXiv:2610.14325v1 Announce Type: new Abstract: Position tracking is a well-studied problem in Euclidean navigation, yet comparatively little attention has been given to navigation on general manifold

tutorialsarxiv-cs-cv

MiMaAlign: Hierarchical Micro-Macro Alignment for Physically Plausible Video Generation

arXiv:2610.16482v1 Announce Type: new Abstract: Text-to-video (T2V) diffusion models have made remarkable progress in generating high-fidelity visuals, yet their outputs still often exhibit physically

Safety

NetRL: Powering Network Decisions via NetGRPO-Driven Reinforcement Learning

arXiv:2610.16226v1 Announce Type: cross Abstract: Network decision-making tasks, including adaptive bitrate streaming, load balancing, and congestion control, require policies to process heterogeneous

safetyarxiv-cs-lg

One-Way Coupling via Patchwise Adaptive Normalization in Transformer Surrogates

arXiv:2610.14687v1 Announce Type: new Abstract: Many physical systems exhibit one-way coupling: exogenous fields such as medium density or obstacle geometry influence the dynamics without being affect

Physics-guided machine learning for saturation control across variable hydraulic conditions in heap leaching

arXiv:2610.15947v1 Announce Type: cross Abstract: Heap-leaching hydraulics vary between regions of an ore bed, motivating fast prediction models that accommodate different material properties. This st

Pick the Mixture, Not the Samples: Combinatorial Data Selection for LLMs

arXiv:2610.14028v1 Announce Type: new Abstract: Data selection for LLM fine-tuning faces two facts about real training: data pools draw from many distinct domains, and evaluation spans diverse tasks.

Plan-Bench: Can Existing VLMs Go Well Beyond Perception to Reason and Plan in Embodied Worlds?

arXiv:2610.18836v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have achieved strong performance in visual perception and spatial reasoning, leading to growing interest in using them as

Applications

Proactive Physical AI through Continuous Observation and Timely Intervention

arXiv:2610.16967v1 Announce Type: new Abstract: Physical AI is commonly formulated around an explicitly specified task: given a goal or instruction, a system perceives, reasons, and acts. In many real

applicationsarxiv-cs-cv

PVFH-Bench: Benchmarking Premise-Induced Visual Fixation Hallucinations in Vision-Language Models

arXiv:2610.14635v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) have achieved remarkable progress across a wide range of multimodal tasks. However, object hallucination remains

ReTrace: Cross-Stage Failure Attribution for Self-Improving Robotic Manipulation

arXiv:2610.15814v1 Announce Type: new Abstract: General-purpose multimodal foundation models are increasingly capable of directly controlling robots, yet improving their manipulation capabilities thro

Tutorials

Siam-ALS: An Explainable Siamese Deep Learning Framework for Early ALS Detection Using EEG and Eye-Tracking Signals

arXiv:2610.15351v1 Announce Type: new Abstract: Amyotrophic lateral sclerosis (ALS) diagnosis remains challenging due to heterogeneous symptoms and reliance on clinical assessment, underscoring the ne

tutorialsarxiv-cs-lg

SidewalkBench: Benchmarking Visual Navigation on Urban Sidewalks

arXiv:2606.16953v2 Announce Type: replace Abstract: Urban sidewalk navigation presents significant challenges due to complex structural layouts, dynamic pedestrian behaviors, and long distances. While

Towards Dependable Optical Flow: Benchmarks for Real-World Spatiotemporal Corruptions

arXiv:2411.14865v2 Announce Type: replace-cross Abstract: Optical flow estimation is a fundamental task in dynamic scene understanding and computer vision. While recent deep models achieve impressive

Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark

arXiv:2610.13947v2 Announce Type: replace Abstract: In this paper, we study physically grounded articulated 3D asset generation---moving the goal from reproducing how objects look to capturing how the

Trust Before Autonomy: Rethinking Agentic Remote Sensing for Crisis Response

arXiv:2610.18789v1 Announce Type: new Abstract: Agentic remote sensing is evaluated on how many questions it can answer, whereas crisis response depends on whether its answers can be relied on and how

TwinPrune: Density-Aware Two-Phase Token Pruning for Vision-Language Models

arXiv:2610.17530v1 Announce Type: new Abstract: We propose a unified spatial-density signal to score token importance for both inference phases: bipartite merge for prefill and KV eviction for decode,

researcharxiv-cs-cv

Vision-Predictor-Action: Towards Efficient Embodied AI via Neuro-Symbolic JEPA Predictors

arXiv:2610.15556v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models commonly generate robot actions token by token through Large Language Model (LLM) decoders, causing inference late

Tutorials

We Have Been Interpreting Diffusion Transformer Backbone Behaviors Wrong

arXiv:2610.14517v1 Announce Type: new Abstract: During a network forward call, diffusion backbones naturally produce many intermediate activations. If we evaluate each activation against an identical

tutorialsarxiv-cs-cv

Agents

WorkRover: Scaling Long-Horizon Cowork Agent Training Via Recursive Environment Evolution

arXiv:2610.18067v1 Announce Type: cross Abstract: Scaling interactive environments is important for training long-horizon agents through reinforcement learning. These environments often require furthe

agentsarxiv-cs-lg

XForecast: The KDD 2026 Finance Day Challenge on News-Grounded Financial Forecasting

arXiv:2610.16131v1 Announce Type: new Abstract: Financial forecasting has traditionally relied on numerical time-series (TS) signals, while textual information such as news remains largely underutiliz

Agents

Agentic data science with the Data Agent Kit

Imagine your compliance team notices that payments are taking longer than expected to clear. They suspect fraud, and you’re the data scientist helping figure out which transactions to investigate firs

agentsgoogle-cloud-ai

Applications

Auditing Prompt Injection Defenses Before They Reach Users: What Strong Adversaries Reveal

arXiv:2505.15738v3 Announce Type: replace-cross Abstract: Large language models are increasingly deployed in user-facing products that handle sensitive personal data while interacting with untrusted e

applicationsarxiv-cs-ai

Agents

Beyond the Snowflakes: Disentangling Weather Effects from Confounding Meta-Factors in LiDAR Object Detection

arXiv:2610.13891v1 Announce Type: cross Abstract: Light Detection and Ranging (LiDAR) is critical for autonomous perception, yet its performance is known to degrade in adverse weather. While existing

agentsarxiv-cs-ro

CoGameReg: Cooperative-Game-Based Collaborative Semi-Supervised Regression for Seismic Reservoir Property Prediction

arXiv:2610.12884v1 Announce Type: new Abstract: Accurate estimation of reservoir properties from seismic data remains challenging when well-log labels are sparse but three-dimensional seismic observat