Search: “evaluation”

arXiv:2610.10079v1 Announce Type: new Abstract: World Action Models (WAMs) combine visual dynamics modeling with action generation, but their high inference latency limits responsive robot control. Re

hardwarearxiv-cs-ro

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Reproducible LLM Inference Benchmarking: A Sequential Isolation Protocol for Regression Testing

DGX agent

arXiv:2610.09778v1 Announce Type: cross Abstract: Reproducible benchmarking of Large Language Model (LLM) inference is challenging because repeated measurements can vary with execution and system stat

model-releasesarxiv-cs-lg

8 Oct 2026

Applications

RoboJEPA: Scaling Robotic Latent World Models

arXiv:2610.10515v1 Announce Type: cross Abstract: Latent world models have shown a remarkable ability to predict future states and to plan in the real world. In practice, however, we lack a principled

applicationsarxiv-cs-ro

RoboPilot: Generalizable Dynamic Robotic Manipulation with Dual-thinking Modes

model-releasesarxiv-cs-ro

arXiv:2510.00154v2 Announce Type: replace Abstract: Despite rapid progress in robotics, complex or long-horizon tasks remain a fundamental challenge. Most current approaches follow an open-loop paradi

RoboQuest: Generalist Physical Agents that Search, Inspect and Test

arXiv:2610.10388v1 Announce Type: cross Abstract: Recent advances in multimodal foundation models have made them capable generalist physical agents for a range of manipulation tasks. However, successf

Local Ai

RobotAPO: Adversarial Physics Preference Optimization for Robotic Manipulation Video Generation

arXiv:2610.09454v1 Announce Type: new Abstract: Robotic manipulation videos are increasingly used as visual plans for embodied agents, but optimizing purely for visual plausibility often fails to capt

local-aiarxiv-cs-ro

Route-Verify-Vote: Procedure-Conditioned Self-Consistency for Mixed-Domain Reasoning

model-releasesarxiv-cs-cl

arXiv:2610.08814v1 Announce Type: cross Abstract: Compositional generalization remains challenging when language models must combine familiar reasoning operations in unfamiliar ways. The Scenario-Base

RSIGym: A Flexible Environment for Recursive Self-Improvement

arXiv:2610.10310v1 Announce Type: new Abstract: Recursive self-improvement requires carrying accepted changes into later improvement cycles, while studying agent-proposed changes also requires substan

Same Text, Different Prediction: Serving-Context Nondeterminism in Text Classifiers

arXiv:2610.09111v1 Announce Type: new Abstract: Deterministic inference is essential for reliable and trustworthy machine learning. Prior studies of text generation have shown that changing factors su

researcharxiv-cs-cl

Scaling Legal AI: Benchmarking Mamba and Transformers for Statutory Classification and Case Law Retrieval

arXiv:2509.00141v2 Announce Type: replace-cross Abstract: Statutory corpora and judicial decisions are growing faster than legal professionals can read them, while individual judgments often exceed th

SciExam for ENSO: Can AI Agents Build Climate Models?

arXiv:2610.10513v1 Announce Type: cross Abstract: Language-model agents are increasingly asked to carry out open-ended scientific research, yet their results are usually graded against a known answer,

SEER: Self-Enhancing Chain-of-Thought Compression for Reasoning Models

model-releasesarxiv-cs-cl

arXiv:2509.14093v3 Announce Type: replace-cross Abstract: Chain-of-Thought (CoT) prompting can substantially improve the reasoning ability of large language models (LLMs), but it often comes with high

Semantic-Aware Predictive Mapping for Exploration and Navigation

arXiv:2610.10382v1 Announce Type: new Abstract: Predictive mapping can support robotic exploration and navigation by estimating unseen geometric layouts from partial occupancy observations. However, o

researcharxiv-cs-ro

Seq-Flow: Efficient Probabilistic Forecasting with Self-Rollout Error Control

arXiv:2610.10440v1 Announce Type: new Abstract: Many scientific forecasting tasks require updating a distribution over future trajectories as new observations arrive. Conventional diffusion and flow m

SGF+: Decoupling Gradient Flows for Autoregressive Video Generation

arXiv:2610.10429v1 Announce Type: new Abstract: Autoregressive video generation requires denoising the current frames while writing their key-value representations as context for future predictions. H

safetyarxiv-cs-cv

SkillCycle: Co-Evolving Agent Policies and Skill Banks

arXiv:2610.09430v1 Announce Type: new Abstract: Internalizing external skills changes a language agent's capabilities and, with them, the value of its remaining guidance: rules can become redundant, m

safetyarxiv-cs-cv

SoccerNet-FoulRet: Retrieving Semantically Similar Soccer Foul Videos

arXiv:2610.09742v1 Announce Type: new Abstract: Refereeing decisions in professional soccer remain inconsistent because referees cannot easily compare a contentious foul against similar past cases. We

SOTA: Stock Options Trading Agents Guided by Option-Implied Return Distributions

arXiv:2610.10407v1 Announce Type: cross Abstract: As option markets grow and AI advances, agentic systems for option trading are gaining increasing attention. Language-model-based agents can reason ov

safetyarxiv-cs-lg

Tutorials

Spatial Latent Reasoning for Embodied Reference Understanding

arXiv:2610.09418v1 Announce Type: new Abstract: Pointing-gesture visual grounding requires connecting hand geometry with the visual identity and extent of a referred object. A central challenge for co

tutorialsarxiv-cs-cv

Agents

SPIN: Shadow Predictive Indexer for Sparse Attention

arXiv:2610.09025v1 Announce Type: new Abstract: Indexer-based sparse attention reduces the cost of core attention by passing only a fixed, small number of important tokens to it. However, the indexer

agentsarxiv-cs-lg

Agents

SPLATIFY: Reproduce, Discover, Innovate! From Papers and Ideas to Trainable 3DGS Code

arXiv:2610.09116v1 Announce Type: new Abstract: The rapid growth of 3D Gaussian Splatting (3DGS) research demands significant effort to reimplement papers before building on them. We introduce SPLATIF

agentsarxiv-cs-cv

Steerspeech: Activation Steering For Emotion Control In Generated Speech

arXiv:2610.10415v1 Announce Type: cross Abstract: Pretrained text-to-speech (TTS) models can generate expressive speech, but reliable inference-time emotion control remains challenging: prompts and re

STORK: Spatio-Temporal Observation of uterine contRactions via neural networKs

arXiv:2610.09598v1 Announce Type: new Abstract: Uterine contractions in fetal MRI are typically identified manually and discarded, limiting insights into contraction dynamics. We formalize Uterine Con

STRIDE: Spatial-Temporal Representation for Interval-conditioned Disease Evolution in Longitudinal Glioblastoma MRI

arXiv:2610.08848v1 Announce Type: cross Abstract: Glioblastoma (GBM), an aggressive primary brain tumor, is routinely monitored with longitudinal MRI after treatment. Distinguishing stable disease (SD

Targeted Modality Dropout for Real-Robot Manipulation Robust to Intermittent Vision Loss

arXiv:2610.09566v1 Announce Type: new Abstract: Imitation learning policies that integrate multiple sensory modalities are prone to overreliance on a dominant modality, such as vision, during training

safetyarxiv-cs-ro

The Best Optimizer Depends on Batch Size

arXiv:2610.08975v1 Announce Type: new Abstract: A plethora of new adaptive optimizers are designed to efficiently estimate and use minibatch gradient statistics to shape parameter updates, but they ar

Agents

The Confidence Game: Strategic Miscalibration in Human-AI Delegation

arXiv:2610.09371v1 Announce Type: cross Abstract: Calibrated uncertainty quantification is essential to ensuring AI agents are trustworthy and reliable. However, when agents seek to maximize user enga

agentsarxiv-cs-cl

The Symbol of the Surrogate: Measuring Numerical Provenance in Neural PDE Solvers

arXiv:2610.09255v1 Announce Type: new Abstract: Neural PDE surrogates are trained on numerical solver outputs that contain both physical evolution and solver-specific discretization errors. Because su

safetyarxiv-cs-lg

TIRA: Tumor Immune Representation Adaptation for Zero-Shot Cross-Cancer MSI and TMB Prediction

arXiv:2610.09441v1 Announce Type: new Abstract: Microsatellite instability-high (MSI-H) and high tumor mutational burden (TMB-H) are clinically relevant biomarkers, yet their histopathological predict

TiTok: Audio-Visual LLM for Multi-Segment Temporal Grounding

arXiv:2610.09408v1 Announce Type: new Abstract: Audio-visual multi-segment grounding (AV-MSG) in untrimmed videos, reasoning over audio-visual evidence and predicting multiple segments for a query, is

safetyarxiv-cs-cv

TMT: Runtime Backdoor Detection for Vision-Language-Action Policies on Unseen Tasks

arXiv:2610.09462v1 Announce Type: new Abstract: Backdoored vision-language-action (VLA) policies can preserve benign task performance while producing malicious actions when a trigger appears. Detectin

safetyarxiv-cs-ro

Towards Calibrated Probabilistic Forecasts for Events of Interest via Outcome-Conditional Recalibration

arXiv:2610.10076v1 Announce Type: cross Abstract: Calibration is an essential requirement for probabilistic predictions to be useful for decision making. While state-of-the-art prediction methods ofte

Tracing Inputs, Verifying Outputs: Validating Attribution in Music Generation

arXiv:2610.09637v1 Announce Type: cross Abstract: How can we verify whose music contributed to an AI-generated output? This paper demonstrates how input-based attribution can provide verifiable eviden

Training with Missed Targets in Generative Recommendation: Separating Supervision from Probability Competition

arXiv:2610.10124v1 Announce Type: cross Abstract: Generative recommenders return a limited candidate set and may omit observed targets before reranking. A training strategy appends these missed target

Transferability and operational reliability of a Prithvi crop classification foundation model under phenological and geographic shift across three continents

arXiv:2610.08810v1 Announce Type: new Abstract: Fine-tuned geospatial foundation models (GeoFMs) pretrained on large satellite archives have been shown to improve crop classification accuracy and geog

Tri-Prompting: Video Diffusion with Unified Control over Scene, Subject, and Motion

arXiv:2603.15614v2 Announce Type: replace Abstract: Recent video diffusion models achieve strong visual quality and temporal coherence, but still lack coordinated control over scene layout, customized

Twist Flow for Inverse Problems

arXiv:2610.09281v1 Announce Type: new Abstract: In Bayesian inverse problems, posterior sampling requires generating samples that are consistent with given observations while capturing the range of pl

U-Space: Uncovering When and Why Uncertainty Arises in Language Models

arXiv:2610.09087v1 Announce Type: new Abstract: Large language models are informing decisions with ever-higher stakes. As the consequences of their errors grow, a central question becomes harder to ig

researcharxiv-cs-cl

Understanding and Mitigating Token-Pruning-Induced Vulnerabilities in VLMs

arXiv:2610.09703v1 Announce Type: cross Abstract: Token-Pruning accelerates Vision-Language Models by removing redundant visual tokens, yet its safety implications remain underexplored. In this work,

safetyarxiv-cs-lg

UniCSI Towards a Universal Wi-Fi CSI Encoder for Ubiquitous Human Sensing

arXiv:2610.09559v1 Announce Type: new Abstract: Wi-Fi sensing promises to turn the everyday wireless signals that already surround us into ubiquitous sensors for human sensing. However, a fundamental

Applications

Vectorizing the Trie: Efficient Constrained Decoding for LLM-based Generative Retrieval on Accelerators

arXiv:2602.22647v3 Announce Type: replace-cross Abstract: Generative retrieval has emerged as a powerful paradigm for LLM-based recommendation. However, industrial recommender systems often benefit fr

applicationsarxiv-cs-cl

Video Prediction Policy 2: Predict Better, Act Better

arXiv:2610.10270v1 Announce Type: new Abstract: World action models (WAMs) have emerged as an important class of generalist robot policies, aiming to transfer video prediction priors to action learnin

VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation

arXiv:2610.10197v1 Announce Type: new Abstract: Accurate contact modeling is fundamental to understanding hand-object interaction, yet existing contact representations are typically restricted to obje

When Rank Rises as LLMs Degrade

arXiv:2610.09647v1 Announce Type: cross Abstract: Post-training adapts language models in non-stationary environments. Practitioners monitor representation health with RankMe and related spectral stat

researcharxiv-cs-cl

When to Unpair: Regulating Pairing Dependence in Medical Visual In-Context Learning

arXiv:2610.10335v1 Announce Type: new Abstract: Visual in-context learning (ICL), well suited to label-scarce medical imaging, uses support image-label pairs to demonstrate input-output mappings, whil

Hardware

YANchor-4B: Effective Long-Horizon Reasoning in O(N) Time with O(1) Memory

arXiv:2610.10118v1 Announce Type: cross Abstract: Long-horizon reasoning demands access to earlier information at a manageable generation cost. Full-history attention incurs growing storage and comput

hardwarearxiv-cs-cl

Local Ai

YUBI-STAG: Contact and Semantic-Rich Alignment for VLAs via Automated Video-Language Grounding

arXiv:2610.09718v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models acquire broad manipulation capabilities via large-scale pretraining, yet eliciting them through language requires

local-aiarxiv-cs-cv

Zero-Shot Brain MRI Inpainting with 2.5D Unconditional Flow Priors

arXiv:2610.08983v1 Announce Type: new Abstract: Generative inpainting of brain MRI volumes is essential for synthesizing healthy tissue in pathological regions, improving the accuracy and reliability