Search: “evaluation”

Reliability-Aware Multimodal Sentiment Prediction Under Local Modality Missingness

arXiv:2610.20543v1 Announce Type: new Abstract: Multimodal sentiment models are usually evaluated on complete utterances, yet streams often lose a contiguous span of text, audio, or video. We study lo

local-aiarxiv-cs-cv

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Reliable Text-to-SQL in Resource-Constrained Settings with Small LLMs via Iterative Retry Workflows

DGX agent

arXiv:2610.17305v1 Announce Type: new Abstract: Large Language Models (LLMs) have recently improved Text-to-SQL generation, but their computational cost can hinder deployment in resource-constrained s

model-releasesarxiv-cs-ai

15 Oct 2026

Risk-Controlled DFT Selection for Machine-Learned Interatomic Potentials

arXiv:2610.19630v1 Announce Type: cross Abstract: Automated materials discovery requires evaluating large pools of candidate configurations, with density functional theory (DFT) as a major throughput

Same Attack, Different Judge: A First Controlled Adversarial Comparison of Jev, LLM Judges, and Purpose-Built Safety Classifiers

arXiv:2610.17820v1 Announce Type: cross Abstract: TypeSafe AI's Jev is a new kind of safety judge. It generates no text and no label: it answers questions the developer defines in advance and returns

ScholarQuest: A Taxonomy-Guided Benchmark for Agentic Academic Paper Search in Open Literature Environments

arXiv:2606.20235v2 Announce Type: replace-cross Abstract: Academic paper search is a core step in scientific research, and LLM-based search agents are emerging as a promising paradigm for iterative, i

SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generation with LLMs

arXiv:2508.08742v3 Announce Type: replace-cross Abstract: Scientific literature question answering is a pivotal step towards new scientific discoveries. Recently, extit{two-stage} retrieval-augmented

SkillHorizon: Constructing Long-Horizon Agent Tasks through Skill Composition

arXiv:2610.14966v1 Announce Type: new Abstract: Long-horizon agents must complete workflows in which later activities depend on earlier outputs and changes to shared state. A key challenge for evaluat

SnapFlow: One-Step Action Generation for Flow-Matching VLAs via Progressive Self-Distillation

arXiv:2604.05656v2 Announce Type: replace Abstract: Vision-language-action (VLA) models with flow-matching action heads, such as {pi}0 and {pi}0.5, have become a standard recipe for generalist robot m

local-aiarxiv-cs-cv

Tutorials

Spectral structure learning for clinical time series

arXiv:2502.11680v2 Announce Type: replace Abstract: We develop and evaluate a structure learning algorithm for clinical time series. Clinical time series are multivariate time series observed in multi

tutorialsarxiv-cs-lg

Structure-Preserving Document-Level Data Augmentation via Discourse Parsing

arXiv:2610.19497v1 Announce Type: new Abstract: Data augmentation (DA) plays a vital role in improving model performance in low-resource or limited-supervision scenarios within Natural Language Proces

researcharxiv-cs-cl

ThreadBench: Benchmarking Realism in Agentic Simulation of Real-world Discussions

arXiv:2606.14715v2 Announce Type: replace-cross Abstract: LLM agents are increasingly used to simulate real-world interactions, but it remains unclear whether simulated behaviors preserve the content

Unconstrained CTI-REALM with Open-Weights

arXiv:2610.14180v1 Announce Type: new Abstract: Organisations that want language-model agents for security work face a choice between open-weight models, which they can run and audit themselves, and f

What We Talk About When We Talk About LLM Planning: Evidence for Two Distinct Planning Abilities

arXiv:2607.11197v2 Announce Type: replace Abstract: When LLMs exhibit uneven performance across planning tasks, these gaps are often attributed to task difficulty. We argue that this explanation is in

local-aiarxiv-cs-ai

When Agents Commit Too Soon: Diagnosing Premature Commitment in LLM Agents

arXiv:2606.22936v2 Announce Type: replace Abstract: Tool-using LLM agents make early choices about what to search for, which evidence to trust, and what to do next. A wrong early choice can steer ever

When Pleasing the User Compromises Care: AI Sycophancy in Caregiver-Mediated Healthcare

arXiv:2610.14360v1 Announce Type: new Abstract: Large language model (LLM) alignment often assumes that the user interacting with a model is also the primary beneficiary of its behavior. Yet in many c

Words to World: Benchmarking LLMs in Interactive Physical Environments

arXiv:2610.15228v1 Announce Type: new Abstract: Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that aff

Safety

A Few More Tokens Ahead: Reinforcing Parallelism in Diffusion LLMs

arXiv:2610.18200v1 Announce Type: new Abstract: Parallel generation is widely regarded as an inherent advantage of diffusion large language models. Yet our fixed-quota evaluation of four representativ

safetyarxiv-cs-lg

Benchmarking Interaction-Oriented Aerial Mobility across Heterogeneous Environments

model-releasesarxiv-cs-ro

arXiv:2610.18381v1 Announce Type: new Abstract: Aerial mobile manipulation requires unmanned aerial vehicles (UAVs) to traverse heterogeneous environments such as indoor and outdoor domains, and conne

Benchmarking Self-Supervised 3D Medical Vision Foundation Models and Transferability Estimation

arXiv:2610.17573v1 Announce Type: new Abstract: Self-supervised pretraining has expanded the pool of 3D medical foundation models, but published evaluations use different datasets, endpoints and fine-

Calibrated alpha-Barycenters for Multiobjective f-Divergence Optimization

arXiv:2610.16819v1 Announce Type: cross Abstract: Matching one distribution to many targets can require repeated evaluations of every target. CAL-alpha-MODM aggregates a nonlinear predictor into one b

Certified Robustness via Sparse Second-Order Cone Relaxations

arXiv:2610.16016v1 Announce Type: new Abstract: Certified robustness is critical for deploying neural networks in safety-sensitive settings, but computing exact certificates typically requires solving

ChronoScribe: Semantic-Numerical Specialization for Instruction-Driven Time Series Forecasting

arXiv:2610.16345v1 Announce Type: cross Abstract: Recent advances in instruction-driven time series forecasting highlight a fundamental tension: systems must simultaneously master natural-language ins

CoCA: Criterion-Aware Credit Assignment for Rubric-Based Reinforcement Learning

arXiv:2610.17733v1 Announce Type: new Abstract: Rubric-based reinforcement learning (RL) evaluates responses against explicit criteria to construct rewards, offering a viable way to train large langua

Decoupling Knowledge Forgetting and Refusal Learning in MLLM Unlearning

arXiv:2610.14605v1 Announce Type: cross Abstract: Current evaluations of multimodal unlearning typically focus on whether a model stops outputting target information. This surface-level criterion, how

DiffGA: Steering Frozen Diffusion Models for Materials Design via Evolutionary Search

arXiv:2610.14999v1 Announce Type: cross Abstract: Steering candidate generation toward user-defined objectives is central to inverse materials design, yet remains difficult when objectives are black-b

DTA-GT: Direction- and Topology-Aware Graph Transformer for Neural Network Representation Learning

arXiv:2610.16822v1 Announce Type: new Abstract: Architecture attribute predictors reduce the cost of neural architecture search by estimating accuracy or latency from a small set of evaluated candidat

Evidence-First Agentic Verification

arXiv:2610.17724v1 Announce Type: cross Abstract: Long-horizon, semi-verifiable agentic tasks often rely on rubric-based evaluation, but the evidence needed to assess these tasks can be spread across

ExeWorldBench: Benchmarking Code-Based Executable 3D World Modeling

arXiv:2610.15166v1 Announce Type: new Abstract: Coding agents are increasingly evolving beyond reproducing what a world looks like toward constructing executable worlds that capture how a world works.

Genesis: Visual Augmentation Primitives for Multimodal Chain-of-Thought Reasoning

arXiv:2610.15565v1 Announce Type: new Abstract: Recent multimodal large language models achieve promising results on visual reasoning tasks, approaching human-level performance on existing STEM benchm

Geometric Parrots: Rule Absence vs. Rule Fragility in Spatial and Physical Reasoning for Vision-Language Models

arXiv:2610.16170v1 Announce Type: new Abstract: Vision-language models (VLMs) can answer many geometric and physical reasoning questions correctly, yet still behave inconsistently in interaction, for

GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learning

arXiv:2610.17845v1 Announce Type: new Abstract: Functional near-infrared spectroscopy (fNIRS) provides portable and spatially localized measurements of cortical hemodynamics, but differences in channe

local-aiarxiv-cs-lg

HALLMARK: How to Diagnose LLM Citation Verifiers and When to Deploy Them

arXiv:2607.18360v2 Announce Type: replace-cross Abstract: GPTZero found 53 NeurIPS 2025 accepted papers with hallucinated citations, and venues now screen submissions with automated reference checkers

HybridDualPathNet: Cross-Fusion Attention of EfficientNetV2 and Swin Transformer for Brain MRI Classification of Alzheimer's and Parkinson's Disease

arXiv:2610.17251v1 Announce Type: new Abstract: Separating Alzheimer's Disease (AD), Parkinson's Disease (PD), and Healthy Controls (HC) using structural MRI remains challenging because disease signat

local-aiarxiv-cs-cv

I2O2I-Nav: A Benchmark with a Modular Agent for Long-Horizon Indoor-to-Outdoor-to-Indoor Navigation

model-releasesarxiv-cs-ro

arXiv:2610.18307v1 Announce Type: new Abstract: Service and delivery robots often need to complete long-horizon navigation missions spanning indoor and outdoor environments. Existing embodied navigati

Safety

Inference on the Value of Policy Improvement in Adaptive Experiments

arXiv:2610.15789v1 Announce Type: cross Abstract: In this paper, we develop an asymptotically normal estimator for the value of policy improvement (VPI) under adaptively collected data. This value, wh

safetyarxiv-cs-lg

InfoVis: Unified Slide Image Generation and Editing

arXiv:2610.16784v1 Announce Type: new Abstract: Generating and editing presentation slides requires models to combine accurate text rendering, instruction following, visual grounding, aesthetic design

IsoVRBench: Video Reward Modeling Without Human Feedback

arXiv:2610.17234v1 Announce Type: cross Abstract: Video reward models are trained and evaluated on human preferences between videos that often differ simultaneously on properties such as prompt alignm

Applications

LensErase: A Foundation Model for Erase Anything

arXiv:2610.18072v1 Announce Type: new Abstract: We introduce LensErase, a general-purpose mask-based Erase Anything foundation model designed to cover a broad spectrum of real-world erase scenarios. L

applicationsarxiv-cs-cv

LynxScenes: A Large-Scale Real-World Benchmark for Outdoor Wheel-Legged Robot Perception, Navigation, Imagination and Reconstruction

model-releasesarxiv-cs-ro

arXiv:2610.18093v1 Announce Type: new Abstract: Wheel-legged robots operating in outdoor spaces shared with humans require accurate perception, socially compliant navigation, future-scene reasoning, a

Tutorials

Manifold Navigation Learning Using Recurrent Networks: Efficient Training Techniques

arXiv:2610.14325v1 Announce Type: new Abstract: Position tracking is a well-studied problem in Euclidean navigation, yet comparatively little attention has been given to navigation on general manifold

tutorialsarxiv-cs-cv

MiMaAlign: Hierarchical Micro-Macro Alignment for Physically Plausible Video Generation

arXiv:2610.16482v1 Announce Type: new Abstract: Text-to-video (T2V) diffusion models have made remarkable progress in generating high-fidelity visuals, yet their outputs still often exhibit physically

Safety

NetRL: Powering Network Decisions via NetGRPO-Driven Reinforcement Learning

arXiv:2610.16226v1 Announce Type: cross Abstract: Network decision-making tasks, including adaptive bitrate streaming, load balancing, and congestion control, require policies to process heterogeneous

safetyarxiv-cs-lg

One-Way Coupling via Patchwise Adaptive Normalization in Transformer Surrogates

arXiv:2610.14687v1 Announce Type: new Abstract: Many physical systems exhibit one-way coupling: exogenous fields such as medium density or obstacle geometry influence the dynamics without being affect

Physics-guided machine learning for saturation control across variable hydraulic conditions in heap leaching

arXiv:2610.15947v1 Announce Type: cross Abstract: Heap-leaching hydraulics vary between regions of an ore bed, motivating fast prediction models that accommodate different material properties. This st

Pick the Mixture, Not the Samples: Combinatorial Data Selection for LLMs

arXiv:2610.14028v1 Announce Type: new Abstract: Data selection for LLM fine-tuning faces two facts about real training: data pools draw from many distinct domains, and evaluation spans diverse tasks.

Plan-Bench: Can Existing VLMs Go Well Beyond Perception to Reason and Plan in Embodied Worlds?

arXiv:2610.18836v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have achieved strong performance in visual perception and spatial reasoning, leading to growing interest in using them as

Applications

Proactive Physical AI through Continuous Observation and Timely Intervention

arXiv:2610.16967v1 Announce Type: new Abstract: Physical AI is commonly formulated around an explicitly specified task: given a goal or instruction, a system perceives, reasons, and acts. In many real

applicationsarxiv-cs-cv

PVFH-Bench: Benchmarking Premise-Induced Visual Fixation Hallucinations in Vision-Language Models

arXiv:2610.14635v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) have achieved remarkable progress across a wide range of multimodal tasks. However, object hallucination remains