Search: “evaluation”

Beyond the Good, the Bad, and the Ugly: Colormap Assessment through Data-Aware Perceptual Metric

arXiv:2610.03720v1 Announce Type: cross Abstract: Continuous colormaps are widely used to visualize scalar fields, and their quality is typically evaluated using measures such as discriminative power

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

CASE: Cost-Aware Stopping for Efficient Long-Video Agents

DGX agent

arXiv:2610.05400v1 Announce Type: cross Abstract: Long-video agents can actively gather question-relevant evidence, but they typically leave a central decision implicit: when has the agent seen enough

model-releasesarxiv-cs-cv

6 Oct 2026

CHAOSMINING: Benchmarking Post-Hoc Attribution with Sparse Informative Features in High Dimensions

arXiv:2406.12150v2 Announce Type: replace Abstract: Post-hoc attribution is widely used to identify important model inputs, but evaluating whether these attributions identify truly informative feature

Agents

COMIC: Agentic Sketch Comedy Generation

arXiv:2603.11048v2 Announce Type: replace Abstract: We propose a fully automated AI system that produces short comedic videos similar to sketch shows such as Saturday Night Live. Starting from charact

agentsarxiv-cs-cv

Demonstration-Calibrated Port-Hamiltonian Retuning for Manipulation Policies

arXiv:2610.05755v1 Announce Type: new Abstract: Diffusion and VLA policies for manipulation are often deployed through downstream impedance controllers. The stiffness and damping gains of these contro

safetyarxiv-cs-ro

Dual Variational Autoencoders for Efficient Sim-to-Real Transfer in Low-Cost Robotic Navigation

arXiv:2610.06327v1 Announce Type: cross Abstract: Vision-based autonomous navigation for low-cost robots remains a fundamental challenge, primarily due to the significant gap between simulated trainin

safetyarxiv-cs-cv

EMBER-Bench: Benchmarking Cross-Event Causal Memory in Long-Horizon Embodied Tasks

arXiv:2610.05013v1 Announce Type: new Abstract: Lifelong physical agents must reason over extended interactions where past events continue to shape the world long after they disappear from view. Beyon

EMG-FM-Bench: A Comprehensive Benchmark for Foundation Model Transfer and Adaptation on Electromyography

arXiv:2610.06450v1 Announce Type: new Abstract: Foundation models (FMs) are increasingly being developed for general time series and physiological signals, yet their transferability to downstream phys

Flash-OPD: Fast On-Policy Distillation

arXiv:2610.06105v1 Announce Type: new Abstract: On-policy distillation (OPD) provides dense teacher supervision on student-generated trajectories, but generating and evaluating long rollouts incurs su

Flip-Flop Consistency: Unsupervised Training for Robustness to Prompt Perturbations in LLMs

arXiv:2510.14242v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) often produce inconsistent answers when faced with different phrasings of the same prompt. In this paper, we prop

From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Models

arXiv:2610.04139v1 Announce Type: new Abstract: Predicting future spatial states supports collision avoidance and timely decision-making in dynamic environments. However, existing vision-language mode

Grounded in Time: A Multi-Source Dataset and Benchmark for Temporal Grounding in Robotic Manipulation

arXiv:2610.04255v1 Announce Type: cross Abstract: Robotic manipulation often requires inferring task-relevant states from past interactions when the current observation alone is insufficient to determ

Improving Proactive AI Assistance with Hierarchical Procedural Understanding

arXiv:2610.06505v1 Announce Type: cross Abstract: Proactive AI assistants continuously observe a user's activity and decide whether to provide new guidance or remain silent. They should provide approp

Incentive Alignment in Online Experimentation

arXiv:2610.05922v1 Announce Type: cross Abstract: Evaluating the causal effect of new features is a central goal for online platforms. While recent literature addresses limited testing traffic via cen

Logic-Logit: A Logic-Based Approach to Choice Modeling

arXiv:2610.05501v1 Announce Type: new Abstract: In this study, we propose a novel rule-based interpretable choice model, Logic-Logit, designed to effectively learn and explain human choices. Choice mo

MedImageOSWorld: Benchmarking GUI Agents for Medical Image Consoles

arXiv:2610.04800v1 Announce Type: cross Abstract: Graphical consoles offer a practical interface for medical acquisition assistance, allowing agents to work through the controls and visual feedback us

ML-OPF-Bench: Benchmarking Machine Learning for Optimal Power Flow

arXiv:2610.04307v1 Announce Type: cross Abstract: Machine Learning (ML) methods promise a fast solution process for Optimal Power Flow (OPF). While inconsistent test cases, implementations, and evalua

MOXIE: Discovering Alternative Explanations for Biomedical Image Classifiers

arXiv:2610.04814v1 Announce Type: new Abstract: Segment-based explanation methods such as LIME return a single explanation for each prediction, computed from one fixed image segmentation. This hides t

MTRACE: Multilingual Retrieval-Augmented Generation for Temporally Diverse Text Corpora

arXiv:2512.12694v2 Announce Type: replace-cross Abstract: Large multilingual knowledge bases expose temporally diverse information, yet retrieval quality remains sensitive to lexical variation and cro

Non-invasive Seizure Detection Using Wearable Wrist-worn Accelerometry and Deep Learning

arXiv:2610.05919v1 Announce Type: new Abstract: Seizure monitoring and detection are crucial for reducing the morbidity and mortality associated with seizures. Current epilepsy care, often involving e

researcharxiv-cs-lg

OccStress: Stress-Testing the 4D Occupancy Forecasting Chain

arXiv:2512.15621v2 Announce Type: replace Abstract: Occupancy world models use historical occupancy states to forecast future 3D scenes, but their robustness under corrupted temporal inputs remains po

On Impact of Loss Function on the Performance of Neural Networks in Melanoma Diagnosis

arXiv:2610.06139v1 Announce Type: cross Abstract: Melanoma is the deadliest type of skin cancer, whose early diagnosis is crucial for patients' survival. Image classification using deep learning model

Local Ai

OncoNoteBERT: A Foundation Representation Model for Natural Language Processing of Real-World Outpatient Oncology Notes

arXiv:2610.03829v1 Announce Type: cross Abstract: Real-world outpatient oncology notes contain specialised terminology, tumour staging expressions, treatment names, toxicity descriptions, and institut

local-aiarxiv-cs-lg

One-Step Curvature Probes Miss the Fitting Operator: Retained Capacity and Terminal Null-Space Correction for Continual Learning

arXiv:2610.03952v1 Announce Type: new Abstract: A one-step curvature probe evaluates an initial direction, whereas continual learners are judged after reaching comparable new-task fit. In an overparam

researcharxiv-cs-lg

Ramp Metering Control via Hybrid State Deep Reinforcement Learning in Partially Observable Connected Vehicle Environments

arXiv:2610.06266v1 Announce Type: new Abstract: Freeway on-ramp merges are major sources of congestion, causing significant economic and environmental costs. While Deep Reinforcement Learning (DRL) of

Hardware

RESOLVE: Language-Agnostic Validation of GPU Kernels Through Testing, Reduction, and Proof

arXiv:2610.05683v1 Announce Type: cross Abstract: AI systems can now write and optimize production GPU kernels, but validating them remains an important challenge. Evaluating the kernel on a few rando

hardwarearxiv-cs-lg

Separating Decision Time from Decision Quality in the Real-Time Gap of Distilled Deciders: Evidence from a Game and a Conveyor Simulator

arXiv:2610.04810v1 Announce Type: new Abstract: Real-time agents are often evaluated with the world paused, or with decision time rounded to whole ticks (tick conversion). Tick conversion predicts alm

researcharxiv-cs-lg

SkillScriptBench: Benchmarking Self-Evolution of Executable Agent Skill Packages Beyond Markdown

arXiv:2610.04008v1 Announce Type: cross Abstract: Executable Agent Skills combine natural-language instructions and scripts into reusable packages for LLM agents, and revising them requires fixing err

SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving

arXiv:2603.07865v2 Announce Type: replace-cross Abstract: Text-to-audio (T2A) diffusion models generate high-quality audio but require tens of neural function evaluations (NFEs), resulting in substant

Spatial Supervision Without Attribution Optimization: Improving Post-Hoc Class Activation Maps via Box-Guided Evidence Routing

arXiv:2610.05891v1 Announce Type: new Abstract: Post-hoc class activation maps (CAMs) are a standard tool for inspecting the evidence behind an image classifier's predictions, yet nothing in ordinary

Applications

Technical Report on the Turba Fertilizer Machine Learning Stack in Morocco

arXiv:2610.05949v1 Announce Type: new Abstract: Site-specific fertilizer recommendation systems adapt nutrient advice to location, soil properties, crop type, and production targets, but scientific re

applicationsarxiv-cs-lg

Applications

Usefulness of Quantile-Aware Diffusion Modeling for Highly Imbalanced Tabular Data

arXiv:2610.05825v1 Announce Type: new Abstract: Classification problem in the context of highly imbalanced data is a major challenge in many real-world applications (e.g., FinTech, healthcare, etc.).

applicationsarxiv-cs-lg

When Does Longer Reasoning Help? Predicting Mathematical Reasoning Through Discovery and Execution

arXiv:2610.05322v1 Announce Type: new Abstract: Test-time compute can improve mathematical reasoning, but can short-budget runs predict how mathematical reasoning scales with additional compute? We in

A Multi Method Importance and Performance Efficiency Analysis of Topological Metrics for Natural Visibility Graph Based Cyber Attack Detection

arXiv:2610.02342v1 Announce Type: new Abstract: Natural Visibility Graph (NVG) based analysis characterizes network traffic through topological descriptors reflecting different structural properties.

researcharxiv-cs-ai

AMBER: Multi-View Adaptive Budget Allocation for Listwise Vision-Language Reranking

arXiv:2610.02831v1 Announce Type: new Abstract: Vision-language models (VLMs) are powerful listwise rerankers for multimodal retrieval, but high inference costs restrict them to evaluating small local

researcharxiv-cs-ai

Agents

ArrivalBench: Agent-Generated Data Pipelines Are Correct Once and Wrong Under Time

arXiv:2610.02363v1 Announce Type: new Abstract: Benchmarks for agent-generated data work grade a pipeline by running it once against a fixed snapshot. ArrivalBench instead re-executes the pipeline an

agentsarxiv-cs-lg

Agents

Autonomous Robotic Navigation for Endovascular Brain-Computer Interface Access

arXiv:2610.03537v1 Announce Type: cross Abstract: Endovascular brain-computer interfaces (BCIs) avoid craniotomy but require precise device delivery through anatomically variable cerebral veins. This

agentsarxiv-cs-lg

Benchmarking Candidate Coverage in Typed Decision Models

arXiv:2610.03387v1 Announce Type: new Abstract: Typed decision models return choices or distributions over answer options supplied at request time. Accuracy with complete options does not establish wh

Beyond Single Videos: Benchmarking and Active Evidence Seeking for E-Commerce Cross-Video Reasoning

arXiv:2610.03099v1 Announce Type: cross Abstract: E-commerce videos are information-dense and frequently compared by consumers evaluating products and merchants assessing marketing strategies. However

CONTRA: Discovering and Qualifying Behavior-Changing Questions for Selective Clarification in LLM Code Generation

arXiv:2610.01769v1 Announce Type: cross Abstract: Coding agents can generate code that appears correct but implements behavior the user never intended. This mismatch can arise when an agent silently r

Dynamic LLM Routers are Often Misguided

arXiv:2610.02762v1 Announce Type: new Abstract: Dynamic LLM routers promise to cut inference costs by sending each query to the cheapest model that can answer it correctly. We analyze six commercial r

Hardware

FlashSinkhorn 2: Block-Sparse Entropic Optimal Transport

arXiv:2610.02395v1 Announce Type: new Abstract: Streaming GPU solvers for entropic optimal transport (EOT), such as FlashSinkhorn, avoid storing the dense kernel but still evaluate all nimes m point p

hardwarearxiv-cs-ai

How Robust Is Multimodal Claim Verification to LLM Rewriting?

arXiv:2610.02841v1 Announce Type: new Abstract: LLMs are known to introduce stylistic changes into generated text, yet how these stylistic shifts affect model decisions on scientific tasks remains und

researcharxiv-cs-cl

HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents

arXiv:2610.03574v1 Announce Type: new Abstract: We introduce HyperBrowseComp, a multilingual and multimodal browsing benchmark comprising 423 manually authored and human-validated questions across 13

Intent-Hiding Jailbreaks: An Information-Theoretic Framework for Compositional Attacks

arXiv:2610.02302v1 Announce Type: cross Abstract: Recent work has shown that large language models (LLMs) can be vulnerable to jailbreak attacks in which harmful intent is obscured through composition

Lexicographic Multi-Objective On-Policy Distillation

arXiv:2610.02359v1 Announce Type: cross Abstract: Reinforcement learning from verifiable rewards (RLVR) usually optimizes answer correctness, yet useful language-model behavior also requires high-qual

safetyarxiv-cs-ai

Hardware

Lightweight and Resource-Efficient Perception for Robotic Guide Dogs

arXiv:2610.03187v1 Announce Type: cross Abstract: Multi-camera streaming perception is increasingly deployed on heterogeneous edge platforms shared with co-resident workloads, yet accelerator placemen

hardwarearxiv-cs-cv

LPS-Bench: Benchmarking Safety Awareness of Computer-Use Agents in Long-Horizon Planning under Benign and Adversarial Scenarios

arXiv:2602.03255v2 Announce Type: replace Abstract: Computer-use agents (CUAs) execute multi-stage tasks through tools, where an early unsafe decision can propagate to consequential actions. Evaluatin