Search: “evaluation”

arXiv:2610.04777v1 Announce Type: new Abstract: Inflammatory bowel disease (IBD) requires frequent imaging-based assessment, yet interpretation of modalities such as wireless capsule endoscopy (WCE) a

agentsarxiv-cs-cv

6 Oct 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Oracle headroom without signal: null-calibrated evaluation of candidate selection for thermal heart rate estimation

DGX agent

arXiv:2610.02561v1 Announce Type: new Abstract: Camera-based physiological monitoring can produce multiple estimates from several facial regions, extraction methods, and processing settings. Signal qu

researcharxiv-cs-cv

5 Oct 2026

Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systems

arXiv:2610.00371v1 Announce Type: cross Abstract: Multi-agent systems derive their capabilities from sharing evidence, delegating tasks, and combining information across agents. The same process creat

safetyarxiv-cs-ai

2 Oct 2026

SimplexUQ: An Evaluation Framework and Benchmark for Conformal Uncertainty on Simplex-Valued Predictions

arXiv:2610.00523v1 Announce Type: new Abstract: Conformal prediction guarantees marginal coverage, but a single calibration threshold can still spread that coverage unevenly, over-covering easy region

2 Oct 2026

Concept-Grounded Attention: A Controlled Evaluation of Graph-Injected Attention, Temporal Versioning, and Epistemic Status

arXiv:2609.38684v1 Announce Type: new Abstract: Knowledge-intensive language-model systems typically represent external knowledge as text chunks or static graphs, with limited support for concept evol

safetyarxiv-cs-ai

1 Oct 2026

DuplexAct-Bench: Broadening Full-Duplex Speech Evaluation toward Proactive Interaction across Diverse Behavioral Requirements

model-releasesarxiv-cs-cl

arXiv:2609.39446v1 Announce Type: new Abstract: Existing full-duplex speech benchmarks cover only subsets of real-time interaction behaviors, often under limited contextual conditions. We introduce Du

1 Oct 2026

Toward Real-Time VLAs: Stage-Aware Two-Step Flow Denoising and System-Level Evaluation

arXiv:2609.39822v1 Announce Type: new Abstract: Vision-language-action (VLA) models face a timing gap between low-rate inference and high-rate robot execution. We characterize this gap through end-to-

researcharxiv-cs-ro

1 Oct 2026

Dating the Model: Hidden Dates in System Prompts Affect LLM Evaluation

arXiv:2609.36931v1 Announce Type: new Abstract: Reproducibility is essential for scientific research, yet prior work shows that LLM outputs vary with hardware and batching. We identify an overlooked f

researcharxiv-cs-cl

30 Sept 2026

Pair Difficulty Matters: Rethinking Pairwise LLM-as-a-Judge Evaluation and Consistency

arXiv:2609.37577v1 Announce Type: new Abstract: Large Language Model judges are widely used to rank texts and text-generating systems through pairwise comparison, and their reliability is typically as

safetyarxiv-cs-cl

30 Sept 2026

Tail-Influence Sampling for CVaR Policy Evaluation

arXiv:2609.38096v1 Announce Type: new Abstract: Policies with similar mean returns can differ sharply in rare failures, yet estimating lower-tail conditional value-at-risk (CVaR) accurately can requir

safetyarxiv-cs-lg

30 Sept 2026

A Visual Classification Dataset and Model Evaluation for Historical Manuscript Illustrations

arXiv:2609.33449v1 Announce Type: new Abstract: Historical manuscript illustrations preserve rich visual evidence of past cultures. They depict people, animals, plants, diagrams, music notations, and

researcharxiv-cs-cv

AgentPerfBench: A Benchmarking and Evaluation Suite for Inference Performance of Agentic LLMs

arXiv:2609.34683v1 Announce Type: new Abstract: The optimization of LLM serving engines, such as vLLM and SGLang, is largely benchmark-driven: optimizations, scheduling policies, hardware and system d

Does Vision-Language Pretraining Granularity Matter? A Controlled Evaluation of Vision-Language Objectives Across Chest X-Ray Interpretation Tasks

arXiv:2609.31985v1 Announce Type: new Abstract: Vision-language pretraining objectives differ in the spatial granularity of their supervision, yet the implications of this distribution for chest X-ray

researcharxiv-cs-cv

Jev in Medicine: A Benchmark Evaluation. Preliminary Results

arXiv:2609.34024v1 Announce Type: cross Abstract: Jev is a non-generative 'System One' model that assigns probabilities to predefined answer options and cannot answer outside them. Its accuracy and ca

Predicting Delayed Train Trajectories on the Dutch Railway Network: Explainable AI Evaluation of Topological, Operational and Weather Features with Tree Based Ensemble Methods

arXiv:2609.34692v1 Announce Type: new Abstract: The reliable prediction of passenger train delays is a critical component of railway management. While contemporary research frequently attempts to maxi

RAISE: Reinforcing Access Control Policy Synthesis in LLMs via Symbolic Evaluation

arXiv:2609.33796v1 Announce Type: cross Abstract: Translating natural-language access-control requirements into policies requires careful reasoning about permissions, constraints, and exceptions, and

Rethinking Circuit Evaluation: Do Circuits Explain Model Errors?

arXiv:2609.35686v1 Announce Type: new Abstract: Mechanistic interpretability (MI) aims to explain a model's behaviour through analyzing its internal computations; circuit-based explanations aim to iso

Design and Evaluation of LLM Chaining-Based Task Planning for General Purpose Service Robots

arXiv:2609.29043v1 Announce Type: cross Abstract: General Purpose Service Robot (GPSR) tasks, as defined in the RoboCup@Home benchmark, require robots to interpret diverse natural language commands an

25 Sept 2026

HiPACE: Hierarchical Phase-Boundary Analysis and Controlled Evaluation of Feature Absorption in Sparse Autoencoders

arXiv:2609.29551v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) decompose LLM activations into sparse dictionary atoms, so that each distinct concept gets its own feature. One recurring beh

25 Sept 2026

Local Ai

Leakage-Safe Machine Learning for Hydrogen Embrittlement Detection in 316L Stainless Steel: A Region-Held-Out Evaluation of Texture and Deep Features in SEM Micrographs

arXiv:2609.28567v1 Announce Type: new Abstract: Scanning electron microscopy (SEM) is routinely used to characterize the microstructural changes caused by hydrogen embrittlement (HE) in structural ste

local-aiarxiv-cs-lg

25 Sept 2026

A Leakage-Aware Multimodal Evaluation Framework for Early Intraoperative Acute Kidney Injury Prediction

arXiv:2609.26848v1 Announce Type: cross Abstract: Postoperative acute kidney injury (AKI) after major non-cardiac surgery carries substantial morbidity, yet early intraoperative risk stratification re

24 Sept 2026

Brain-to-Language Decoding: Tasks, Signals, Methods, Evaluation, Practical Use and Beyond

arXiv:2609.27650v1 Announce Type: new Abstract: Brain-to-language decoding translates neural activity associated with language production, internal speech and perception into linguistic or expressive

applicationsarxiv-cs-cl

24 Sept 2026

Comparative Evaluation of Static Embedding Models for HTTP Request Anomaly Detection

arXiv:2609.26860v1 Announce Type: cross Abstract: Web applications are increasingly targeted by cyberattacks that exploit HTTP requests to evade security mechanisms. Traditional web application firewa

24 Sept 2026

Agents

Behavior is Not Enough: A Mechanism-Based Evaluation of Social Norm Emergence in LLM Societies

arXiv:2609.26481v1 Announce Type: cross Abstract: Social norms cannot be identified from behavior alone: the same cooperative equilibrium may reflect shared expectations, strategic incentives, or simp

agentsarxiv-cs-cl

23 Sept 2026

Calibration as a First-Class Criterion in LLM Evaluation

arXiv:2609.26489v1 Announce Type: new Abstract: Calibration of language models -- the alignment between expressed or implicit confidence and empirical correctness -- is a well-studied subfield within

safetyarxiv-cs-cl

23 Sept 2026

Measuring the Serving Stack Instead of the Model: Hidden Confounds in Local Tool-Use Evaluation

model-releasesarxiv-cs-cl

arXiv:2609.26693v1 Announce Type: new Abstract: A coding agent must emit a valid tool call--a parseable invocation of a tool in the provided schema--before the harness can execute its chosen action. W

23 Sept 2026

AskQE: Question Answering as Automatic Evaluation for Machine Translation

model-releasesarxiv-cs-cl

arXiv:2504.11582v3 Announce Type: replace Abstract: How can a monolingual English speaker determine whether an automatic translation in French is good enough to be shared? Existing MT error detection

22 Sept 2026

Experimental Evaluation of a Low-Power Ultra-Wideband Receiver for Spectrum Sensing

arXiv:2609.22134v1 Announce Type: cross Abstract: Walsh-sequence-based receiver architectures offer an alternative approach for the reception and reconstruction of multiple simultaneous RF signals ove

22 Sept 2026

Towards Reliable Underwater Diver-Robot Interaction: Gesture Design, Interaction Logic, and Real-World Evaluation

arXiv:2609.23392v1 Announce Type: new Abstract: Underwater human--robot interaction requires gesture commands that are both easy for divers to use and reliable for robots to recognize. We investigate

applicationsarxiv-cs-ro

22 Sept 2026

CityLearn v3: A Configurable Simulation and Evaluation Framework for Realistic Control Studies of Renewable Energy Communities

arXiv:2609.21570v1 Announce Type: cross Abstract: Renewable energy communities (RECs) coordinate buildings, photovoltaic generation, batteries, electric vehicles and flexible loads. Controller studies

21 Sept 2026

Cross-Lingual Parkinson's Disease Severity Assessment Using Pre-trained Speech Embeddings: A Multi-Class Evaluation

arXiv:2609.20875v1 Announce Type: cross Abstract: Parkinson's disease (PD) often manifests through speech impairments, facilitating accessible, non-invasive, and cost-effective severity assessment for

researcharxiv-cs-cl

21 Sept 2026

Efficient Architecture Search under Leave-One-Subject-Out Evaluation

arXiv:2609.21457v1 Announce Type: new Abstract: Deep neural architectures are widely used for signal processing in automated pain assessment systems. However, architecture design has remained largely

21 Sept 2026

A Neuropsychologically Grounded Evaluation of LLM Cognitive Abilities

arXiv:2603.02540v2 Announce Type: replace Abstract: Large language models (LLMs) display a unified 'general factor' of capability across 10 benchmarks (a finding confirmed by our factor analysis of 15

Behavioral Coherence: A Method for Sensitive-Domain LLM Evaluation

arXiv:2512.13142v5 Announce Type: replace Abstract: People use LLMs for reproductive-health questions, including abortion-related support. A response can sound supportive while answers reinforce harmf

safetyarxiv-cs-ai

Beyond Depth Truncation: Controlled Evaluation of Depth Utilization in Recursive Language Models

arXiv:2609.19934v1 Announce Type: new Abstract: Depth-recurrent language models iteratively apply a small layer stack, decoupling per-token compute from distinct parameter count. To determine whether

Evolution or Illusion? Rethinking Evaluation in LLM Evolutionary Search

arXiv:2609.19799v1 Announce Type: cross Abstract: LLM-driven evolutionary search finds programs by launching seeds and iterating each one. Papers report a single budget setting, usually one seed run f

Local Ai

WoundAIssist: Development and Evaluation of an AI-Based Mobile Application for Remote Chronic Wound Care in Elderly Patients

arXiv:2506.06104v2 Announce Type: replace-cross Abstract: The rising prevalence of chronic wounds, especially in aging populations, presents a significant healthcare challenge due to prolonged hospita

local-aiarxiv-cs-cv

Exponential Hardness of Off-Policy Evaluation under History-Dependent Logging

arXiv:2609.19135v1 Announce Type: new Abstract: Can a logged dataset visit every hidden state frequently and still be exponentially uninformative about a target policy's value? We show that it can whe

safetyarxiv-cs-lg

17 Sept 2026

RAM-H1200: A Unified Evaluation and Dataset on Hand Radiographs for Rheumatoid Arthritis

model-releasesarxiv-cs-cv

arXiv:2605.05616v2 Announce Type: replace Abstract: Rheumatoid arthritis (RA) assessment from hand radiographs requires multi-level analysis and modeling of anatomical structures and fine-grained loca

16 Sept 2026

AlgoRAG: Retrieval-Augmented Generation for Theoretical Computer Science Education -- A Comprehensive Evaluation Framework for Algorithm Analysis and Complexity Theory

arXiv:2609.14572v1 Announce Type: cross Abstract: Teaching abstract theoretical computer science (TCS) concepts such as algorithm analysis and complexity theory is challenging because students must ha

applicationsarxiv-cs-ai

ChatGPT Images 2.5 in the Wild: A Launch-Period Dataset and Detector Evaluation

arXiv:2609.15100v1 Announce Type: cross Abstract: An image tool can change its underlying generator while retaining its public name, making version attribution from online posts ambiguous. We study th

Evaluation of optimisation and Bayesian inference methods for reaction rates in atmospheric chemical mechanisms

arXiv:2609.14569v1 Announce Type: cross Abstract: Constraining reaction rate coefficients is a central challenge in the development of explicit atmospheric chemical mechanisms, particularly for autoxi

Hallucination in Multimodal Foundation Models: A Survey on Causes, Corrections, and Evaluations

arXiv:2410.15359v2 Announce Type: replace Abstract: Multimodal Foundation Models represent a significant leap in artificial intelligence. Among them, Large Vision-Language Models (LVLMs) serve as the

HELENA for 5G NR LEO NTN Channel Estimation: A Comparative Evaluation

arXiv:2609.14735v1 Announce Type: cross Abstract: Deep Learning (DL)-based channel estimation has shown high accuracy and low latency in terrestrial 5G NR, but Low Earth Orbit (LEO) Non-Terrestrial Ne

Scalability and Performance Evaluation of Federated Learning Frameworks: A Comparative Analysis

arXiv:2609.15681v1 Announce Type: cross Abstract: This paper presents a systematic examination and experimental comparison of the prominent Federated Learning (FL) frameworks FedML, Flower, Substra, a

applicationsarxiv-cs-ai

Self-Evolving AI for Humanoids: Mechanisms, Safety, and Evaluation of Post-Deployment Self-Improvement

model-releasesarxiv-cs-ro

arXiv:2609.13236v1 Announce Type: new Abstract: Humanoid robots are becoming an important part of embodied artificial intelligence, driven by advances in reinforcement learning for locomotion, world m

An Automated Thickness Evaluation Procedure Using an Integrated Structured Light 3D Camera in a Robotic Bioprinting Framework

arXiv:2609.12206v1 Announce Type: new Abstract: Bioprinting is emerging as a tissue engineering technique to replace common treatment methods for large scale injuries. While thickness of the BioPrinte

researcharxiv-cs-ro

14 Sept 2026

Local Ai

On-Device Language Models for Privacy-Preserving Stress Prediction: A Multimodal Evaluation on Mobile Health