Search: “evaluation”

Toxicity Detection Should Measure Contextual Harm, Not Text-Intrinsic Badness

arXiv:2503.16072v4 Announce Type: replace-cross Abstract: Toxicity detection has become core safety infrastructure for online moderation, dataset filtering, and deployed language-model systems. Yet mo

safetyarxiv-cs-cl

13 May 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

VNDUQE: Information-Theoretic Novelty Detection using Deep Variational Information Bottleneck

DGX agent

arXiv:2605.11551v1 Announce Type: cross Abstract: Detecting out-of-distribution (OOD) samples is critical for safe deployment of neural networks in safety-critical applications. While maximum softmax

safetyarxiv-cs-cv

13 May 2026

A Cold Diffusion Approach for Percussive Dereverberation

arXiv:2605.10256v1 Announce Type: cross Abstract: Most recent advances in audio dereverberation focus almost exclusively on speech, leaving percussive and drum signals largely unexplored despite their

applicationsarxiv-cs-ai

Achieving Better Local Regret Bound for Online Non-Convex Bilevel Optimization

arXiv:2602.06457v2 Announce Type: replace Abstract: Online bilevel optimization (OBO) has emerged as a powerful framework for many machine learning problems. Prior works have developed several algorit

researcharxiv-cs-lg

AgentRx: A Benchmark Study of LLM Agents for Multimodal Clinical Prediction Tasks

arXiv:2605.10286v1 Announce Type: new Abstract: Building effective clinical decision support systems requires the synthesis of complex heterogeneous multimodal data. Such modalities include temporal e

AI-Care: A Conversational Agentic System for Task Coordination in Alzheimer's Disease Care

arXiv:2605.08480v1 Announce Type: new Abstract: Individuals with Alzheimer's disease (AD) and Alzheimer's disease-related dementia (ADRD) experience memory and thinking changes that impact their abili

AlignDrive: Aligned Lateral-Longitudinal Planning for End-to-End Autonomous Driving

arXiv:2601.01762v2 Announce Type: replace-cross Abstract: Practical autonomous driving requires models that generalize by reasoning through spatial-temporal possibilities to exclude unsafe outcomes. W

AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment

arXiv:2603.26680v2 Announce Type: replace-cross Abstract: As Large Language Models (LLMs) evolve into lifelong AI assistants, LLM personalization has become a critical frontier. However, progress is c

Are vision-language models ready to zero-shot replace supervised classification models in agriculture?

arXiv:2512.15977v3 Announce Type: replace Abstract: Vision-language models (VLMs) are increasingly proposed as general-purpose solutions for visual recognition tasks, yet their reliability for agricul

Auto-Rubric as Reward: From Implicit Preferences to Explicit Multimodal Generative Criteria

arXiv:2605.08354v1 Announce Type: new Abstract: Aligning multimodal generative models with human preferences demands reward signals that respect the compositional, multi-dimensional structure of human

Autonomous FAIR Digital Objects: From Passive Assertions to Active Knowledge

arXiv:2605.10370v1 Announce Type: new Abstract: Scientific knowledge on the Web is published as passive assertions and cannot decide when to validate evidence, reconcile contradictions, or update conf

BabelDOC: Better Layout-Preserving PDF Translation via Intermediate Representation

arXiv:2605.10845v1 Announce Type: cross Abstract: As global cross-lingual communication intensifies, language barriers in visually rich documents such as PDFs remain a practical bottleneck. Existing d

BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD

arXiv:2605.10865v1 Announce Type: new Abstract: Industrial Computer-Aided Design (CAD) code generation requires models to produce executable parametric programs from visual or textual inputs. Beyond r

BenchHAR: Benchmarking Self-Supervised Learning for Generalizable Sensor-based Activity Recognition

arXiv:2605.08296v1 Announce Type: new Abstract: Human Activity Recognition (HAR) from wearable sensors supports broad healthcare and behavior science applications. However, data heterogeneity and the

Benchmarking ResNet Backbones in RT-DETR: Impact of Depth and Regularization under environmental conditions

arXiv:2605.08136v1 Announce Type: cross Abstract: Visual perception plays a central role in competitive robotics, where environmental variations can directly affect real-time detection performance. Th

researcharxiv-cs-ai

Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure

arXiv:2605.10438v1 Announce Type: cross Abstract: Current 3D tokenizers largely treat representation as spatial compression: compact codes reconstruct surface geometry, but leave component ownership a

researcharxiv-cs-cv

Byte-Exact Deduplication in Retrieval-Augmented Generation: A Three-Regime Empirical Analysis Across Public Benchmarks

arXiv:2605.09611v1 Announce Type: new Abstract: This preprint presents an empirical analysis of byte-exact chunk-level deduplication in Retrieval-Augmented Generation (RAG) pipelines. We measure conte

C-CoT: Counterfactual Chain-of-Thought with Vision-Language Models for Safe Autonomous Driving

arXiv:2605.10744v1 Announce Type: new Abstract: Safety-critical planning in complex environments, particularly at urban intersections, remains a fundamental challenge for autonomous driving. Existing

CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generation

arXiv:2605.10873v1 Announce Type: cross Abstract: Recovering editable CAD programs from images or 3D observations is central to AI-assisted design, but progress is difficult to measure because existin

Can Language Models Identify Side Effects of Breast Cancer Radiation Treatments?

arXiv:2605.08439v1 Announce Type: new Abstract: Accurately communicating the side effects of cancer treatments to cancer survivors is critical, particularly in settings such as informed consent, where

researcharxiv-cs-cl

Can Revealed Preferences Clarify LLM Alignment and Steering?

arXiv:2605.08556v1 Announce Type: new Abstract: LLMs are increasingly used to make or support high-stakes decisions under uncertainty, where alignment depends not only on factual accuracy but on how m

safetyarxiv-cs-lg

CapCLIP: A Vision-Language Representation Alignment Approach for Wireless Capsule Endoscopy Analysis

arXiv:2605.08493v1 Announce Type: new Abstract: Wireless capsule endoscopy (WCE) enables non-invasive visual assessment of the small bowel, but its clinical utility is constrained by the large volume

safetyarxiv-cs-cv

Causal Stories from Sensor Traces: Auditing Epistemic Overreach in LLM-Generated Personal Sensing Explanations

arXiv:2605.08590v1 Announce Type: cross Abstract: LLMs are increasingly used to explain personal sensing data, translating traces of activity and mood into natural-language accounts of why an anomalou

ChartDiff: A Large-Scale Benchmark for Comprehending Pairs of Charts

arXiv:2603.28902v2 Announce Type: replace Abstract: Charts are central to analytical reasoning, yet existing benchmarks for chart understanding focus almost exclusively on single-chart interpretation

Clin-JEPA: A Multi-Phase Co-Training Framework for Joint-Embedding Predictive Pretraining on EHR Patient Trajectories

arXiv:2605.10840v1 Announce Type: cross Abstract: We present Clin-JEPA, a multi-phase co-training framework for joint-embedding predictive (JEPA) pretraining on EHR patient trajectories. JEPA architec

CLR-voyance: Reinforcing Open-Ended Reasoning for Inpatient Clinical Decision Support with Outcome-Aware Rubrics

arXiv:2605.09584v1 Announce Type: cross Abstract: Inpatient clinical reasoning is a sequential decision under partial observability: the clinician sees the admission so far and must choose the next ac

ColorConceptBench: A Benchmark for Probabilistic Color-Concept Understanding in Text-to-Image Models

arXiv:2601.16836v3 Announce Type: replace-cross Abstract: Text-to-image (T2I) models have advanced considerably in generating high-quality images from textual descriptions. However, their ability to a

Core-Halo Decomposition: Decentralizing Large-Scale Fixed-Point Problems

arXiv:2605.08681v1 Announce Type: cross Abstract: We study solving large-scale fixed-point equation (x^star=ar F(x^star)) with decomposition. Standard strict decomposition assigns each agent a disjoin

Counterfactual Stress Testing for Image Classification Models

arXiv:2605.10894v1 Announce Type: new Abstract: Deep learning models in medical imaging often fail when deployed in new clinical environments due to distribution shifts in demographics, scanner hardwa

applicationsarxiv-cs-cv

CrackMeBench: Binary Reverse Engineering for Agents

arXiv:2605.10597v1 Announce Type: cross Abstract: Benchmarks for coding agents increasingly measure source-level software repair, and cybersecurity benchmarks increasingly measure broad capture-the-fl

CREATE: Testing LLMs for Associative Creativity

arXiv:2603.09970v2 Announce Type: replace Abstract: A key component of creativity is associative reasoning: the ability to draw novel yet meaningful connections between concepts. We introduce CREATE,

CUDAHercules: Benchmarking Hardware-Aware Expert-level CUDA Optimization for LLMs

model-releasesarxiv-cs-lg

arXiv:2605.08467v1 Announce Type: new Abstract: Large language models show promise for automated CUDA programming, however even the strongest coding models (e.g., Claude-Opus-4.6) may still fall short

Data-Asymmetric Latent Imagination and Reranking for 3D Robotic Imitation Learning

arXiv:2605.10166v1 Announce Type: new Abstract: Robotic imitation learning typically assumes access to optimal demonstrations, yet real-world data collection often yields suboptimal, exploratory, or e

applicationsarxiv-cs-ro

Agents

DataMaster: Towards Autonomous Data Engineering for Machine Learning

arXiv:2605.10906v1 Announce Type: cross Abstract: As model families, training recipes, and compute budgets become increasingly standardized, further gains in machine learning systems depend increasing

agentsarxiv-cs-ai

Detecting Multi-Agent Collusion Through Multi-Agent Interpretability

arXiv:2604.01151v2 Announce Type: replace Abstract: As LLM agents are increasingly deployed in multi-agent systems, they introduce risks of covert coordination that may evade standard forms of human o

DexWrist: A Robotic Wrist for Constrained and Dynamic Manipulation

arXiv:2507.01008v3 Announce Type: replace Abstract: Development of dexterous manipulation hardware has primarily focused on hands and grippers. However, these end-effectors are often paired with bulky

safetyarxiv-cs-ro

Discriminative Span as a Predictor of Synthetic Data Utility via Classifier Reconstruction

arXiv:2605.09697v1 Announce Type: new Abstract: In many real-world computer vision applications, including medical imaging and industrial inspection, binary classification tasks are characterized by a

applicationsarxiv-cs-cv

Do Linear Probes Generalize Better in Persona Coordinates?

arXiv:2605.09391v1 Announce Type: new Abstract: It is becoming increasingly necessary to have monitors check for harmful behaviors during language model interactions, but text-only monitoring has not

Drum Synthesis from Expressive Drum Grids via Neural Audio Codecs

arXiv:2605.10281v1 Announce Type: cross Abstract: Generating realistic drum audio directly from symbolic representations is a challenging task at the intersection of music perception and machine learn

DynaMiCS: Fine-tuning LLMs with Performance Constraints using Dynamic Mixtures

arXiv:2605.10770v1 Announce Type: new Abstract: Multi-domain fine-tuning of large language models requires improving performance on target domains while preserving performance on constrained domains,

safetyarxiv-cs-lg

E-TCAV: Formalizing Penultimate Proxies for Efficient Concept Based Interpretability

arXiv:2605.10261v1 Announce Type: new Abstract: TCAV (Testing with Concept Activation Vectors) is an interpretability method that assesses the alignment between the internal representations of a train

EchoFake: A Replay-Aware Dataset for Practical Speech Deepfake Detection

arXiv:2510.19414v2 Announce Type: replace-cross Abstract: The growing prevalence of speech deepfakes has raised serious concerns, particularly in real-world scenarios such as telephone fraud and ident

applicationsarxiv-cs-ai

EduStory: A Unified Framework for Pedagogically-Consistent Multi-Shot STEM Instructional Video Generation

arXiv:2605.09378v1 Announce Type: cross Abstract: Long-horizon video generation has advanced in visual quality, yet existing methods still struggle to maintain knowledge consistency and coherent pedag

Agents

EvoDriveVLA: Evolving Driving VLA Models via Collaborative Perception-Planning Distillation

arXiv:2603.09465v3 Announce Type: replace-cross Abstract: Vision-Language-Action models have shown great promise for autonomous driving, yet they suffer from degraded perception after unfreezing the v

agentsarxiv-cs-ai

Evolving-RL: End-to-End Optimization of Experience-Driven Self-Evolving Capability within Agents

arXiv:2605.10663v1 Announce Type: new Abstract: Experience-driven self-evolving agents aim to overcome the static nature of large language models by distilling reusable experience from past interactio

researcharxiv-cs-ai

EvoMAS: Learning Execution-Time Workflows for Multi-Agent Systems

arXiv:2605.08769v1 Announce Type: new Abstract: Large language model (LLM)-based multi-agent systems have shown strong potential on complex tasks through agent specialization, tool use, and collaborat

EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistant

arXiv:2605.10343v1 Announce Type: cross Abstract: Streaming video understanding demands more than watching longer videos: assistants must decide when to speak in real time, balancing responsiveness ag

Explainable Machine Learning Framework for Cardiovascular Disease Diagnosis and Prognosis

arXiv:2507.11185v2 Announce Type: replace-cross Abstract: Heart disease continues to pose a critical worldwide health issue, more specifically in areas with insufficient access to healthcare infrastru

applicationsarxiv-cs-ai