Search: “evaluation”

Differential privacy representation geometry for medical image analysis

arXiv:2603.01098v2 Announce Type: replace-cross Abstract: Differential privacy (DP)'s effect in medical imaging is typically evaluated only through end-to-end performance, leaving the mechanism of pri

researcharxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Dynamic Tool Dependency Retrieval for Lightweight Function Calling

DGX agent

arXiv:2512.17052v4 Announce Type: replace Abstract: Function calling agents powered by Large Language Models (LLMs) select external tools to automate complex tasks. On-device agents typically use a re

model-releasesarxiv-cs-lg

20 Apr 2026

Facial-Expression-Aware Prompting for Empathetic LLM Tutoring

arXiv:2604.15336v1 Announce Type: cross Abstract: Large language models (LLMs) enable increasingly capable tutoring-style conversational agents, yet effective tutoring requires sensitivity to learners

FETAL-GAUGE: A Benchmark for Assessing Vision-Language Models in Fetal Ultrasound

arXiv:2512.22278v2 Announce Type: replace Abstract: The growing demand for prenatal ultrasound imaging has intensified a global shortage of trained sonographers, creating barriers to essential fetal h

HarmfulSkillBench: How Do Harmful Skills Weaponize Your Agents?

arXiv:2604.15415v1 Announce Type: cross Abstract: Large language models (LLMs) have evolved into autonomous agents that rely on open skill ecosystems (e.g., ClawHub and Skills.Rest), hosting numerous

IPQA: A Benchmark for Core Intent Identification in Personalized Question Answering

arXiv:2510.23536v2 Announce Type: replace Abstract: Intent identification serves as the foundation for generating appropriate responses in personalized question answering (PQA). However, existing benc

KWBench: Measuring Unprompted Problem Recognition in Knowledge Work

arXiv:2604.15760v1 Announce Type: new Abstract: We introduce the first version of KWBench (Knowledge Work Bench), a benchmark for unprompted problem recognition in large language models: can an LLM id

Machine learning approaches to uncover the neural mechanisms of motivated behaviour: from ADHD to individual differences in effort and reward sensitivity

arXiv:2604.15363v1 Announce Type: cross Abstract: Motivated behaviour relies on the brain's capacity to evaluate effort and reward. Dysregulation within these processes contributes to a spectrum of co

researcharxiv-cs-lg

Modeling of ASD/TD Children's Behaviors in Interaction with a Virtual Social Robot During a Music Education Program Using Deep Neural Networks

arXiv:2604.15314v1 Announce Type: cross Abstract: This research aimed to develop an intelligent system to evaluate performance and extract behavioral models for children with ASD and neurotypical (TD)

applicationsarxiv-cs-ai

Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research

arXiv:2412.04497v5 Announce Type: replace-cross Abstract: Low-resource languages serve as invaluable repositories of human history, embodying cultural evolution and intellectual diversity. Despite the

researcharxiv-cs-ai

PIIBench: A Unified Multi-Source Benchmark Corpus for Personally Identifiable Information Detection

arXiv:2604.15776v1 Announce Type: cross Abstract: We present PIIBench, a unified benchmark corpus for Personally Identifiable Information (PII) detection in natural language text. Existing resources f

Ranking XAI Methods for Head and Neck Cancer Outcome Prediction

arXiv:2604.16034v1 Announce Type: new Abstract: For head and neck cancer (HNC) patients, prognostic outcome prediction can support personalized treatment strategy selection. Improving prediction perfo

researcharxiv-cs-cv

RedBench: A Universal Dataset for Comprehensive Red Teaming of Large Language Models

arXiv:2601.03699v2 Announce Type: replace Abstract: As large language models (LLMs) become integral to safety-critical applications, ensuring their robustness against adversarial prompts is paramount.

RefereeBench: Are Video MLLMs Ready to be Multi-Sport Referees

arXiv:2604.15736v1 Announce Type: cross Abstract: While Multimodal Large Language Models (MLLMs) excel at generic video understanding, their ability to support specialized, rule-grounded decision-maki

Teaching Language Models Mechanistic Explainability Through MechSMILES

arXiv:2512.05722v2 Announce Type: replace Abstract: Chemical reaction mechanisms are the foundation of how chemists evaluate reactivity and feasibility, yet current Computer-Assisted Synthesis Plannin

researcharxiv-cs-lg

Hardware

The threat of analytic flexibility in using large language models to simulate human data

arXiv:2509.13397v3 Announce Type: replace-cross Abstract: Social scientists are now using large language models to create 'silicon samples': synthetic datasets intended to stand in for human responden

hardwarearxiv-cs-ai

Towards Realistic Open-Vocabulary Remote Sensing Segmentation: Benchmark and Baseline

arXiv:2604.15652v1 Announce Type: new Abstract: Open-vocabulary remote sensing image segmentation (OVRSIS) remains underexplored due to fragmented datasets, limited training diversity, and the lack of

TwinTrack: Post-hoc Multi-Rater Calibration for Medical Image Segmentation

model-releasesarxiv-cs-lg

arXiv:2604.15950v1 Announce Type: new Abstract: Pancreatic ductal adenocarcinoma (PDAC) segmentation on contrast-enhanced CT is inherently ambiguous: inter-rater disagreement among experts reflects ge

Two-Stage Framework for Efficient UAV-Based Wildfire Video Analysis with Adaptive Compression and Fire Source Detection

arXiv:2508.16739v2 Announce Type: replace Abstract: Unmanned Aerial Vehicles (UAVs) have become increasingly important in disaster emergency response by facilitating aerial video analysis. Due to the

UA-Net: Uncertainty-Aware Network for TRISO Image Semantic Segmentation

arXiv:2604.15542v1 Announce Type: new Abstract: Tristructural isotropic (TRISO)-coated particle fuels undergo dimensional changes and chemical reactions during high-temperature neutron irradiation. Po

researcharxiv-cs-cv

AI-Assisted Peer Review at Scale: The AAAI-26 AI Review Pilot

arXiv:2604.13940v1 Announce Type: new Abstract: Scientific peer review faces mounting strain as submission volumes surge, making it increasingly difficult to sustain review quality, consistency, and t

Attention-Gated Convolutional Networks for Scanner-Agnostic Quality Assessment

arXiv:2604.15059v1 Announce Type: new Abstract: Motion artifacts present a significant challenge in structural MRI (sMRI), often compromising clinical diagnostics and large-scale automated analysis. W

Chain of Modality: From Static Fusion to Dynamic Orchestration in Omni-MLLMs

arXiv:2604.14520v1 Announce Type: new Abstract: Omni-modal Large Language Models (Omni-MLLMs) promise a unified integration of diverse sensory streams. However, recent evaluations reveal a critical pe

safetyarxiv-cs-cv

ChatSVA: Bridging SVA Generation for Hardware Verification via Task-Specific LLMs

arXiv:2604.02811v2 Announce Type: replace-cross Abstract: Functional verification consumes over 50% of the IC development lifecycle, where SystemVerilog Assertions (SVAs) are indispensable for formal

Chinese Essay Rhetoric Recognition Using LoRA, In-context Learning and Model Ensemble

arXiv:2604.14167v1 Announce Type: new Abstract: Rhetoric recognition is a critical component in automated essay scoring. By identifying rhetorical elements in student writing, AI systems can better as

applicationsarxiv-cs-cl

ConfLayers: Adaptive Confidence-based Layer Skipping for Self-Speculative Decoding

arXiv:2604.14612v1 Announce Type: cross Abstract: Self-speculative decoding is an inference technique for large language models designed to speed up generation without sacrificing output quality. It c

safetyarxiv-cs-cl

Dissecting Failure Dynamics in Large Language Model Reasoning

arXiv:2604.14528v1 Announce Type: cross Abstract: Large Language Models (LLMs) achieve strong performance through extended inference-time deliberation, yet how their reasoning failures arise remains p

local-aiarxiv-cs-cl

Exploring and Testing Skill-Based Behavioral Profile Annotation: Human Operability and LLM Feasibility under Schema-Guided Execution

arXiv:2604.14843v1 Announce Type: new Abstract: Behavioral Profile (BP) annotation is difficult to automate because it requires simultaneous coding across multiple linguistic dimensions. We treat BP a

FoodSense: A Multisensory Food Dataset and Benchmark for Predicting Taste, Smell, Texture, and Sound from Images

arXiv:2604.14388v1 Announce Type: new Abstract: Humans routinely infer taste, smell, texture, and even sound from food images a phenomenon well studied in cognitive science. However, prior vision lang

From Black Box to Glass Box: Cross-Model ASR Disagreement to Prioto Review in Ambient AI Scribe Documentation

arXiv:2604.14152v1 Announce Type: cross Abstract: Ambient AI 'scribe' systems promise to reduce clinical documentation burden, but automatic speech recognition (ASR) errors can remain unnoticed withou

applicationsarxiv-cs-cl

Interpretable Human Activity Recognition for Subtle Robbery Detection in Surveillance Videos

arXiv:2604.14329v1 Announce Type: new Abstract: Non-violent street robberies (snatch-and-run) are difficult to detect automatically because they are brief, subtle, and often indistinguishable from ben

Large Language Models to Enhance Business Process Modeling: Past, Present, and Future Trends

arXiv:2604.14034v1 Announce Type: cross Abstract: Recent advances in Generative Artificial Intelligence, particularly Large Language Models (LLMs), have stimulated growing interest in automating or as

applicationsarxiv-cs-ai

Lazy or Efficient? Towards Accessible Eye-Tracking Event Detection Using LLMs

arXiv:2604.13243v1 Announce Type: cross Abstract: Gaze event detection is fundamental to vision science, human-computer interaction, and applied analytics. However, current workflows often require spe

researcharxiv-cs-ai

LexGenius: An Expert-Level Benchmark for Large Language Models in Legal General Intelligence

arXiv:2512.04578v3 Announce Type: replace Abstract: Legal general intelligence (GI) refers to artificial intelligence (AI) that encompasses legal understanding, reasoning, and decision-making, simulat

MARCA: A Checklist-Based Benchmark for Multilingual Web Search

arXiv:2604.14448v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as sources of information, yet their reliability depends on the ability to search the web, select rel

Open-Set Vein Biometric Recognition with Deep Metric Learning

arXiv:2604.14874v1 Announce Type: new Abstract: Most state-of-the-art vein recognition methods rely on closed-set classification, which inherently limits their scalability and prevents the adaptive en

Portfolio Optimization Proxies under Label Scarcity and Regime Shifts via Bayesian and Deterministic Students under Semi-Supervised Sandwich Training

arXiv:2604.14206v1 Announce Type: new Abstract: This paper proposes a machine learning assisted portfolio optimization framework designed for low data environments and regime uncertainty. We construct

researcharxiv-cs-lg

PortraitCraft: A Benchmark for Portrait Composition Understanding and Generation

arXiv:2604.03611v2 Announce Type: replace Abstract: Portrait composition plays a central role in portrait aesthetics and visual communication, yet existing datasets and benchmarks mainly focus on coar

Social Story Frames: Contextual Reasoning about Narrative Intent and Reception

arXiv:2512.15925v2 Announce Type: replace Abstract: Reading stories evokes rich interpretive, affective, and evaluative responses, such as inferences about narrative intent or judgments about characte

researcharxiv-cs-cl

Variance Computation for Weighted Model Counting with Knowledge Compilation Approach

arXiv:2601.03523v2 Announce Type: replace Abstract: One of the most important queries in knowledge compilation is weighted model counting (WMC), which has been applied to probabilistic inference on va

applicationsarxiv-cs-ai

Weight Patching: Toward Source-Level Mechanistic Localization in LLMs

arXiv:2604.13694v1 Announce Type: new Abstract: Mechanistic interpretability seeks to localize model behavior to the internal components that causally realize it. Prior work has advanced activation-sp

Your LLM Agents are Temporally Blind: The Misalignment Between Tool Use Decisions and Human Time Perception

arXiv:2510.23853v3 Announce Type: replace Abstract: Large language model (LLM) agents are increasingly used to interact with and execute tasks in dynamic environments. However, a critical yet overlook

safetyarxiv-cs-cl

Automatically Inferring Teachers' Geometric Content Knowledge: A Skills Based Approach

arXiv:2604.13666v1 Announce Type: cross Abstract: Assessing teachers' geometric content knowledge is essential for geometry instructional quality and student learning, but difficult to scale. The Van

applicationsarxiv-cs-lg

Before the First Token: Scale-Dependent Emergence of Hallucination Signals in Autoregressive Language Models

arXiv:2604.13068v1 Announce Type: new Abstract: When do large language models decide to hallucinate? Despite serious consequences in healthcare, law, and finance, few formal answers exist. Recent work

applicationsarxiv-cs-cl

Beyond State Consistency: Behavior Consistency in Text-Based World Models

arXiv:2604.13824v1 Announce Type: new Abstract: World models have been emerging as critical components for assessing the consequences of actions generated by interactive agents in online planning and

safetyarxiv-cs-lg

Document-tuning for robust alignment to animals

arXiv:2604.13076v1 Announce Type: new Abstract: We investigate the robustness of value alignment via finetuning with synthetic documents, using animal compassion as a value that is both important in i

Enhancing Confidence Estimation in Telco LLMs via Twin-Pass CoT-Ensembling

model-releasesarxiv-cs-lg

arXiv:2604.13271v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly applied to complex telecommunications tasks, including 3GPP specification analysis and O-RAN network troub

Explainable Fall Detection for Elderly Care via Temporally Stable SHAP in Skeleton-Based Human Activity Recognition

arXiv:2604.13279v1 Announce Type: new Abstract: Fall detection in elderly care requires not only accurate classification but also reliable explanations that clinicians can trust. However, existing pos