Search: “evaluation”

arXiv:2605.03984v1 Announce Type: new Abstract: Sampling from unnormalized densities is analogous to the generative modeling problem, but the target distribution is defined by a known energy function

tutorialsarxiv-cs-lg

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

GOAT: A Training Framework for Goal-Oriented Agent with Tools

DGX agent

arXiv:2510.12218v2 Announce Type: replace Abstract: Current approaches rely on zero-shot evaluation due to the absence of training data; while proprietary models such as GPT-4 exhibit strong reasoning

model-releasesarxiv-cs-ai

6 May 2026

ISAAC: Auditing Causal Reasoning in Deep Models for Drug-Target Interaction

model-releasesarxiv-cs-lg

arXiv:2605.02962v1 Announce Type: new Abstract: Deep learning models for drug--target interaction (DTI) prediction often achieve strong benchmark performance without necessarily relying on mechanistic

LiveFMBench: Unveiling the Power and Limits of Agentic Workflows in Specification Generation

arXiv:2605.01394v1 Announce Type: cross Abstract: Formal specification is essential for rigorous program verification, yet writing correct specifications remains costly and difficult to automate. Alth

MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Servers

arXiv:2602.00933v2 Announce Type: replace-cross Abstract: The Model Context Protocol (MCP) is rapidly becoming the standard interface for Large Language Models (LLMs) to discover and invoke external t

MEMSAD: Gradient-Coupled Anomaly Detection for Memory Poisoning in Retrieval-Augmented Agents

arXiv:2605.03482v1 Announce Type: cross Abstract: Persistent external memory enables LLM agents to maintain context across sessions, yet its security properties remain formally uncharacterized. We for

Multi-Agent Reasoning Improves Compute Efficiency: Pareto-Optimal Test-Time Scaling

arXiv:2605.01566v1 Announce Type: new Abstract: Advances in inference methods have enabled language models to improve their predictions without additional training. These methods often prioritize raw

PIIGuard: Mitigating PII Harvesting under Adversarial Sanitization

arXiv:2605.03129v1 Announce Type: cross Abstract: Browsing-enabled LLM assistants can fetch webpages and answer contact-seeking queries, creating a practical channel for scraping contact-style persona

PriorNet: Prior-Guided Engagement Estimation from Face Video

arXiv:2605.03615v1 Announce Type: new Abstract: Engagement estimation from face video remains challenging because facial evidence is often incomplete, labeled data are limited, and engagement annotati

Applications

Robustness and Transferability of Pix2Geomodel for Bidirectional Facies Property Translation in a Complex Reservoir

arXiv:2605.03919v1 Announce Type: cross Abstract: Reservoir geomodeling is central to subsurface characterization, but it remains challenging because conditioning data are sparse, geological heterogen

applicationsarxiv-cs-cv

Scoring Edit Impact in Grammatical Error Correction via Embedded Association Graphs

arXiv:2604.06573v2 Announce Type: replace Abstract: A Grammatical Error Correction (GEC) system produces a sequence of edits to correct an erroneous sentence. The quality of these edits is typically e

researcharxiv-cs-cl

Structural Ranking of the Cognitive Plausibility of Computational Models of Analogy and Metaphors with the Minimal Cognitive Grid

arXiv:2605.01359v1 Announce Type: new Abstract: In this paper, we employ the Minimal Cognitive Grid (MCG), a framework created to evaluate the cognitive plausibility of artificial systems, to offer a

researcharxiv-cs-ai

Agents

WMF-AM: Probing LLM Working Memory via Depth-Parameterized Cumulative State Tracking

arXiv:2603.27343v2 Announce Type: replace Abstract: Existing large language models (LLMs) evaluations use fixed-difficulty benchmarks that cannot adapt as models improve, and rarely isolate specific c

agentsarxiv-cs-ai

A dimensional R2 regression metric

arXiv:2605.01066v1 Announce Type: new Abstract: R2 score is the standard metric for evaluating regression tasks, offering a normalized magnitude-agnostic measure of accuracy that captures variance. Ho

Applications

A Hybrid Approach for Closing the Sim2real Appearance Gap in Game Engine Synthetic Datasets

arXiv:2605.02291v1 Announce Type: new Abstract: Video game engines have been an important source for generating large volumes of visual synthetic datasets for training and evaluating computer vision a

applicationsarxiv-cs-cv

A Rational Account of Categorization Based on Information Theory

arXiv:2603.29895v2 Announce Type: replace-cross Abstract: We present a new theory of categorization based on an information-theoretic rational analysis. To evaluate this theory, we investigate how wel

ACTG-ARL: Differentially Private Conditional Text Generation with RL-Boosted Control

arXiv:2510.18232v2 Announce Type: replace Abstract: Generating high-quality synthetic text under differential privacy (DP) is critical for training and evaluating language models without compromising

Tutorials

Adaptation of AI-accelerated CFD Simulations to the IPU platform

arXiv:2605.00462v1 Announce Type: cross Abstract: Intelligence Processing Units (IPU) have proven useful for many AI applications. In this paper, we evaluate them within the emerging field of AI for s

tutorialsarxiv-cs-ai

Adoption and Use of LLMs at an Academic Medical Center

arXiv:2602.00074v2 Announce Type: replace-cross Abstract: While large language models (LLMs) can support clinical documentation needs, standalone tools struggle with 'workflow friction' from manual da

Local Ai

Biological Spatial Priors Regularize Foundation Model Representations for Cross-Site MSI Generalization in Colorectal Cancer

arXiv:2605.02660v1 Announce Type: cross Abstract: Predicting microsatellite instability (MSI) status from routine hematoxylin and eosin (H&E) whole slide images (WSIs) offers a practical alternative t

local-aiarxiv-cs-cv

Tutorials

Continual Learning of Feedback-based Molecular Communication

arXiv:2605.01020v1 Announce Type: new Abstract: This paper proposes and evaluates a new performance estimation method that leverages continual learning (CL) algorithms to carry out sequential simulati

tutorialsarxiv-cs-lg

ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescue

model-releasesarxiv-cs-ro

arXiv:2605.01371v1 Announce Type: new Abstract: The rapid advancement of Multimodal Large Language Models (MLLMs) has empowered Unmanned Aerial Vehicle (UAV) with exceptional capabilities in spatial r

Grounding Synthetic Data Generation With Vision and Language Models

arXiv:2603.09625v2 Announce Type: replace Abstract: Deep learning models benefit from increasing data diversity and volume, motivating synthetic data augmentation to improve existing datasets. However

Robustness of Transformer-Based Fluence Map Prediction Under Clinically Realistic Perturbations

arXiv:2605.00904v1 Announce Type: new Abstract: Learning-based fluence map prediction offers a fast alternative to iterative inverse planning in intensity-modulated radiation therapy (IMRT), but its r

researcharxiv-cs-cv

Social Bias in LLM-Generated Code: Benchmark and Mitigation

arXiv:2605.00382v2 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly deployed to generate code for human-centered applications where demographic fairness is critical. Howeve

Stable Localized Conformal Prediction via Transduction

arXiv:2605.01452v1 Announce Type: cross Abstract: Existing evaluations of conformal prediction, such as prediction efficiency and test-conditional coverage, are defined in expectation over the calibra

STAGE: A Full-Screenplay Benchmark for Reasoning over Evolving Storie

arXiv:2601.08510v3 Announce Type: replace Abstract: Movie screenplays are rich long-form narratives that interleave complex character relationships, temporally ordered events, and dialogue-driven inte

Submodular Benchmark Selection

model-releasesarxiv-cs-lg

arXiv:2605.02209v1 Announce Type: cross Abstract: Evaluating large language models across many benchmarks is expensive, yet many benchmarks are highly correlated. We formalize the selection of a small

TF1-EN-3M: Three Million Synthetic Moral Fables for Training Small, Open Language Models

arXiv:2504.20605v2 Announce Type: replace Abstract: Moral stories are a time-tested vehicle for transmitting values, yet modern NLP lacks a large, structured corpus that couples coherent narratives wi

The Compliance Trap: How Structural Constraints Degrade Frontier AI Metacognition Under Adversarial Pressure

arXiv:2605.02398v1 Announce Type: cross Abstract: As frontier AI models are deployed in high-stakes decision pipelines, their ability to maintain metacognitive stability -- knowing what they do not kn

Toward Culturally Grounded Natural Language Processing

arXiv:2603.26013v2 Announce Type: replace Abstract: Multilingual NLP is often treated as a route to global inclusion, but linguistic coverage and cultural competence frequently diverge. This paper syn

Toward Fine-Grained Speech Inpainting Forensics:A Dataset, Method, and Metric for Multi-Region Tampering Localization

arXiv:2605.02223v1 Announce Type: cross Abstract: Recent advances in voice cloning and text-to-speech synthesis have made partial speech manipulation - where an adversary replaces a few words within a

Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark

arXiv:2605.00883v1 Announce Type: new Abstract: Face swapping has witnessed significant progress in recent years, largely driven by advances in deep generative models such as GANs and diffusion models

VideoNet: A Large-Scale Dataset for Domain-Specific Action Recognition

arXiv:2605.02834v1 Announce Type: new Abstract: Videos are unique in their ability to capture actions which transcend multiple frames. Accordingly, for many years action recognition was the quintessen

A Comparative Study of QSPR Methods on a Unique Multitask PAMPA dataset

arXiv:2605.00508v1 Announce Type: new Abstract: We present a unique, multitask dataset comprising 143 drug and drug candidate molecules, each evaluated on in vitro, parallel artificial-membrane permea

Local Ai

Bayesian Optimization in Linear Time

arXiv:2605.00237v1 Announce Type: new Abstract: Bayesian optimization is a sequential method for minimizing objective functions that are expensive to evaluate and about which few assumptions can be ma

local-aiarxiv-cs-lg

Safety

Beyond Suffixes: Token Position in GCG Adversarial Attacks on Large Language Models

arXiv:2602.03265v2 Announce Type: replace Abstract: Large Language Models (LLMs) have seen widespread adoption across multiple domains, creating an urgent need for robust safety alignment mechanisms.

safetyarxiv-cs-lg

Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues

arXiv:2605.00119v1 Announce Type: new Abstract: There is a significant gap in evaluating cultural reasoning in LLMs using conversational datasets that capture culturally rich and dialectal contexts. M

researcharxiv-cs-cl

Do Open-Loop Metrics Predict Closed-Loop Driving? A Cross-Benchmark Correlation Study of NAVSIM and Bench2Drive

model-releasesarxiv-cs-ro

arXiv:2605.00066v1 Announce Type: new Abstract: Open-loop evaluation offers fast, reproducible assessment of autonomous driving planners, but its ability to predict real closed-loop driving performanc

Driving with A Thousand Faces: A Benchmark for Closed-Loop Personalized End-to-End Autonomous Driving

arXiv:2602.18757v2 Announce Type: replace Abstract: Human driving behavior is inherently diverse, yet most end-to-end autonomous driving (E2E-AD) systems learn a single average driving style, neglecti

Local Ai

Learning the Helmholtz equation operator with DeepONet for non-parametric 2D geometries

arXiv:2605.00760v1 Announce Type: new Abstract: This paper deals with solving the 2D Helmholtz equation on non-parametric domains, leveraging a physics-informed neural operator network based on the De

local-aiarxiv-cs-lg

Modeling Subjective Urban Perception with Human Gaze

arXiv:2605.00764v1 Announce Type: new Abstract: Urban perception describes how people subjectively evaluate urban environments, shaping how cities are experienced and understood. Existing computationa

researcharxiv-cs-cv

RETO: A Rotary-Enhanced Transformer Operator for High-Fidelity Prediction of Automotive Aerodynamics

model-releasesarxiv-cs-lg

arXiv:2605.00062v1 Announce Type: cross Abstract: Rapid aerodynamic evaluation is crucial for modern vehicle design, yet existing neural operators struggle to capture intricate spatial correlations. W

The Seismic Wavefield Common Task Framework

arXiv:2512.19927v2 Announce Type: replace Abstract: Seismology faces fundamental challenges in state forecasting and reconstruction (e.g., earthquake early warning and ground motion prediction) and ma

Unsupervised Denoising of Real Clinical Low Dose Liver CT with Perceptual Attention Networks

arXiv:2605.00793v1 Announce Type: cross Abstract: With the development of deep learning, medical image processing has been widely used to assist clinical research. This paper focuses on the denoising

researcharxiv-cs-cv

Safety

World Model for Robot Learning: A Comprehensive Survey

arXiv:2605.00080v1 Announce Type: cross Abstract: World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They s

safetyarxiv-cs-cv

AesRM: Improving Video Aesthetics with Expert-Level Feedback

arXiv:2604.28078v1 Announce Type: new Abstract: Despite rapid advances in photorealistic video generation, real-world applications such as filmmaking require video aesthetics, e.g., harmonious colors

1 May 2026

Agentic AI for Cybersecurity: A Meta-Cognitive Architecture for Governable Autonomy

arXiv:2602.11897v3 Announce Type: replace-cross Abstract: Cybersecurity decision-making increasingly occurs in environments characterized by uncertainty, partial observability, and adversarial manipul