Search: “evaluation”

What Prompts Don't Say: Understanding and Managing Underspecification in LLM Prompts

arXiv:2505.13360v3 Announce Type: replace Abstract: Prompt underspecification is a common challenge when interacting with LLMs. In this paper, we present an in-depth analysis of this problem, showing

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

WISE-FM:Operation-Aware, Engineering-Informed Foundation Model for Multi-Task Well Design

DGX agent

arXiv:2604.23767v1 Announce Type: new Abstract: Deploying machine learning models across diverse well portfolios requires generalisation to wells with design parameters outside the training distributi

model-releasesarxiv-cs-lg

28 Apr 2026

World-R1: Reinforcing 3D Constraints for Text-to-Video Generation

arXiv:2604.24764v1 Announce Type: new Abstract: Recent video foundation models demonstrate impressive visual synthesis but frequently suffer from geometric inconsistencies. While existing methods atte

safetyarxiv-cs-cv

XITE: Cross-lingual Interpolation for Transfer using Embeddings

arXiv:2604.23589v1 Announce Type: new Abstract: Facilitating cross-lingual transfer in multilingual language models remains a critical challenge. Towards this goal, we propose an embedding-based data

xOffense: An Autonomous Multi-Agent Framework for Penetration Testing with Domain-Adapted Large Language Models

arXiv:2509.13021v2 Announce Type: replace-cross Abstract: This work introduces xOffense, an AI-driven, multi-agent penetration testing framework that shifts the process from labor-intensive, expert-dr

AdaFair-MARL: Enforcing Adaptive Fairness Constraints in Multi-Agent Reinforcement Learning

arXiv:2511.14135v2 Announce Type: replace-cross Abstract: Fair workload enforcement in heterogeneous multi-agent systems that pursue shared objectives remains challenging. Fixed fairness penalties oft

Adaptive vs. Static Robot-to-Human Handover: A Study on Orientation and Approach Direction

arXiv:2604.22378v1 Announce Type: new Abstract: Robot-to-human handovers often rely on static, open-loop strategies (or, at best, approaches that adapt only the position), which generally do not consi

safetyarxiv-cs-ro

Adversarial Co-Evolution of Malware and Detection Models: A Bilevel Optimization Perspective

arXiv:2604.22569v1 Announce Type: cross Abstract: Machine learning-based malware detectors are increasingly vulnerable to adversarial examples. Traditional defenses, such as one-shot adversarial train

AI-Driven Performance-to-Design Generation and Optimization of Marine Propellers

arXiv:2604.22224v1 Announce Type: cross Abstract: AI is increasingly used to accelerate engineering design by improving decision-making and shortening iteration cycles. Application to marine propeller

An End-to-End Ukrainian RAG for Local Deployment. Optimized Hybrid Search and Lightweight Generation

arXiv:2604.22095v1 Announce Type: new Abstract: This paper presents a highly efficient Retrieval-Augmented Generation (RAG) system built specifically for Ukrainian document question answering, which a

An Interdisciplinary and Cross-Task Review on Missing Data Imputation

arXiv:2511.01196v3 Announce Type: replace-cross Abstract: Missing data is a fundamental challenge in data science, significantly hindering analysis and decision-making across a wide range of disciplin

applicationsarxiv-cs-ai

Anatomy-Aware Unsupervised Detection and Localization of Retinal Abnormalities in Optical Coherence Tomography

arXiv:2604.22139v1 Announce Type: new Abstract: Reliable automated analysis of Optical Coherence Tomography (OCT) imaging is crucial for diagnosing retinal disorders but faces a critical barrier: the

ArchSym: Detecting 3D-Grounded Architectural Symmetries in the Wild

arXiv:2604.22202v1 Announce Type: new Abstract: Symmetry detection is a fundamental problem in computer vision, and symmetries serve as powerful priors for downstream tasks. However, existing learning

Tutorials

Are Natural-Domain Foundation Models Effective for Accelerated Cardiac MRI Reconstruction?

arXiv:2604.22557v1 Announce Type: cross Abstract: The emergence of large-scale pretrained foundation models has transformed computer vision, enabling strong performance across diverse downstream tasks

tutorialsarxiv-cs-cv

Associativity-Peakiness Metric for Contingency Tables

arXiv:2604.22655v1 Announce Type: new Abstract: For the use case of comparing the performance of clustering algorithms whose output is a contingency table, a single performance metric for contingency

Atlas-Alignment: Making Interpretability Transferable Across Language Models

arXiv:2510.27413v2 Announce Type: replace-cross Abstract: Interpretability is crucial for building safe, reliable, and controllable language models, yet existing interpretability pipelines remain cost

BERAG: Bayesian Ensemble Retrieval-Augmented Generation for Knowledge-based Visual Question Answering

arXiv:2604.22678v1 Announce Type: new Abstract: A common approach to question answering with retrieval-augmented generation (RAG) is to concatenate documents into a single context and pass it to a lan

Tutorials

Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAs

arXiv:2604.22618v1 Announce Type: new Abstract: Self-supervised learning in healthcare has largely relied on invariance-based objectives, which maximize similarity between different views of the same

tutorialsarxiv-cs-lg

Agents

Build Strands Agents with SageMaker AI models and MLflow

In this post, we demonstrate how to build AI agents using Strands Agents SDK with models deployed on SageMaker AI endpoints. You will learn how to deploy foundation models from SageMaker JumpStart, in

agentsaws-ml-blog

Call-Chain-Aware LLM-Based Test Generation for Java Projects

arXiv:2604.22046v1 Announce Type: cross Abstract: Large language models (LLMs) have recently shown strong potential for generating project-level unit tests. However, existing state-of-the-art approach

Causal Concept Graphs in LLM Latent Space for Stepwise Reasoning

arXiv:2603.10377v2 Announce Type: replace-cross Abstract: Sparse autoencoders can localize where concepts live in language models, but not how they interact during multi-step reasoning. We propose Cau

Closed Form Relations and Higher-Order Approximations of First and Second Derivatives of the Tangent Operator on SE(3)

arXiv:2604.22287v1 Announce Type: cross Abstract: The Lie group SE(3) of isometric orientation preserving transformation is used for modeling multibody systems, robots, and Cosserat continua. The use

researcharxiv-cs-ro

CognitiveTwin: Robust Multi-Modal Digital Twins for Predicting Cognitive Decline in Alzheimer's Disease

arXiv:2604.22428v1 Announce Type: new Abstract: Predicting individual cognitive decline in Alzheimer's disease (AD) is difficult due to the heterogeneity of disease progression. Reliable clinical tool

CRAFT: Clustered Regression for Adaptive Filtering of Training data

arXiv:2604.22693v1 Announce Type: cross Abstract: Selecting a small, high-quality subset from a large corpus for fine-tuning is increasingly important as corpora grow to tens of millions of datapoints

Cross-Domain Offshore Wind Power Forecasting: Transfer Learning Through Meteorological Clusters

arXiv:2601.19674v2 Announce Type: replace-cross Abstract: Ambitious decarbonisation targets are rapidly increasing the commission of new offshore wind farms. For these newly commissioned plants to run

Cross-Session Decoding of Neural Spiking Data via Task-Conditioned Latent Alignment

arXiv:2601.19963v2 Announce Type: replace-cross Abstract: Training a high-performing neural decoder can be difficult when only limited data are available from a recording session. To address this chal

Decoding High-Dimensional Finger Motion from EMG Using Riemannian Features and RNNs

model-releasesarxiv-cs-lg

arXiv:2604.22499v1 Announce Type: new Abstract: Continuous estimation of high-dimensional finger kinematics from forearm surface electromyography (EMG) could enable natural control for hand prostheses

Detecting Concept Drift in Evolving Malware Families Using Rule-Based Classifier Representations

arXiv:2604.22629v1 Announce Type: cross Abstract: This work proposes a structural approach to concept drift detection in malware classification using decision tree rulesets. Classifiers are trained ac

Dharma, Data and Deception: An LLM-Powered Rhetorical Analysis of Cow-Urine Health Claims on YouTube

model-releasesarxiv-cs-cl

arXiv:2604.22606v1 Announce Type: new Abstract: Health misinformation remains one of the most pressing challenges on social media, particularly when cultural traditions intersect with scientific-sound

Tutorials

Distilling Vision Transformers for Distortion-Robust Representation Learning

arXiv:2604.22529v1 Announce Type: new Abstract: Self-supervised learning has achieved remarkable success in learning visual representations from clean data, yet remains challenging when clean observat

tutorialsarxiv-cs-cv

Agents

DM^3-Nav: Decentralized Multi-Agent Multimodal Multi-Object Semantic Navigation

arXiv:2604.22014v1 Announce Type: cross Abstract: We present DM^3-Nav, a fully decentralized multi-agent semantic navigation system supporting multimodal open-vocabulary goal specification and multi-o

agentsarxiv-cs-ro

Agents

Do Not Imitate, Reinforce: Iterative Classification via Belief Refinement

arXiv:2604.22110v1 Announce Type: new Abstract: Standard supervised classification trains models to imitate the exact labels provided by a perfect oracle. This imitation happens in a single pass, rest

agentsarxiv-cs-lg

Dynamically Acquiring Text Content to Enable the Classification of Lesser-known Entities for Real-world Tasks

arXiv:2604.22325v1 Announce Type: new Abstract: Existing Natural Language Processing (NLP) resources often lack the task-specific information required for real-world problems and provide limited cover

applicationsarxiv-cs-cl

Energy-Efficient Multi-Robot Coverage Path Planning of Non-Convex Regions of Interests

model-releasesarxiv-cs-ro

arXiv:2604.22189v1 Announce Type: new Abstract: This letter presents an energy-efficient multi-robot coverage path planning (MRCPP) framework for large, nonconvex Regions of Interest (ROI) containing

EV-CLIP: Efficient Visual Prompt Adaptation for CLIP in Few-shot Action Recognition under Visual Challenges

arXiv:2604.22595v1 Announce Type: new Abstract: CLIP has demonstrated strong generalization in visual domains through natural language supervision, even for video action recognition. However, most exi

Exploiting Low-Rank Structure in Max-K-Cut Problems

arXiv:2602.20376v2 Announce Type: replace-cross Abstract: We approach the Max-3-Cut problem through the lens of maximizing complex-valued quadratic forms and demonstrate that low-rank structure in the

Fast, close, non-singular and property-preserving approximations of entropic measures

arXiv:2505.14234v2 Announce Type: replace-cross Abstract: Entropic measures like Shannon entropy (SE), its quantum mechanical analogue von Neumann entropy, and Kullback-Leibler divergence (KL) are key

FeatEHR-LLM: Leveraging Large Language Models for Feature Engineering in Electronic Health Records

arXiv:2604.22534v1 Announce Type: cross Abstract: Feature engineering for Electronic Health Records (EHR) is complicated by irregular observation intervals, variable measurement frequencies, and struc

applicationsarxiv-cs-ai

FILTR: Extracting Topological Features from Pretrained 3D Models

arXiv:2604.22334v1 Announce Type: new Abstract: Recent advances in pretraining 3D point cloud encoders (e.g., Point-BERT, Point-MAE) have produced powerful models, whose abilities are typically evalua

FixV2W: Correcting Invalid CVE-CWE Mappings with Knowledge Graph Embeddings

arXiv:2604.22176v1 Announce Type: cross Abstract: Accurate mapping between Common Vulnerabilities and Exposures (CVE) and Common Weakness Enumeration (CWE) entries is critical for effective vulnerabil

From Global to Local: Rethinking CLIP Feature Aggregation for Person Re-Identification

arXiv:2604.22190v1 Announce Type: cross Abstract: CLIP-based person re-identification (ReID) methods aggregate spatial features into a single global exttt{[CLS]} token optimized for image-text alignme

From Natural Language to Verified Code: Toward AI Assisted Problem-to-Code Generation with Dafny-Based Formal Verification

arXiv:2604.22601v1 Announce Type: cross Abstract: Large Language Models (LLMs) show promise in automated software engineering, yet their guarantee of correctness is frequently undermined by erroneous

From Words to Amino Acids: Does the Curse of Depth Persist?

arXiv:2602.21750v2 Announce Type: replace Abstract: Protein language models (PLMs) have become widely adopted as general-purpose models, demonstrating strong performance in protein engineering and de

GazeVLA: Learning Human Intention for Robotic Manipulation

arXiv:2604.22615v1 Announce Type: new Abstract: Embodied foundation models have achieved significant breakthroughs in robotic manipulation, yet they still depend heavily on large-scale robot demonstra

applicationsarxiv-cs-ro

H-Sets: Hessian-Guided Discovery of Set-Level Feature Interactions in Image Classifiers

arXiv:2604.22045v1 Announce Type: cross Abstract: Feature attribution methods explain the predictions of deep neural networks by assigning importance scores to individual input features. However, most

Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer

arXiv:2601.10386v2 Announce Type: replace-cross Abstract: Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Mu

How Large Language Models Balance Internal Knowledge with User and Document Assertions

arXiv:2604.22193v1 Announce Type: new Abstract: Large language models (LLMs) often need to balance their internal parametric knowledge with external information, such as user beliefs and content from

safetyarxiv-cs-cl

How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining

arXiv:2511.18903v2 Announce Type: replace-cross Abstract: Due to the scarcity of high-quality data, large language models (LLMs) are often trained on mixtures of data with varying quality levels, even