Search: “evaluation”

If you use LLM-as-judge, this one is worth reading. (bookmark it) It's actually one of the most effective ways to use LLM-as-a-Judge for evals. Holistic judge scores hide both their reasoning and thei

tutorialsdair-ai--x

27 Jun 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

A Latent ODE Approach to Spatiotemporal Modeling of Cine Cardiac MRI

DGX agent

arXiv:2606.26718v1 Announce Type: new Abstract: Cardiac magnetic resonance imaging (CMR) captures rich spatiotemporal information about ventricular structure and motion, but conventional risk models u

researcharxiv-cs-ai

26 Jun 2026

A System for Fast, Resilient, and Adaptable Loco-Manipulation Behaviors on Humanoid Robots

arXiv:2606.26425v1 Announce Type: new Abstract: Humanoid robots could take on physically demanding, hazardous, and repetitive work in spaces built for humans. However, a useful robot for these spaces

researcharxiv-cs-ro

Accelerated sampling using SamAdams variable timesteps and position-adaptive Langevin dynamics

arXiv:2606.26881v1 Announce Type: cross Abstract: We introduce an accelerated Langevin-based sampling method that is based on two complementary devices: SamAdams adaptive timestepping, which automatic

local-aiarxiv-cs-lg

Active Adversarial Perturbation-driven Associative Memory Retrieval for RGB-Event Visual Object Tracking

arXiv:2606.26455v1 Announce Type: cross Abstract: RGB-Event tracking improves localization robustness by fusing RGB appearance textures and dense temporal motion cues from event sensors. While this mu

Adaptive Utility driven Resource Orchestration for Resilient AI (AURORA-AI)

arXiv:2606.27005v1 Announce Type: new Abstract: Modern AI systems are increasingly deployed under non-stationary computational, demographic, and operational conditions in which static resource allocat

Applications

Adversarial Robustness of AI-Generated Image Detectors in the Real World

arXiv:2410.01574v4 Announce Type: replace Abstract: The rapid advancement of Generative Artificial Intelligence (GenAI) capabilities is accompanied by a concerning rise in its misuse. In particular th

applicationsarxiv-cs-cv

AIGP: An LLM-Based Framework for Long-Term Value Alignment in E-Commerce Pricing

arXiv:2606.26787v1 Announce Type: cross Abstract: Traditional dynamic pricing models in large-scale e-commerce suffer from limited interpretability, poor utilization of unstructured information, and m

An Empirical Study of LLM-Generated Specifications for VeriFast

arXiv:2606.26490v1 Announce Type: cross Abstract: Static verification tools can assure industrial scale software, but require significant human labor to write specifications. This is particularly true

Analyzing and Encoding the Al-Mawrid Arabic-English Dictionary with the ISO Language Markup Framework and TEI Lex-0

arXiv:2606.18205v2 Announce Type: replace Abstract: This paper presents a robust methodology for the systematic digitization and encoding of the Al-Mawrid Arabic-English dictionary, transforming it fr

researcharxiv-cs-cl

Anatomy-Guided Residual Motion Diffusion for Controllable 4D Cardiac MRI Synthesis

arXiv:2606.26764v1 Announce Type: cross Abstract: Developing robust artificial intelligence models for 4D (3D + time) medical imaging is constrained by limited annotated data, inter-device domain shif

AnySimLite: A Lightweight Few-Shot Similarity Encoder for On-Device Speech-Adjacent Classification

arXiv:2606.26452v1 Announce Type: new Abstract: To minimize privacy concerns and inference latency on edge devices like smartphones, lightweight on-device models remain important for end-user applicat

local-aiarxiv-cs-cl

Application of LLMs to Threat Assessment of Foreign Peacekeeping Missions

arXiv:2606.27106v1 Announce Type: cross Abstract: We present a novel approach for applying Large Language Models (LLMs) to threat assessment in the context of foreign peacekeeping missions. Building o

Assert, don't describe: Linguistic features that shift LLM reasoning about animal welfare

arXiv:2606.26104v1 Announce Type: cross Abstract: Animal-welfare advocates produce a lot of writing, and increasingly that writing trains the language models that millions of people then ask about ani

Auditing Framing-Sensitive Behavioral Instability in Large Language Models for Mental Health Interactions

arXiv:2606.26982v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly being integrated into mental health support tools and other psychologically sensitive conversational app

Tutorials

Augmentation techniques for video surveillance in the visible and thermal spectral range

arXiv:2606.13042v2 Announce Type: replace Abstract: In intelligent video surveillance, cameras record image sequences during day and night. Commonly, this demands different sensors. To achieve a bette

tutorialsarxiv-cs-ai

Bayesian Optimization for General Reaction Conditions

model-releasesarxiv-cs-lg

arXiv:2502.18966v2 Announce Type: replace Abstract: General chemical reaction conditions that achieve consistently high performance across multiple substrates are important for practical applications

Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification

arXiv:2606.26698v1 Announce Type: cross Abstract: In today's fast-paced information era, logical fallacies, defined as defective patterns of reasoning, inevitably contribute to the growth of informati

Beyond Surface Forms: A Comprehensive, Mechanism-Oriented Taxonomy of Indirect Linguistic Encoding for LLM-Based Coded Language Detection

model-releasesarxiv-cs-cl

arXiv:2606.27314v1 Announce Type: new Abstract: To avoid moderation and surveillance on social media, some users routinely invent indirect linguistic expressions (ILE) that camouflage sensitive meanin

Boundary-Aware Context Grounding for A Low-Channel EEG Agent

arXiv:2606.26519v1 Announce Type: new Abstract: Large language models (LLMs) can make scientific software easier to use. However, a general model does not automatically know which measurements a parti

BOWConnect: Parallel Bayesian Optimization over Windows with Learned Local Cost Maps for Sample-Efficient Kinodynamic Motion Planning

model-releasesarxiv-cs-ro

arXiv:2606.27292v1 Announce Type: new Abstract: This paper presents BOWConnect, a bidirectional parallel kinodynamic motion planner that addresses three fundamental limitations of existing sampling-ba

Agents

Bridging Talk and Thought: Understanding Dialogue Dynamics Across Collaborative Problem-Solving Contexts

arXiv:2606.27233v1 Announce Type: cross Abstract: We present a conceptual framework for analyzing dialogue in collaborative problem-solving contexts, with an emphasis on the emerging dynamics of human

agentsarxiv-cs-ai

Byzantine-Robust Aggregation for Securing Decentralized Federated Learning

arXiv:2409.17754v2 Announce Type: replace-cross Abstract: Federated Learning (FL) emerges as a distributed machine learning approach that addresses privacy concerns by training AI models locally on de

local-aiarxiv-cs-ai

Can Large Language Models Reliably Code Qualitative Humanitarian Data? A Benchmark Study Against Human Expert Adjudication

model-releasesarxiv-cs-lg

arXiv:2606.26541v1 Announce Type: new Abstract: Data from affected populations are crucial for informing humanitarian response, but their value depends on timely and consistent interpretation of nuanc

Chai: Agentic Discovery of Cryptographic Misuse Vulnerabilities

arXiv:2606.26933v1 Announce Type: cross Abstract: AI-assisted vulnerability discovery has proven effective for bug classes like memory safety, where instrumentation confirms memory violations and effi

Charting the Growth of Social-Physical HRI (spHRI): A Systematic Review Pipeline Augmented by Small Language Models

arXiv:2606.26382v1 Announce Type: cross Abstract: Social-physical human-robot interaction (spHRI) has grown rapidly across robotics, human-computer interaction, human-robot interaction, and haptics. Y

Chisme: Heterogeneity-Aware Gossip Learning

arXiv:2505.09854v3 Announce Type: replace Abstract: As end-user device capability increases and demand for intelligent services at the Internet's edge rises, distributed learning has emerged as a key

local-aiarxiv-cs-lg

Applications

Circular Quasiconformal Deturbulence: Geometry-Based Restoration from Multiple Turbulent Frames

arXiv:2504.13432v3 Announce Type: replace Abstract: Imaging through inhomogeneous media often results in severe distortions, posing significant challenges to downstream image-processing tasks. The lac

applicationsarxiv-cs-cv

Comparing BERT Sentence-Pair Classification and Few-Shot LLM Prompting for Detecting Threat and Solution Framing in German Climate News

model-releasesarxiv-cs-cl

arXiv:2606.26489v1 Announce Type: new Abstract: News media play a central role in shaping public perceptions of climate change, and whether coverage emphasizes threats or solutions has measurable effe

Computational Analysis of Heart Rate Variability in Healthy Adults

arXiv:2606.26816v1 Announce Type: new Abstract: Heart Rate Variability (HRV) analysis is a key indicator of cardiac physiological state and aids in disease diagnosis. However, research on HRV paramete

Computationally-efficient Graph Modeling with Refined Graph Random Features

arXiv:2510.07716v2 Announce Type: replace Abstract: We propose refined GRFs (GRFs++), a new class of Graph Random Features (GRFs) for efficient and accurate computations involving kernels defined on t

researcharxiv-cs-lg

Computer Vision for MOBA Analytics: A Dataset and Baseline for Visibility Analysis in Dota 2

arXiv:2606.26970v1 Announce Type: new Abstract: Introduction: Most Multiplayer Online Battle Arena (MOBA) analytics studies rely on structured data, which does not directly capture what each team coul

researcharxiv-cs-cv

Controllable Egocentric Video Generation via Occlusion-Aware Sparse 3D Hand Joints

arXiv:2603.11755v2 Announce Type: replace Abstract: Controllable video generation for complex hand-object interactions is a critical step toward building visual world models. However, existing methods

researcharxiv-cs-cv

Agents

COrigami: An AI Pipeline for Co-Designing Flat-Foldable Visually Recognisable Origami

arXiv:2606.26299v1 Announce Type: new Abstract: While generative AI has achieved remarkable success in solving problems with verifiable solutions, generating physical art that satisfies both strict ge

agentsarxiv-cs-ai

CSU-PCAST: A Dual-Branch Transformer Framework for medium-range ensemble Precipitation Forecasting

arXiv:2510.20769v2 Announce Type: replace-cross Abstract: Accurate medium-range precipitation forecasting is essential for hydrometeorological risk management but remains challenging for both numerica

safetyarxiv-cs-lg

Depth-Semantic Alignment and Affinity-Guided Fusion for Structured Radar Point Cloud Generation

arXiv:2606.26743v1 Announce Type: new Abstract: Point clouds are an important carrier of three-dimensional spatial information, and their quality directly affects the performance of downstream percept

safetyarxiv-cs-cv

Designing Reward Signals for Portable Query Generation: A Case Study in Industrial Semantic Job Search

arXiv:2606.27291v1 Announce Type: new Abstract: Job-search platforms rely on low-bandwidth query interfaces that often fail to capture the high-dimensional complexity of candidate profiles. We present

safetyarxiv-cs-lg

Detecting and Controlling Sycophancy with Cascading Linear Features

arXiv:2606.26155v1 Announce Type: new Abstract: Interpreting and controlling model behaviors through activation steering methods requires many pairs of contrastive samples that clearly exhibit desired

Diagnosing Task Insensitivity in Language Agents

arXiv:2606.26918v1 Announce Type: new Abstract: Large language models can serve as capable long-horizon agents, but their out-of-distribution (OOD) generalization remains weak. We identify a key sourc

Applications

Discovering Millions of Interpretable Features with Sparse Autoencoders

arXiv:2606.26620v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) have emerged as a powerful tool for decomposing superposed language model representations into sparse and interpretable fea

applicationsarxiv-cs-ai

DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents

arXiv:2606.26122v1 Announce Type: new Abstract: Recent methods train search agents via reinforcement learning from (question, answer, evidence) tuples without requiring expert trajectories. The tuples

safetyarxiv-cs-cv

Does AI Reviewer See the Full Picture? Attacking and Defending Multimodal Peer Review

model-releasesarxiv-cs-cl

arXiv:2606.12716v2 Announce Type: replace Abstract: The integration of Large Language Models (LLMs) and Multimodal LLMs (MLLMs) into scientific peer-review workflows introduces novel and significant r

DroidBreaker: Practical and Functional Problem-Space Attacks on Machine-Learning Android Malware Detectors

arXiv:2606.26707v1 Announce Type: cross Abstract: Adversarial APKs are Android applications modified in the problem space to evade machine-learning malware detectors. In this work, we first show that,

researcharxiv-cs-lg

EMA-FS: Accelerating GBDT Training via Gain-Informed Feature Screening

model-releasesarxiv-cs-lg

arXiv:2606.26337v1 Announce Type: new Abstract: Gradient Boosted Decision Trees (GBDT), exemplified by LightGBM, spend a dominant fraction of training time -- typically 65-70% -- constructing per-feat

EO-WM: A Physically Informed World Model for Probabilistic Earth Observation Forecasting

arXiv:2606.27277v1 Announce Type: new Abstract: Earth Observation (EO) forecasting aims to predict future Earth surface dynamics from satellite observations under changing meteorological conditions. I

Erase-then-Delta Attention: Decoupling Erase and Write Addresses in Delta-Rule Linear Attention

arXiv:2606.26560v1 Announce Type: new Abstract: Delta-rule linear attention improves recurrent memory updates by correcting what is already stored at the current write address before writing new conte

researcharxiv-cs-cl

Estimating Uncertainty in Classifier Performance with Applications to Large Language Models and Nested Data

arXiv:2606.26422v1 Announce Type: new Abstract: Researchers increasingly use text classification--supervised models or large language models--to measure constructs from natural language, providing met

EVOM: Agentic Meta-Evolution of Actor-Critic Architectures for Reinforcement Learning

arXiv:2606.26327v1 Announce Type: cross Abstract: In actor-critic reinforcement learning, network architectures are typically manually designed. Automating this design is challenging because each cand