Search: “evaluation”

Estimating Item Difficulty with Large Language Models as Experts

arXiv:2605.18562v1 Announce Type: cross Abstract: Accurate estimates of item difficulty are essential for valid assessment and effective adaptive learning. However, for newly created tasks, response d

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Event-Grounded Sparse Autoencoders for Vision-Language-Action Policies

DGX agent

arXiv:2605.17204v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) policies translate language and visual inputs into robot actions, where their hidden representations directly shape close

safetyarxiv-cs-ai

19 May 2026

Evidence-Grounded Frontier Mapping and Agentic Hypothesis Generation in Nanomedicine

arXiv:2605.18144v1 Announce Type: new Abstract: Nanomedicine research spans delivery chemistry, immunology, imaging, biomaterials, and disease-specific translational science, yet its conceptual design

Evolve the Method, Not the Prompts: Evolutionary Synthesis of Jailbreak Attacks on LLMs

model-releasesarxiv-cs-cl

arXiv:2511.12710v2 Announce Type: replace Abstract: Automated red teaming frameworks for Large Language Models (LLMs) have become increasingly sophisticated, yet many still formulate attack optimizati

EXG: Self-Evolving Agents with Experience Graphs

arXiv:2605.17721v1 Announce Type: new Abstract: Large language model (LLM)-based agents have demonstrated strong capabilities in complex reasoning and problem solving through multi-step interactions,

Explicit Logic Channel for Validation and Enhancement of MLLMs on Zero-Shot Tasks

arXiv:2603.11689v2 Announce Type: replace Abstract: Frontier Multimodal Large Language Models (MLLMs) exhibit remarkable capabilities in Visual-Language Comprehension (VLC) tasks. However, they are of

extit{Don't Guess, Just Ask}: Resolving Ambiguity in Referring Segmentation via Multi-turn Clarification

model-releasesarxiv-cs-cv

arXiv:2605.17531v1 Announce Type: new Abstract: Referring segmentation aims to segment the target objects in images or videos based on the textual query. Despite remarkable progress over the past year

F2IND-IT! -- Multimodal Fuzzy Fake Indian News Detection using Images and Text

arXiv:2605.17115v1 Announce Type: new Abstract: Biased manipulation of facts across regional and national media outlets complicates misinformation detection in diverse landscapes like India. This pape

Factorized Latent Dynamics for Video JEPA: An Empirical Study of Auxiliary Objectives

arXiv:2605.17165v1 Announce Type: new Abstract: Joint-Embedding Predictive Architectures (JEPA) are a promising framework for self-supervised video representation learning, yet the behavior of auxilia

FAM-HRI: Foundation-Model Assisted Multi-Modal Human-Robot Interaction Combining Gaze and Speech

model-releasesarxiv-cs-ro

arXiv:2503.16492v3 Announce Type: replace-cross Abstract: ffective Human-Robot Interaction (HRI) is crucial for enhancing accessibility and usability in real-world robotics applications. However, exis

Fast Kernel-Space Diffusion for Remote Sensing Pansharpening

model-releasesarxiv-cs-cv

arXiv:2505.18991v3 Announce Type: replace Abstract: Pansharpening seeks to fuse high-resolution panchromatic (PAN) and low-resolution multispectral (LRMS) images into a single image with both fine spa

Applications

Federated Distillation on Edge Devices: Efficient Client-Side Filtering for Non-IID Data

arXiv:2508.14769v2 Announce Type: replace Abstract: Federated distillation has emerged as a promising collaborative machine learning approach, offering enhanced privacy protection and reduced communic

applicationsarxiv-cs-lg

FEG-Pro: Forecast-Error Growth Profiling for Finite-Horizon Instability Analysis of Nonlinear Time Series

arXiv:2605.17282v1 Announce Type: cross Abstract: Estimating the largest Lyapunov exponent from a scalar time series is difficult when the governing equations, tangent dynamics, and full state vector

researcharxiv-cs-lg

Tutorials

Few-Shot Network Intrusion Detection Using Online Triplet Mining

arXiv:2605.17530v1 Announce Type: cross Abstract: Network intrusion detection systems play a vital role in protecting networks by detecting malicious network traffic which can then be investigated by

tutorialsarxiv-cs-ai

Fidelity Probes for Specification--Code Alignment

arXiv:2605.17246v1 Announce Type: cross Abstract: We introduce fidelity probes: natural-language questions generated from a reference artifact with code-derived ground-truth answers, answered from a c

Fine-tuning Pocket-Aware Diffusion Models via Denoising Policy Optimization

arXiv:2605.17693v1 Announce Type: cross Abstract: Structure-based drug design has been accelerated by pocket-aware 3D generative models, yet most methods primarily fit the training distribution and ma

Firefly: Illuminating Large-Scale Verified Tool-Call Data Generation from Real APIs

model-releasesarxiv-cs-cl

arXiv:2605.17558v1 Announce Type: cross Abstract: Training tool-calling agents requires large-scale trajectory data with verifiable labels, yet existing approaches either synthesize environments that

FLAG: Foundation model representation with Latent diffusion Alignment via Graph for spatial gene expression prediction

arXiv:2605.18055v1 Announce Type: cross Abstract: Predicting spatial gene expression from routine H&E enables large-scale molecular profiling, yet current models treat this as isolated pointwise tasks

FML-bench: A Controlled Study of AI Research Agent Strategies from the Perspective of Search Dynamics

arXiv:2605.17373v1 Announce Type: cross Abstract: AI research agents accelerate ML research by automating hypothesis generation, experimentation, and empirical refinement. Existing agent strategies ra

FOL2NS: Generating Natural Sentences from First-Order Logic

arXiv:2605.18155v1 Announce Type: new Abstract: Translating formal language into natural language is a foundational challenge in NLP, driving various downstream applications in semantic parsing, theor

researcharxiv-cs-cl

Form and Function: Machine Unlearning as a Problem of Misaligned States

model-releasesarxiv-cs-lg

arXiv:2605.17590v1 Announce Type: new Abstract: We formulate machine unlearning for online L-BFGS as a counterfactual state-alignment problem. Given an actual event stream and a deletion-edited counte

Foundation Models for Credit Risk Prediction: A Game Changer?

arXiv:2605.18147v1 Announce Type: new Abstract: Predictive models play a pivotal role in credit risk management, guiding critical decisions through accurate estimation of default probabilities and los

researcharxiv-cs-lg

fPINN-DeepONet: A Physics-Informed Operator Learning Framework for Multi-term Time-fractional Mixed Diffusion-wave Equations

arXiv:2605.16594v1 Announce Type: cross Abstract: In this paper, we develop a physics-informed deep operator learning framework for solving multi-term time-fractional mixed diffusion-wave equations (T

researcharxiv-cs-lg

From Prompts to Protocols: An AI Agent for Laboratory Automation

arXiv:2605.16552v1 Announce Type: new Abstract: Automating science laboratories enables faster, safer, more accurate, and more reproducible execution of protocols, accelerating the discovery and testi

From Reactive to Proactive: A Multi-Regulatory Empirical Analysis of 480 AI Incidents and a Data-Driven Governance Compliance Framework

arXiv:2605.16281v1 Announce Type: cross Abstract: Artificial intelligence systems are increasingly deployed in high-stakes domains, yet it remains unclear whether existing governance frameworks ensure

Functionalization via Structure Completion and Motion Rectification

arXiv:2605.18010v1 Announce Type: new Abstract: Acquisition and creation of 3D assets have been largely view- or appearance-driven. As a result, existing digital 3D models often lack the requisite str

FUSE: A Framework for Unified State Estimation in Robotic SLAM Systems

arXiv:2605.18047v1 Announce Type: new Abstract: Tightly coupled SLAM formulations under mixed-rate sensing often bind temporal processing, local geometric association, estimator formulation, and map-u

safetyarxiv-cs-ro

Generating Realistic Safety-Critical Scenarios for Vehicle-Pedestrian Interactions

arXiv:2605.17229v1 Announce Type: new Abstract: Automated driving system deployment requires rigorous validation across safety-critical vehicle-pedestrian interactions, yet real-world datasets rarely

safetyarxiv-cs-ro

Genflow Ad Studio: A Compound AI Architecture for Brand-Aligned, Self-Correcting Video Generation

arXiv:2605.16748v1 Announce Type: cross Abstract: Recent advancements in generative video models demonstrate high visual fidelity, yet their integration into enterprise environments is restricted by t

GenTS: A Comprehensive Benchmark Library for Generative Time Series Models

model-releasesarxiv-cs-lg

arXiv:2605.17804v1 Announce Type: new Abstract: Generative models have demonstrated remarkable potential in time series analysis tasks, like synthesis, forecasting, imputation, etc. However, offering

GeoFlow: Enforcing Implicit Geometric Consistency in Video Generation

arXiv:2605.18365v1 Announce Type: new Abstract: Generating geometrically consistent videos remains an open challenge: text-to-video diffusion models trained on web-scale data treat geometry only impli

Geometry-Aware Surrogate for Real-Time Hydrodynamics Estimation of Autonomous Ground Vehicles in Amphibious Environments

arXiv:2605.18543v1 Announce Type: new Abstract: Autonomous ground vehicles operating in shallow water or flood-prone terrains require dynamic models that account for hydrodynamic forces. However, the

agentsarxiv-cs-ro

GeoSym127K: Scalable Symbolically-verifiable Synthesis for Multimodal Geometric Reasoning

arXiv:2605.16371v1 Announce Type: cross Abstract: Large Multimodal Models (LMMs) often struggle with geometric reasoning due to visual hallucinations and a lack of mathematically precise Chain-of-Thou

GeoWorld-VLM: Geometry from World Models for Vision-Language Models

arXiv:2605.16713v1 Announce Type: cross Abstract: Modern Vision-Language Models (VLMs) achieve strong semantic recognition, yet remain brittle on elementary spatial relations such as left of, on, behi

Goal-Conditioned Supervised Learning for LLM Fine-Tuning

arXiv:2605.16345v1 Announce Type: cross Abstract: Large language models often require fine-tuning to better align their behavior with user intent at deployment. Existing approaches are commonly divide

GraphMind: From Operational Traces to Self-Evolving Workflow Automation

arXiv:2605.17617v1 Announce Type: new Abstract: Complex operational workflows coordinating personnel, tools, and information are central to enterprise operations, yet end-to-end automation remains cha

great deep dive into how we built LangSmith Engine lots of fun learnings and tips and tricks

Harrison Chase provides a detailed technical overview of the architecture and development process behind LangSmith Engine, sharing key learnings and practical tips accumulated during its construction.

agentsharrison-chase--x

Hardware

Guard: Scalable Straggler Detection and Node Health Management for Large-Scale Training

arXiv:2605.17879v1 Announce Type: cross Abstract: Training frontier-scale foundation models involves coordinating tens of thousands of GPUs over multi-month runs, where even minor performance degradat

hardwarearxiv-cs-ai

GUT-IS: A Data-Driven Approach to Integrating Constructs and Their Relations in Information Systems

arXiv:2605.18567v1 Announce Type: new Abstract: Structural equation modeling is widely used in IS research. However, inconsistent construct definitions impede the cumulative development of knowledge.

researcharxiv-cs-cl

Hardware

Hawkeye: Reproducing GPU-Level Non-Determinism

arXiv:2603.20421v2 Announce Type: replace-cross Abstract: We present Hawkeye, a system for analyzing and reproducing GPU-level arithmetic operations. Using our framework, anyone can re-execute on a CP

hardwarearxiv-cs-lg

Local Ai

Herding CATs: ALARA for Agent Harness Engineering in Portable Composable Multi-Agent Teams

arXiv:2603.20380v2 Announce Type: replace-cross Abstract: Industry practitioners and academic researchers regularly use multi-agent systems to accelerate their work, but the applications through which

local-aiarxiv-cs-ai

Hierarchical Two-Stage Framework for Environment-Aware Long-Horizon Vessel Trajectory Prediction

arXiv:2605.16442v1 Announce Type: cross Abstract: Long-horizon vessel trajectory forecasting under real ocean conditions is critical for collision avoidance, traffic management, and route planning. Ho

Applications

HighSync: High-Quality Lip Synchronization via Latent Diffusion Models

arXiv:2605.16918v1 Announce Type: new Abstract: We present HighSync, an end-to-end diffusion-based framework for high-fidelity lip synchronization that generates photorealistic talking-face videos ali

applicationsarxiv-cs-cv

HPC-LLM: Practical Domain Adaptation and Retrieval-Augmented Generation for HPC Support

model-releasesarxiv-cs-lg

arXiv:2605.16347v1 Announce Type: new Abstract: Modern scientific research increasingly depends on High-Performance Computing (HPC) infrastructures, yet many researchers face significant operational b

Human-Flow Digital Twin for Predicting the Effects of Mobility Introduction on Visitor Circulation

arXiv:2605.17426v1 Announce Type: cross Abstract: We propose a framework for predicting the effects of mobility introduction measures using a human-flow digital twin. This digital twin incorporates a

agentsarxiv-cs-lg

Image-to-Video Diffusion: From Foundations to Open Frontiers

arXiv:2605.17248v1 Announce Type: new Abstract: Diffusion-based extit{image-to-video} (I2V) generation has become a central direction in generative models by turning a reference image, with optional c

Improving MLLM Training Efficiency via Stage-Aware Sparsity

arXiv:2509.18150v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) have demonstrated outstanding performance across a variety of domains. However, training MLLMs is oft

Applications

Improving Spatio-Temporal Residual Error Propagation by Mitigating Over-Squashing

arXiv:2605.18068v1 Announce Type: cross Abstract: Residual error propagation remains a fundamental problem in recurrent models, where small prediction inaccuracies compound over time and degrade long-

applicationsarxiv-cs-ai