Search: “evaluation”

TextSculptor: Training and Benchmarking Scene Text Editing

arXiv:2605.21090v1 Announce Type: new Abstract: Recent advances in Multimodal Large Language Models (MLLMs) and diffusion-based generative models have substantially improved prompt-driven image editin

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Unsupervised clustering and classification of upper limb EMG signals during functional movements: a data-driven

DGX agent

arXiv:2605.20599v1 Announce Type: new Abstract: This study presents a comprehensive approach for the clustering and classification of upper-limb surface electromyography (sEMG) signals during function

researcharxiv-cs-lg

21 May 2026

Applications

Validating Navmesh using Geometry: Voxel-Based Analysis with Prioritized Exploration

arXiv:2605.21397v1 Announce Type: cross Abstract: Navigation mesh (Navmesh) inconsistencies affect the player experience by directly impacting the navigation systems used by non-playable characters (N

applicationsarxiv-cs-ro

Verifiable Provenance and Watermarking for Generative AI: An Evidentiary Framework for International Operational Law and Domestic Courts

arXiv:2605.21002v1 Announce Type: cross Abstract: Generative artificial intelligence now synthesizes photorealistic imagery, audio, and video at a cost that defeats traditional forensic intuition. The

VLANeXt: Recipes for Building Strong VLA Models

arXiv:2602.18532v2 Announce Type: replace Abstract: Following the rise of large foundation models, Vision-Language-Action models (VLAs) emerged, leveraging strong visual and language understanding fro

safetyarxiv-cs-cv

WCXB: A Multi-Type Web Content Extraction Benchmark

arXiv:2605.21097v1 Announce Type: new Abstract: Web content extraction - isolating a page's main content from surrounding boilerplate - is a prerequisite for search indexing, retrieval-augmented gener

What Do Biomedical NER and Entity Linking Benchmarks Measure? A Corpus-Centric Diagnostic Framework

arXiv:2605.20537v1 Announce Type: new Abstract: Biomedical named entity recognition (NER) and entity linking (EL) strongly depend on annotated corpora, but the utility of these resources for benchmark

What Semantics Survive the Connector? Diagnosing VLM-to-DiT Alignment in Video Editing

arXiv:2605.20795v1 Announce Type: new Abstract: Flow matching based video generative models have been increasingly relying on prepended Vision-Language Models (VLMs) to handle complex, instruction-bas

safetyarxiv-cs-cv

Adversarial Stress Testing of SPARK Humanoid Safety Filters

model-releasesarxiv-cs-ro

arXiv:2605.19009v1 Announce Type: new Abstract: Humanoid robots are difficult to deploy safely because they have high-dimensional bodies, many collision constraints, and must operate near people and o

Aero-World: Action-Conditioned Aerial Video Generation from Inertial Controls

arXiv:2605.19728v1 Announce Type: new Abstract: Foundation video models produce visually impressive results, but their use in embodied AI remains limited because they are primarily trained on natural

Agent Meltdowns: The Road to Hell Is Paved with Helpful Agents

arXiv:2605.19149v1 Announce Type: new Abstract: Agents operating with computer and Web use inevitably encounter errors: inaccessible webpages, missing files, local and remote misconfigurations, etc. T

Agents

Agentic GraphRAG: Navigating Unstructured Financial Data with Collaborative AI

arXiv:2605.18770v1 Announce Type: cross Abstract: We present a collaborative agentic GraphRAG framework for expert analysis of commercial registry data. Public registries are often formally accessible

agentsarxiv-cs-ai

Agents

Agentic Trading: When LLM Agents Meet Financial Markets

arXiv:2605.19337v1 Announce Type: new Abstract: A growing body of work explores how Large Language Models (LLMs) can be embedded in trading systems as agents that perceive market information, retrieve

agentsarxiv-cs-ai

Applications

An Integrated Forecasting Prototype for Emergency Department Boarding Time to Support Proactive Operational Decision Making

arXiv:2605.18839v1 Announce Type: cross Abstract: Overcrowding in emergency departments (ED) remains a persistent operational challenge worldwide, causing delays in care delivery and downstream conges

applicationsarxiv-cs-ai

BLINKG: A Benchmark for LLM-Integrated Knowledge Graph Generation

arXiv:2605.19518v1 Announce Type: new Abstract: Generating Knowledge Graphs (KGs) remains one of the most time-consuming and labor-intensive tasks for knowledge engineers, as they need to identify sem

CADENet: Condition-Adaptive Asynchronous Dual-Stream Enhancement Network for Adverse Weather Perception in Autonomous Driving

arXiv:2605.19837v1 Announce Type: cross Abstract: Adverse weather (rain, fog, sand, and snow) degrades camera-based object detection in autonomous vehicles. Existing enhancement-then-detect approaches

safetyarxiv-cs-ai

Can Large Language Models Revolutionize Survey Research? Experiments with Disaster Preparedness Responses

arXiv:2605.19229v1 Announce Type: new Abstract: Survey research faces mounting structural challenges: declining response rates, sample bias, block-wise missingness among at-risk respondents, and AI-as

safetyarxiv-cs-ai

ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning

arXiv:2605.20176v1 Announce Type: new Abstract: Large language models (LLMs) and agentic systems have shown promise for clinical decision support, but existing works largely assume that evidence has a

DecisionBench: A Benchmark for Emergent Delegation in Long-Horizon Agentic Workflows

arXiv:2605.19099v1 Announce Type: new Abstract: We introduce DecisionBench, a benchmark substrate for emergent delegation in long-horizon agentic workflows. The substrate fixes a task suite (GAIA, tau

Disentangling generalization and memorization in large language models using chess

arXiv:2601.16823v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) exhibit remarkable capabilities, yet it remains unclear to what extent these reflect sophisticated recall or genu

Efficient Pre-Training with Token Superposition

arXiv:2605.06546v2 Announce Type: replace Abstract: Pre-training of Large Language Models is often prohibitively expensive and inefficient at scale, requiring complex and invasive modifications in ord

researcharxiv-cs-cl

EgoBabyVLM: Benchmarking Cross-Modal Learning from Naturalistic Egocentric Video Data

arXiv:2605.19130v1 Announce Type: cross Abstract: Children acquire language grounding with remarkable robustness from limited visuo-linguistic input in ways that surpass today's best large multimodal

EmbGen: Teaching with Reassembled Corpora

arXiv:2605.19394v1 Announce Type: cross Abstract: Adapting small instruction-tuned models to specialized domains often relies on supervised fine-tuning (SFT) on curated instruction-response examples,

Euclidean Embedding of Data Using Local Distances

arXiv:2605.19243v1 Announce Type: cross Abstract: We study the problem of recovering a globally consistent Euclidean embedding of data, given only a local distance graph and propose a method that opti

Eyes on VLM: Benchmarking Gaze Following and Social Gaze Prediction in Vision Language Models

arXiv:2605.19859v1 Announce Type: new Abstract: Vision-language models (VLMs) have rapidly evolved into general-purpose multimodal reasoners with strong zero-shot generalization. In this context, VLMs

researcharxiv-cs-cv

FineBench: Benchmarking and Enhancing Vision-Language Models for Fine-grained Human Activity Understanding

arXiv:2605.19846v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have demonstrated remarkable capabilities in general video understanding, yet they often struggle with the fine-grained

FLUXtrapolation: A benchmark on extrapolating ecosystem fluxes

arXiv:2605.19812v1 Announce Type: cross Abstract: We introduce FLUXtrapolation, a benchmark for extrapolating ecosystem fluxes under progressively harder distribution shifts. Ecosystem fluxes are cent

GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignment

arXiv:2605.19577v1 Announce Type: new Abstract: We present GoLongRL, a fully open-source, capability-oriented post-training recipe for long-context reinforcement learning with verifiable rewards (RLVR

GoTTA be Diverse: Rethinking Memory Policies for Test-Time Adaptation

arXiv:2605.19890v1 Announce Type: new Abstract: Test-time adaptation (TTA) enables a pre-trained model to adapt online to an unlabeled test stream under distribution shift. While most TTA research foc

How Do Document Parsers Break? Auditing Structural Vulnerability in Document Intelligence

arXiv:2605.19309v1 Announce Type: new Abstract: Document Layout Analysis (DLA) pipelines provide structured page representations for retrieval-augmented generation, long-document question answering, a

safetyarxiv-cs-cl

Local Ai

INSIGHTS: Demonstration-Based Summaries of Time Series Predictors

arXiv:2605.18849v1 Announce Type: cross Abstract: Explainability methods have progressed rapidly, but global explanations for time-series models remain underdeveloped, with most approaches focusing on

local-aiarxiv-cs-ai

Learning Long-Term Temporal Dependencies in Photovoltaic Power Output Prediction Through Multi-Horizon Forecasting

arXiv:2605.19074v1 Announce Type: cross Abstract: The rapid global expansion of solar photovoltaic (PV) capacity-reaching a record 597 GW in 2024-highlights the urgent need for robust forecasting mode

Mind Your Moras: Orthography-Aware Error Analysis of Neural Japanese Morphological Generation

arXiv:2605.20043v1 Announce Type: new Abstract: We present an orthography-aware error analysis of Japanese past-tense morphological inflection, treating hiragana not merely as a transcriptional medium

researcharxiv-cs-cl

MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Models

arXiv:2605.20128v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly integrated into high-stakes decision-making. Inspired by the theory of inattentional blindness in human co

MO-CAPO: Multi-Objective Cost-Aware Prompt Optimization

arXiv:2605.18869v1 Announce Type: cross Abstract: Large language models (LLMs) achieve strong performance across a wide range of tasks but are highly sensitive to prompt design, motivating the need fo

MSAlign: Aligning Molecule and Mass Spectra Foundation Models for Metabolite Identification

model-releasesarxiv-cs-lg

arXiv:2605.19752v1 Announce Type: new Abstract: Accurately identifying metabolites i.e. small molecules from mass spectrometry data remains a core challenge in metabolomics, with broad applications in

NGL: Natural Garment Language for Training-Free Sewing Pattern Estimation

arXiv:2602.20700v2 Announce Type: replace Abstract: Estimating sewing patterns from images is a practical approach for creating high-quality 3D garments, but it remains challenging due to the scarcity

OpenComputer: Verifiable Software Worlds for Computer-Use Agents

arXiv:2605.19769v1 Announce Type: new Abstract: We present OpenComputer, a verifier-grounded framework for constructing verifiable software worlds for computer-use agents. OpenComputer integrates four

Physics-informed simulation framework for realistic sonar image generation and statistical validation

arXiv:2605.19712v1 Announce Type: new Abstract: Synthetic sonar datasets offer a scalable alternative to costly real-world acquisition, yet their utility remains limited by the absence of rigorous qua

safetyarxiv-cs-cv

Agents

Probing Embodied LLMs: When Higher Observation Fidelity Hurts Problem Solving

arXiv:2605.20072v1 Announce Type: new Abstract: Large Language Models are increasingly proposed as cognitive components for robotic systems, yet their opaque decision processes make it difficult to ex

agentsarxiv-cs-ai

Applications

Quantized Machine Learning Models for Medical Imaging in Low-Resource Healthcare Settings

arXiv:2605.19207v1 Announce Type: cross Abstract: Deep learning models have shown strong performance in medical image analysis, but deploying them in low-resource clinical environments remains difficu

applicationsarxiv-cs-ai

Local Ai

Query-Conditioned Graph Retrieval for Contextualized LLM Reasoning in Personalized Wearable Data

arXiv:2605.18763v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly applied to analyzing wearable sensing data, which are long-term, multimodal, and highly personalized. A

local-aiarxiv-cs-ai

Sequential Consensus for Multi-Agent LLM Debates: A Wald-SPRT compute governor with calibration-based failure detection

model-releasesarxiv-cs-lg

arXiv:2605.19193v1 Announce Type: new Abstract: Multi-agent LLM debate improves factuality and reasoning, but most recipes pick a fixed round count, over-spending on easy items and under-spending on h

Sonar-TS: Search-Then-Verify Natural Language Querying for Time Series Databases

arXiv:2602.17001v2 Announce Type: replace Abstract: Natural Language Querying for Time Series Databases (NLQ4TSDB) aims to assist non-expert users retrieve meaningful events, intervals, and summaries

Synthetic Data Generation for Brain-Computer Interfaces: Overview, Benchmarking, and Future Directions

arXiv:2603.12296v2 Announce Type: replace-cross Abstract: Deep learning has achieved transformative performance across diverse domains, largely driven by large-scale and high-quality training data. In

WARC-Bench: Web Archive Based Benchmark for GUI Subtask Executions

arXiv:2510.09872v2 Announce Type: replace-cross Abstract: Training web agents to navigate complex, real-world websites requires them to master extit{subtasks} - short-horizon interactions on multiple

World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Tasks

arXiv:2605.19957v1 Announce Type: cross Abstract: World models are widely explored in embodied intelligence, yet they typically predict distinct evolutions of the world and the ego within a single str

A-ProS: Towards Reliable Autonomous Programming Through Multi-Model Feedback

arXiv:2605.18073v1 Announce Type: cross Abstract: Large Language Models (LLMs) demonstrate strong potential for automated code generation, yet their ability to iteratively refine solutions using execu