Search: “evaluation”

How Do Document Parsers Break? Auditing Structural Vulnerability in Document Intelligence

arXiv:2605.19309v1 Announce Type: new Abstract: Document Layout Analysis (DLA) pipelines provide structured page representations for retrieval-augmented generation, long-document question answering, a

safetyarxiv-cs-cl

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

INSIGHTS: Demonstration-Based Summaries of Time Series Predictors

DGX agent

arXiv:2605.18849v1 Announce Type: cross Abstract: Explainability methods have progressed rapidly, but global explanations for time-series models remain underdeveloped, with most approaches focusing on

local-aiarxiv-cs-ai

20 May 2026

Learning Long-Term Temporal Dependencies in Photovoltaic Power Output Prediction Through Multi-Horizon Forecasting

arXiv:2605.19074v1 Announce Type: cross Abstract: The rapid global expansion of solar photovoltaic (PV) capacity-reaching a record 597 GW in 2024-highlights the urgent need for robust forecasting mode

Mind Your Moras: Orthography-Aware Error Analysis of Neural Japanese Morphological Generation

arXiv:2605.20043v1 Announce Type: new Abstract: We present an orthography-aware error analysis of Japanese past-tense morphological inflection, treating hiragana not merely as a transcriptional medium

researcharxiv-cs-cl

MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Models

model-releasesarxiv-cs-cl

arXiv:2605.20128v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly integrated into high-stakes decision-making. Inspired by the theory of inattentional blindness in human co

MO-CAPO: Multi-Objective Cost-Aware Prompt Optimization

arXiv:2605.18869v1 Announce Type: cross Abstract: Large language models (LLMs) achieve strong performance across a wide range of tasks but are highly sensitive to prompt design, motivating the need fo

MSAlign: Aligning Molecule and Mass Spectra Foundation Models for Metabolite Identification

arXiv:2605.19752v1 Announce Type: new Abstract: Accurately identifying metabolites i.e. small molecules from mass spectrometry data remains a core challenge in metabolomics, with broad applications in

NGL: Natural Garment Language for Training-Free Sewing Pattern Estimation

arXiv:2602.20700v2 Announce Type: replace Abstract: Estimating sewing patterns from images is a practical approach for creating high-quality 3D garments, but it remains challenging due to the scarcity

OpenComputer: Verifiable Software Worlds for Computer-Use Agents

arXiv:2605.19769v1 Announce Type: new Abstract: We present OpenComputer, a verifier-grounded framework for constructing verifiable software worlds for computer-use agents. OpenComputer integrates four

Physics-informed simulation framework for realistic sonar image generation and statistical validation

arXiv:2605.19712v1 Announce Type: new Abstract: Synthetic sonar datasets offer a scalable alternative to costly real-world acquisition, yet their utility remains limited by the absence of rigorous qua

safetyarxiv-cs-cv

Agents

Probing Embodied LLMs: When Higher Observation Fidelity Hurts Problem Solving

arXiv:2605.20072v1 Announce Type: new Abstract: Large Language Models are increasingly proposed as cognitive components for robotic systems, yet their opaque decision processes make it difficult to ex

agentsarxiv-cs-ai

Applications

Quantized Machine Learning Models for Medical Imaging in Low-Resource Healthcare Settings

arXiv:2605.19207v1 Announce Type: cross Abstract: Deep learning models have shown strong performance in medical image analysis, but deploying them in low-resource clinical environments remains difficu

applicationsarxiv-cs-ai

Local Ai

Query-Conditioned Graph Retrieval for Contextualized LLM Reasoning in Personalized Wearable Data

arXiv:2605.18763v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly applied to analyzing wearable sensing data, which are long-term, multimodal, and highly personalized. A

local-aiarxiv-cs-ai

Sequential Consensus for Multi-Agent LLM Debates: A Wald-SPRT compute governor with calibration-based failure detection

arXiv:2605.19193v1 Announce Type: new Abstract: Multi-agent LLM debate improves factuality and reasoning, but most recipes pick a fixed round count, over-spending on easy items and under-spending on h

Sonar-TS: Search-Then-Verify Natural Language Querying for Time Series Databases

arXiv:2602.17001v2 Announce Type: replace Abstract: Natural Language Querying for Time Series Databases (NLQ4TSDB) aims to assist non-expert users retrieve meaningful events, intervals, and summaries

Synthetic Data Generation for Brain-Computer Interfaces: Overview, Benchmarking, and Future Directions

arXiv:2603.12296v2 Announce Type: replace-cross Abstract: Deep learning has achieved transformative performance across diverse domains, largely driven by large-scale and high-quality training data. In

Agents

the first step to building evals is often times figuring out what you want to eval (sounds simple, in practice it has a lot of nuance)

the first step to building evals is often times figuring out what you want to eval (sounds simple, in practice it has a lot of nuance) you can condense long horizon evals with agents into smaller subs

agentsharrison-chase--x

WARC-Bench: Web Archive Based Benchmark for GUI Subtask Executions

arXiv:2510.09872v2 Announce Type: replace-cross Abstract: Training web agents to navigate complex, real-world websites requires them to master extit{subtasks} - short-horizon interactions on multiple

World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Tasks

arXiv:2605.19957v1 Announce Type: cross Abstract: World models are widely explored in embodied intelligence, yet they typically predict distinct evolutions of the world and the ego within a single str

A-ProS: Towards Reliable Autonomous Programming Through Multi-Model Feedback

arXiv:2605.18073v1 Announce Type: cross Abstract: Large Language Models (LLMs) demonstrate strong potential for automated code generation, yet their ability to iteratively refine solutions using execu

A Scalable Tool for Measuring Manner and Result Verbs in Developmental Language Research

arXiv:2605.16654v1 Announce Type: cross Abstract: Manner and result verbs encode different aspects of event structure and have been discussed in developmental work as a potentially informative distinc

A2RBench: An Automatic Paradigm for Formally Verifiable Abstract Reasoning Benchmark Generation

arXiv:2605.17278v1 Announce Type: new Abstract: Abstract reasoning ability reflects the intelligence and generalization capacity of LLMs to extract and apply abstract rules. However, accurately measur

Applications

An Analytical Multiple Criteria Framework for Temporal and Dynamic Business-to-Business Customer Segmentation in Manufacturing

arXiv:2605.17151v1 Announce Type: new Abstract: In sales and marketing, customer segmentation is an important tool for formulating strategies for customer treatment and supply chain management. Most s

applicationsarxiv-cs-lg

An Efficient Machine Learning-based Framework for Detection and Prevention of Frauds in Telecom Networks

arXiv:2605.17245v1 Announce Type: cross Abstract: Telecommunication fraud is an acute problem that leads to substantial material losses and compromises the reliability of telecom systems worldwide. On

researcharxiv-cs-lg

Are Sparse Autoencoder Benchmarks Reliable?

arXiv:2605.18229v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) are a core interpretability tool for large language models, and progress on SAE architectures depends on benchmarks that re

ArtifactLinker: Linking Scientific Artifacts for Automatic State-of-the-Art Discovery

arXiv:2605.16902v1 Announce Type: new Abstract: Scientific artifacts such as models and datasets are foundations for research. With the rapid growth of platforms like HuggingFace, researchers now have

Artificial Intelligence can Recognize Whether a Job Applicant is Selling and/or Lying According to Facial Expressions and Head Movements Much More Correctly Than Human Interviewers

arXiv:2605.17461v1 Announce Type: cross Abstract: Whether an interviewee's honest and deceptive responses can be detected by facial expression signals in videos has been debated and requires further r

Attention-Guided Fusion of 1D and 2D CNNs for Robust ECG-Based Biometric Recognition

arXiv:2605.17685v1 Announce Type: cross Abstract: Electrocardiogram (ECG)-based biometric recognition has emerged as a promising solution for secure authentication and liveness detection. However, mos

Tutorials

Automated Knowledge Component Generation for Interpretable Knowledge Tracing in Coding Problems

arXiv:2502.18632v4 Announce Type: replace Abstract: Knowledge components (KCs) mapped to problems help model student learning, tracking their mastery levels on fine-grained skills thereby facilitating

tutorialsarxiv-cs-ai

AutoRubric-T2I: Robust Rule-Based Reward Model for Text-to-Image Alignment

arXiv:2605.17602v1 Announce Type: new Abstract: Aligning Text-to-Image (T2I) generation models with human preferences increasingly relies on image reward models that score or rank generated images acc

safetyarxiv-cs-ai

Applications

Beyond Imperfect Alternatives with Rulemapping: A Neuro-Symbolic Case Study on Online Hate Speech

arXiv:2605.16280v1 Announce Type: cross Abstract: Automating legal reasoning forces a choice between imperfect alternatives: symbolic systems offer transparency but struggle with ambiguity, whereas ne

applicationsarxiv-cs-ai

Local Ai

Beyond Inference-Time Search: Reinforcement Learning Synthesizes Reusable Solvers

arXiv:2605.18374v1 Announce Type: cross Abstract: Large language models (LLMs) typically approach combinatorial optimization as an inference-time procedure, solving each instance separately through sa

local-aiarxiv-cs-ai

Can LLMs Refuse Questions They Do Not Know? Measuring Knowledge-Aware Refusal in Factual Tasks

arXiv:2510.01782v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) should refuse to answer questions beyond their knowledge. This capability, which we term knowledge-aware refusal,

CatalyticMLLM: A Graph-Text Multimodal Large Language Model for Catalytic Materials

arXiv:2605.17254v1 Announce Type: new Abstract: Property prediction and inverse structural design of catalytic materials are typically modeled as two independent tasks: the former predicts target prop

safetyarxiv-cs-ai

Causely: A Causal Intelligence Layer for Enterprise AI A Benchmark Study on SRE and Reliability Workflows

arXiv:2605.18327v1 Announce Type: new Abstract: AI agents deployed into SRE workflows currently derive their understanding of environment state from raw observability telemetry at query time, paying a

Tutorials

CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning

arXiv:2605.16416v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have achieved strong performance on general multimodal reasoning, yet remain challenged in integrating nonlocal visual i

tutorialsarxiv-cs-ai

ChemVA: Advancing Large Language Models on Chemical Reaction Diagrams Understanding

arXiv:2605.17214v1 Announce Type: new Abstract: While Large Language Models (LLMs) have revolutionized scientific text processing, they exhibit a significant capability gap when interpreting chemical

safetyarxiv-cs-ai

Compositional Adversarial Training for Robust Visual Watermarking

arXiv:2605.16720v1 Announce Type: new Abstract: Robust watermarking is typically trained with random post-processing augmentation, but random sampling under-covers the combinatorial space of realistic

Local Ai

Conservative AI for Safety-Sensitive Medical Image Restoration: Residual-Bounded CT-CTA Enhancement for Intracranial Aneurysm-Relevant Signal Recovery

arXiv:2605.16458v1 Announce Type: cross Abstract: Image restoration models are increasingly applied to degraded medical scans, but in safety-sensitive settings they must improve image quality without

local-aiarxiv-cs-ai

Constrained Policy Optimization via Sampling-Based Weight-Space Projection

arXiv:2512.13788v2 Announce Type: replace Abstract: Safety-critical learning requires policies that improve performance without leaving the safe operating regime. We study constrained policy learning

Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting

arXiv:2508.04227v2 Announce Type: replace Abstract: Vision-language models (VLMs) and the recent surge of Multimodal Large Language Models (MLLMs) have revolutionized artificial intelligence with unpr

CooT: Learning to Coordinate In-Context with Coordination Transformers

arXiv:2506.23549v3 Announce Type: replace Abstract: Effective coordination among unfamiliar partners remains a major challenge in multi-agent systems. Existing approaches, such as population-based met

DASH: A Meta-Attack Framework for Synthesizing Effective and Stealthy Adversarial Examples

arXiv:2508.13309v3 Announce Type: replace Abstract: Numerous techniques have been proposed for generating adversarial examples in white-box settings under strict Lp-norm constraints. However, such nor

Deep Learning for MRI Slice Interpolation: The Critical Role of Problem Formulation

arXiv:2605.16476v1 Announce Type: cross Abstract: Through-plane resolution in clinical MRI is typically much coarser than in-plane resolution, limiting diagnostic utility. This work investigates deep

DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy

arXiv:2605.16519v1 Announce Type: new Abstract: Accurate polyp segmentation in colonoscopy is essential for early colorectal cancer detection, yet real-world clinical environments pose persistent chal

DeTrack: A Benchmark and Altitude-Aware Dual World Model for Drone-embodied Tracking

arXiv:2605.17451v1 Announce Type: new Abstract: Aerial object tracking has broad applications in public safety, emergency rescue, wildlife monitoring, and related fields. However, existing aerial trac

DiRotQ: Rotation-Aware Quantization for 4-bit Diffusion Transformers

arXiv:2605.16732v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) achieve state-of-the-art image generation quality but incur substantial memory and computational costs at inference. While

safetyarxiv-cs-cv

Dual-Rate Diffusion: Accelerating diffusion models with an interleaved heavy-light network

arXiv:2605.18190v1 Announce Type: cross Abstract: Diffusion models achieve state-of-the-art generative performance but suffer from high computational costs during inference due to the repeated evaluat