Search: “evaluation”

Video Models Can Reason with Verifiable Rewards

arXiv:2605.15458v1 Announce Type: new Abstract: Video diffusion models have made rapid progress in perceptual realism and temporal coherence, but they remain primarily optimized for plausible generati

safetyarxiv-cs-cv

18 May 2026

Zero-Shot Goal Recognition with Large Language Models

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2605.15333v1 Announce Type: new Abstract: Large language models have recently reached near-parity with classical planners on well-known planning domains, yet this competence relies on world-know

model-releasesarxiv-cs-ai

18 May 2026

AgentTrap: Measuring Runtime Trust Failures in Third-Party Agent Skills

arXiv:2605.13940v1 Announce Type: cross Abstract: Third-party skills are becoming the package ecosystem for LLM agents. They package natural-language instructions, helper scripts, templates, documents

AI-assisted cultural heritage dissemination: Comparing NMT and glossary-augmented LLM translation in rock art documents

arXiv:2605.14679v1 Announce Type: cross Abstract: Cultural heritage institutions increasingly disseminate research and interpretive materials globally, but multilingual dissemination is constrained by

AnchorRoute: Human Motion Synthesis with Interval-Routed Sparse Contro

arXiv:2605.14716v1 Announce Type: cross Abstract: Sparse anchors provide a compact interface for human motion authoring: users specify a few root positions, planar trajectory samples, or body-point ta

ARES-LSHADE: Autoresearch-Enhanced LSHADE with Memetic Polish for the GNBG Benchmark

arXiv:2605.13877v1 Announce Type: cross Abstract: We present ARES-LSHADE, a memetic differential-evolution variant submitted to the GECCO 2026 competition on LLM-designed evolutionary algorithms for t

ArGEnT: Arbitrary Geometry-encoded Transformer for Operator Learning

arXiv:2602.11626v2 Announce Type: replace-cross Abstract: Learning solution operators for systems with complex, varying geometries and parametric physical settings is a central challenge in scientific

ASH: Agents that Self-Hone via Embodied Learning

arXiv:2605.14211v1 Announce Type: new Abstract: Long-horizon embodied tasks remain a fundamental challenge in AI, as current methods rely on hand-engineered rewards or action-labeled demonstrations, n

AttnGen: Attention-Guided Saliency Learning for Interpretable Genomic Sequence Classification

arXiv:2605.14073v1 Announce Type: cross Abstract: Deep neural networks have achieved strong performance in genomic sequence classification; however, relating their predictions to biologically meaningf

Auditing Agent Harness Safety

arXiv:2605.14271v1 Announce Type: new Abstract: LLM agents increasingly run inside execution harnesses that dispatch tools, allocate resources, and route messages between specialized components. Howev

AVEX: What Matters for Animal Vocalization Encoding

arXiv:2508.11845v3 Announce Type: replace-cross Abstract: Bioacoustics, the study of sounds produced by living organisms, plays a vital role in conservation, biodiversity monitoring, and behavioral st

researcharxiv-cs-ai

Beyond Mode-Seeking RL: Trajectory-Balance Post-Training for Diffusion Language Models

arXiv:2605.13935v1 Announce Type: cross Abstract: Diffusion language models are a promising alternative to autoregressive models, yet post-training methods for them largely adapt reward-maximizing obj

Computational Imaging Priors for Wireless Capsule Endoscopy: Monte Carlo-Guided Hemoglobin Mapping for Rare-Anomaly Detection

arXiv:2605.15062v1 Announce Type: new Abstract: Background. RGB-trained capsule-endoscopy classifiers underperform on small-vessel vascular findings by conflating hemoglobin contrast with bile and ill

researcharxiv-cs-cv

Confidence Estimation for LLMs in Multi-turn Interactions

arXiv:2601.02179v2 Announce Type: replace Abstract: While confidence estimation is a promising direction for mitigating hallucinations in Large Language Models (LLMs), current research overwhelmingly

researcharxiv-cs-cl

Correctness-Aware Repository Filtering Under Maximum Effective Context Window Constraints

arXiv:2605.14362v1 Announce Type: cross Abstract: Context window efficiency is a practical constraint in large language model (LLM)-based developer tools. Paulsen [12] shows that all tested models deg

CurveBench: A Benchmark for Exact Topological Reasoning over Nested Jordan Curves

arXiv:2605.14068v1 Announce Type: new Abstract: We introduce CurveBench, a benchmark for hierarchical topological reasoning from visual input. CurveBench consists of extbf{756 images} of pairwise non-

Descriptor: Distance-Annotated Traffic Perception Question Answering (DTPQA)

arXiv:2511.13397v2 Announce Type: replace-cross Abstract: The remarkable progress of Vision-Language Models (VLMs) on a variety of tasks has raised interest in their application to automated driving.

Do Reasoning LLMs Refuse What They Infer in Long Contexts?

arXiv:2602.08874v2 Announce Type: replace Abstract: Long-context LLMs can infer objectives that are not stated explicitly. This capability is useful for reasoning over documents, code, retrieved evide

safetyarxiv-cs-cl

Do-Undo Bench: Reversibility for Action Understanding in Image Generation

arXiv:2512.13609v2 Announce Type: replace Abstract: We introduce the Do-Undo task and benchmark to address a critical gap in vision-language models: understanding and generating plausible scene transf

Fair and Calibrated Toxicity Detection with Robust Training and Abstention

arXiv:2605.14074v1 Announce Type: new Abstract: Fairness in toxicity classification involves three integrated axes: ranking, calibration, and abstention. Training-time interventions and post-hoc safet

safetyarxiv-cs-lg

Invisible Orchestrators Suppress Protective Behavior and Dissociate Power-Holders: Safety Risks in Multi-Agent LLM Systems

arXiv:2605.13851v1 Announce Type: new Abstract: Multi-agent orchestration -- in which a hidden coordinator manages specialized worker agents -- is becoming the default architecture for enterprise AI d

Agents

Lang2MLIP: End-to-End Language-to-Machine Learning Interatomic Potential Development with Autonomous Agentic Workflows

arXiv:2605.14527v1 Announce Type: new Abstract: Developing machine learning interatomic potentials (MLIPs) for complex materials systems remains challenging because it requires expertise in atomistic

agentsarxiv-cs-lg

LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling

model-releasesarxiv-cs-lg

arXiv:2605.14186v1 Announce Type: new Abstract: Large language models (LLMs) often expose useful signals of self-monitoring: before solving a problem, they can estimate whether they are likely to succ

Measuring and Mitigating Toxicity in Large Language Models: A Comprehensive Replication Study

arXiv:2605.14087v1 Announce Type: new Abstract: Large Language Models (LLMs), when trained on web-scale corpora, inherently absorb toxic patterns from their training data. This leads to ``toxic degene

safetyarxiv-cs-cl

Mechanical Enforcement for LLM Governance:Evidence of Governance-Task Decoupling in Financial Decision Systems

arXiv:2605.14744v1 Announce Type: cross Abstract: Large language models in regulated financial workflows are governed by natural-language policies that the same model interprets, creating a principal-

ML-Embed: Inclusive and Efficient Embeddings for a Multilingual World

arXiv:2605.15081v1 Announce Type: cross Abstract: The development of high-quality text embeddings is increasingly drifting toward an exclusionary future, defined by three critical barriers: prohibitiv

MMTutorBench: The First Multimodal Benchmark for AI Math Tutoring

arXiv:2510.23477v2 Announce Type: replace Abstract: Effective math tutoring requires not only solving problems but also diagnosing students' difficulties and guiding them step by step. While multimoda

Monitoring Data-aware Temporal Properties (Extended Version)

arXiv:2605.14666v1 Announce Type: new Abstract: Dynamic systems in AI are often complex and heterogeneous, so that an internal specification is not accessible and verification techniques such as model

researcharxiv-cs-ai

Network-Aware Bilinear Tokenization for Brain Functional Connectivity Representation Learning

arXiv:2605.14048v1 Announce Type: new Abstract: Masked autoencoders (MAEs) have recently shown promise for self-supervised representation learning of resting-state brain functional connectivity (FC).

Neural Signals Generate Clinical Notes in the Wild

arXiv:2601.22197v3 Announce Type: replace-cross Abstract: Generating clinical reports that summarize abnormal patterns, diagnostic findings, and clinical interpretations from long-term EEG recordings

On the Cultural Anachronism and Temporal Reasoning in Vision Language Models

arXiv:2605.15071v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) are increasingly applied to cultural heritage materials, from digital archives to educational platforms. This work ident

OneSearch-V2: The Latent Reasoning Enhanced Self-distillation Generative Search Framework

arXiv:2603.24422v2 Announce Type: replace-cross Abstract: Generative Retrieval (GR) has emerged as a promising paradigm for modern search systems. Compared to multi-stage cascaded architecture, it off

Agents

Orchard: An Open-Source Agentic Modeling Framework

arXiv:2605.15040v1 Announce Type: new Abstract: Agentic modeling aims to transform LLMs into autonomous agents capable of solving complex tasks through planning, reasoning, tool use, and multi-turn in

agentsarxiv-cs-ai

PaAno: Patch-Based Representation Learning for Time-Series Anomaly Detection

arXiv:2602.01359v2 Announce Type: replace-cross Abstract: Although recent studies on time-series anomaly detection have increasingly adopted ever-larger neural network architectures such as transforme

PEML: Parameter-efficient Multi-Task Learning with Optimized Continuous Prompts

arXiv:2605.14055v1 Announce Type: cross Abstract: Parameter-Efficient Fine-Tuning (PEFT) is widely used for adapting Large Language Models (LLMs) for various tasks. Recently, there has been an increas

PolitNuggets: Benchmarking Agentic Discovery of Long-Tail Political Facts

arXiv:2605.14002v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) embedded in agentic frameworks have transformed information retrieval from static, long context question answering into op

RAM-W600: A Multi-Task Wrist Dataset and Benchmark for Rheumatoid Arthritis

arXiv:2507.05193v4 Announce Type: replace-cross Abstract: Rheumatoid arthritis (RA) is a common autoimmune disease that has been the focus of research in computer-aided diagnosis (CAD) and disease mon

Rethinking Molecular OOD Generalization via Target-Aware Source Selection

model-releasesarxiv-cs-lg

arXiv:2605.13932v1 Announce Type: new Abstract: Robust prediction of molecular properties under extreme out-of-distribution (OOD) scenarios is a pivotal bottleneck in AI-driven drug discovery. Current

Safe Bayesian Optimization for Complex Control Systems via Additive Gaussian Processes

arXiv:2408.16307v3 Announce Type: replace-cross Abstract: Automatic controller tuning is attractive for robotics and mechatronic systems whose dynamics are difficult to model accurately, but direct bl

SciPaths: Forecasting Pathways to Scientific Discovery

arXiv:2605.14600v1 Announce Type: new Abstract: Scientific progress depends on sequences of enabling contributions, yet existing AI4Science benchmarks largely focus on citation prediction, literature

Talk is (Not) Cheap: A Taxonomy and Benchmark Coverage Audit for LLM Attacks

arXiv:2605.15118v1 Announce Type: cross Abstract: We introduce a reusable framework for auditing whether LLM attack benchmarks collectively cover the threat surface: a 4imes6 Target imes Technique mat

Temporal Fair Division in Multi-Agent Systems: From Precise Alternation Metrics to Scalable Coordination Proxies

arXiv:2605.14879v1 Announce Type: cross Abstract: A plethora real-world environments require agents to compete repeatedly for the same limited resource, calling for a temporal notion of fairness judge

safetyarxiv-cs-lg

Text Knows What, Tables Know When: Clinical Timeline Reconstruction via Retrieval-Augmented Multimodal Alignment

arXiv:2605.15168v1 Announce Type: cross Abstract: Reconstructing precise clinical timelines is essential for modeling patient trajectories and forecasting risk in complex, heterogeneous conditions lik

Vendor-Conditioned Contrastive Learning for Predicting Organizational Cyber Threat Targets

model-releasesarxiv-cs-lg

arXiv:2012.14425v2 Announce Type: replace-cross Abstract: Cyberattacks cause billions of dollars in damage annually, with malicious hackers often sharing exploit code and techniques on underground for

Applications

What if Tomorrow is the World Cup Final? Counterfactual Time Series Forecasting with Textual Conditions

arXiv:2605.14422v1 Announce Type: new Abstract: Time series forecasting has become increasingly critical in real-world scenarios, where future sequences are influenced not only by historical patterns

applicationsarxiv-cs-lg

Adaptive mine planning under geological uncertainty: A POMDP framework for sequential decision-making

arXiv:2605.13702v1 Announce Type: new Abstract: Strategic mine production scheduling under geological uncertainty is conventionally formulated as a stochastic optimization problem in which a fixed ext

14 May 2026

Addressing Finite-Horizon MDPs via Low-Rank Tensor Value Approximation

arXiv:2501.10598v3 Announce Type: replace Abstract: We study the problem of learning optimal policies in finite-horizon Markov Decision Processes (MDPs) using low-rank reinforcement learning (RL) meth

safetyarxiv-cs-lg

14 May 2026

Agents

An Agentic LLM-Based Framework for Population-Scale Mental Health Screening