Search: “evaluation”

Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security

arXiv:2605.23989v1 Announce Type: new Abstract: Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Trace data is literally worth its weight in gold these days, if you know what to do with it! As has been established, creating effective age…

DGX agent

Trace data is literally worth its weight in gold these days, if you know what to do with it! As has been established, creating effective agents requires shipping early, observing behavior, and iterati

agentsharrison-chase--x

26 May 2026

TRAFA: Anticipating User Actions to Reduce Errors in Procedural Tasks with Predictive Feedback

arXiv:2605.24526v1 Announce Type: cross Abstract: Interactive assistance systems typically provide feedback after an action has been completed, supporting error recovery but not preventing the error i

Train-Free Segmentation in MRI with Cubical Persistent Homology

arXiv:2401.01160v3 Announce Type: replace-cross Abstract: We investigate a framework for train-free MRI segmentation based on Topological Data Analysis. The pipeline proceeds in three steps, first ide

Transformers over-extend what humans underlearn: the case of Spanish L-shaped morphome

arXiv:2507.21556v3 Announce Type: replace Abstract: The cognitive reality of irregular morphological patterns has been debated for decades: do speakers extend them to novel forms, or are they lexical

applicationsarxiv-cs-cl

TriVAL: A Tri-Validation Framework for Faithful Automatic Optimization Modeling

arXiv:2605.23966v1 Announce Type: cross Abstract: Optimization modeling serves as the pivotal bridge between natural-language problem descriptions and optimization solvers, and remains a cornerstone f

Trust but Verify: Prover-Verifier Deliberation for Selective LLM Prediction

arXiv:2605.25133v1 Announce Type: new Abstract: Reliably knowing when a language model is correct is almost as important as being correct. We introduce prover-verifier deliberation (PVD), an inference

TTPrint: Evidence-Grounded TTP Extraction via Diverge-then-Converge Verification

arXiv:2605.25836v1 Announce Type: cross Abstract: Extracting MITRE ATT&CK techniques from cyber threat intelligence (CTI) reports is an open-set, multi-label problem requiring both high recall (not mi

Turn-Based Structural Triggers: Prompt-Free Backdoors in Multi-Turn LLMs

arXiv:2601.14340v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are widely integrated into interactive systems such as dialogue agents and task-oriented assistants. This growing

Unbalanced Incomplete Multi-view Clustering via the Scheme of View Evolution: Weak Views are Meat; Strong Views do Eat

arXiv:2011.10254v3 Announce Type: replace-cross Abstract: Incomplete multi-view clustering is an important technique to deal with real-world incomplete multi-view data. Previous works assume that all

applicationsarxiv-cs-ai

Uncertainty-DTW for Sequences and Visual Tokens

arXiv:2605.25110v1 Announce Type: cross Abstract: Aligning structured data is a fundamental problem in computer vision and machine learning, underlying tasks such as time series analysis, human action

VectorArk: Learning Practical Image Vectorization with Rounded Polygon Representation

arXiv:2605.24398v1 Announce Type: cross Abstract: Recent vision-language model (VLM)-based approaches have achieved impressive results on image vectorization tasks. However, they are typically evaluat

applicationsarxiv-cs-ai

Verified SHAP: Provable Bounds for Exact Shapley Values of Neural Networks

arXiv:2605.24084v1 Announce Type: cross Abstract: Shapley additive explanations (SHAP) are widely recognised as computationally intractable for neural networks, since they induce an exponential search

VisualOverload: Probing Visual Understanding of VLMs in Really Dense Scenes

arXiv:2509.25339v3 Announce Type: replace-cross Abstract: Is basic visual understanding really solved in state-of-the-art VLMs? We present VisualOverload, a slightly different visual question answerin

Voting with the Graph: Stable RLAIF via Topological Consistency Maximization

arXiv:2510.15514v3 Announce Type: replace Abstract: Reinforcement Learning from AI Feedback (RLAIF) relies on LLM judges as preference measurement instruments, yet these instruments are fundamentally

What Gets Cited: Competitive GEO in AI Answer Engines

arXiv:2605.25517v1 Announce Type: new Abstract: AI answer engines generate answers from retrieved pages but cite only a few sources. This makes visibility depend not just on ranking, but on being cite

What Happens Next? Anticipating Future Motion by Generating Point Trajectories

arXiv:2509.21592v2 Announce Type: replace-cross Abstract: We consider the problem of forecasting motion from a single image, i.e., predicting how objects in the world are likely to move, without the a

applicationsarxiv-cs-ai

When Correct Beliefs Collapse: Epistemic Resilience of LLMs under Clinical Pressure

arXiv:2605.23932v1 Announce Type: new Abstract: Despite strong medical benchmark accuracy, LLMs can exhibit severe multi-turn sycophancy in clinical dialogue, abandoning initial correct diagnosis unde

When Does Synthetic Patent Data Help? Volume-Fidelity Trade-offs in Low-Resource Multi-Label Classification

arXiv:2605.24296v1 Announce Type: new Abstract: We study when LLM-generated synthetic data helps low-resource multi-label patent classification, separating true synthetic value from the confound that

When Mean CE Fails: Median CE Can Better Track Language Model Quality

arXiv:2605.24667v1 Announce Type: new Abstract: Mean cross-entropy is the standard validation metric for language models, but it can fail to track model quality during training. We examine this in two

Which Is Better For Reducing Outdated and Vulnerable Dependencies: Pinning or Floating?

arXiv:2510.08609v3 Announce Type: replace-cross Abstract: Developers consistently use version constraints to specify acceptable versions of the dependencies for their project. Pinning dependencies can

Whose Alignment? Comparing LLM Process Alignment Across Diverse Organizational Decision Contexts

arXiv:2605.25256v1 Announce Type: new Abstract: Aligning AI systems with organizational decision-making is typically framed as a single-target problem: make the model behave like the organization. We

Agents

Why We Need World Models for AGI: Where LLMs Fail and How World Models May Outperform

arXiv:2605.23972v1 Announce Type: new Abstract: Large language models achieve strong performance in language generation and knowledge-intensive tasks, yet remain limited in settings requiring causal r

agentsarxiv-cs-ai

WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimation

model-releasesarxiv-cs-ro

arXiv:2605.24074v1 Announce Type: cross Abstract: Fisheye cameras are increasingly adopted in robotics for near-field manipulation, navigation, and immersive perception, yet indoor depth benchmarks wi

X-DiffVLA: X-Embodied Diffusion Action Heads for Vision-Language-Action Models

arXiv:2605.25044v1 Announce Type: new Abstract: Learning universal policies from cross-embodied data remains a fundamental challenge in robotics. Although Vision-Language-Action (VLA) models are pre-t

safetyarxiv-cs-ro

Zeroth-Order Nonconvex Nonsmooth Optimization with Heavy-Tailed Noise

arXiv:2605.24513v1 Announce Type: new Abstract: This paper considers the nonconvex nonsmooth problem in which the objective function is Lipschitz continuous. We focus on the stochastic setting where t

A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Development

arXiv:2605.22828v1 Announce Type: new Abstract: This survey provides a comprehensive catalog of publicly available text and speech resources for two West African languages: Hausa, an Afroasiatic langu

researcharxiv-cs-cl

Agentic-VLA: Efficient Online Adaptation for Vision-Language-Action Models

arXiv:2605.22896v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have emerged as a promising paradigm for robotic manipulation by leveraging pre-trained vision-language representa

AGZO: Activation-Guided Zeroth-Order Optimization for LLM Fine-Tuning

arXiv:2601.17261v4 Announce Type: replace Abstract: Zeroth-Order (ZO) optimization has emerged as a promising solution for fine-tuning LLMs under strict memory constraints, as it avoids the prohibitiv

AI Security Research Should Better Incentivize Defense Research

arXiv:2605.23448v1 Announce Type: cross Abstract: This work examines an imbalance in artificial intelligence (AI) security research: the field tends to produce more work on attacking AI systems than o

An AI-Driven Framework for Energy-Efficient Environmental Monitoring in Smart Cities Using Edge Intelligence

arXiv:2605.22824v1 Announce Type: cross Abstract: Environmental monitoring is a crucial component of the smart city infrastructure. It enables informed decision making which enhances sustainability, p

Tutorials

An Open-Source Training Dataset for Foundation Models for Black-box Optimization

arXiv:2605.23417v1 Announce Type: new Abstract: Most black-box optimization methods require extensive hyperparameter tuning, often limiting their ability to generalize across different optimization do

tutorialsarxiv-cs-lg

Archimedean Copula Inference via Taylor-Mode AD

model-releasesarxiv-cs-lg

arXiv:2605.23134v1 Announce Type: new Abstract: No existing nested Archimedean copula tool handles all three of (a) arbitrary per-variable (right-)censoring in survival analysis, (b) arbitrary nesting

ARES: Automated Rubric Synthesis for Scalable LLM Reinforcement Learning

arXiv:2605.23454v1 Announce Type: new Abstract: Rubric-based rewards offer a promising way to extend reinforcement learning (RL) for large language models beyond tasks with automatically verifiable an

applicationsarxiv-cs-cl

Asking For An Old Friend: Diagnosing and Mitigating Temporal Failure Modes in LLM-based Statutory Question Answering

arXiv:2605.23497v1 Announce Type: new Abstract: Large language models are increasingly used for legal research, yet their fixed training cutoffs and reliance on static parametric knowledge are at odds

Assessing Predictive Models for Fairness Based on Movement Patterns

arXiv:2605.23234v1 Announce Type: new Abstract: Assessing the spatial fairness of predictive models involves establishing whether they are statistically penalizing (favoring) individuals associated wi

safetyarxiv-cs-lg

Atom-level Protein Representation Learning Improves Protein Structure Prediction

arXiv:2605.22133v2 Announce Type: replace-cross Abstract: Recent advances in generative modeling show that pretrained representations can improve generation as conditioning features or alignment targe

Agents

AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery

arXiv:2605.23204v1 Announce Type: new Abstract: Scientific research is being reshaped by AI systems that move beyond isolated assistance toward longer-horizon workflows spanning literature grounding,

agentsarxiv-cs-ai

Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics

arXiv:2510.12787v4 Announce Type: replace Abstract: We present Ax-Prover, a multi-agent system for automated theorem proving in Lean that can solve problems across diverse scientific domains and opera

Benchmarking and Enhancing VLM for Compressed Image Understanding

model-releasesarxiv-cs-cv

arXiv:2512.20901v2 Announce Type: replace Abstract: With the rapid development of Vision-Language Models (VLMs) and the growing demand for their applications, efficient compression of the image inputs

Benchmarking Google Embeddings 2 against Open-Source Models for Multilingual Dense Retrieval and RAG Systems

arXiv:2605.23618v1 Announce Type: new Abstract: We benchmark Google Embeddings (GE2), a Vertex-AI-hosted bi-encoder with 2,048-token context and explicit task-type conditioning, against five open-sour

Tutorials

Bridging Data and Physics: A Graph Neural Network-Based Hybrid Twin Framework

arXiv:2512.15767v2 Announce Type: replace-cross Abstract: Simulating complex unsteady physical phenomena relies on detailed mathematical models, simulated for instance by using the Finite Element Meth

tutorialsarxiv-cs-ai

BVI-RLV: A Fully Registered Dataset for Low-Light Video Enhancement

arXiv:2407.03535v3 Announce Type: replace Abstract: Low-light videos often exhibit spatiotemporally incoherent noise, compromising visibility and degrading performance in computer vision applications.

applicationsarxiv-cs-cv

Can AI Guess What You Know? Performance Comparison of Large Language Models for Human Domain Knowledge Estimation From Communication Logs

arXiv:2605.22971v1 Announce Type: new Abstract: Employees often struggle to identify ``who knows what,'' leading to organizational productivity losses. We investigate whether Large Language Models (LL

CarlaNCAP: A Framework for Quantifying the Safety of Vulnerable Road Users in Infrastructure-Assisted Collective Perception Using EuroNCAP Scenarios

arXiv:2512.11551v2 Announce Type: replace Abstract: The growing number of road users has significantly increased the risk of accidents in recent years. Vulnerable Road Users (VRUs) are particularly at

safetyarxiv-cs-ro

Causal Additive Models with Unobserved Causal Paths and Backdoor Paths

arXiv:2502.07646v3 Announce Type: replace Abstract: Causal additive models provide a tractable yet expressive framework for causal discovery in the presence of hidden variables. When unobserved backdo

ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models

arXiv:2605.23694v1 Announce Type: new Abstract: Chart descriptions are essential for accessibility, cross-modal retrieval, and assisting readers in extracting insights from complex visualizations. As

Classical State Preparation for Variational Quantum Algorithms via Reinforcement Learning

arXiv:2605.23138v1 Announce Type: cross Abstract: Variational Quantum Algorithms (VQAs) potentially offer a pathway to practical quantum advantage, but their optimization is heavily hindered by barren