Search: “evaluation”

VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Models

model-releasesarxiv-cs-cv

arXiv:2512.22539v2 Announce Type: replace-cross Abstract: While Vision-Language-Action models (VLAs) are rapidly advancing towards generalist robot policies, it remains difficult to quantitatively und

3 Jun 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

A Closer Look at In-Distribution vs. Out-of-Distribution Accuracy for Open-Set Test-time Adaptation

DGX agent

arXiv:2606.01973v1 Announce Type: cross Abstract: Open-set test-time adaptation (TTA) updates models on new data in the presence of input shifts and unknown output classes. While recent methods have m

model-releasesarxiv-cs-cv

2 Jun 2026

A Foundation Model for Wearable Movement Data in Mental Health Research

arXiv:2411.15240v5 Announce Type: replace-cross Abstract: Wearable movement data is collected by nearly all commercially available smartwatches and is a valuable resource for mental health research, r

A Lightweight Hybrid MLP-Based Framework for Real-Time Phishing URL Detection Using Structural URL Features

arXiv:2606.00889v1 Announce Type: cross Abstract: Phishing attacks remain a major cybersecurity threat, exploiting deceptive URLs to steal sensitive user information. Traditional blacklist and rule-ba

researcharxiv-cs-lg

A Machine-to-Machine Knowledge-Guided LLM Agent for Generalizable Radiotherapy Treatment Planning

model-releasesarxiv-cs-ro

arXiv:2606.00922v1 Announce Type: cross Abstract: In this work, we propose a prototype machine-to-machine (M2M) knowledge-guided Large Language Model (LLM) framework for automated radiotherapy treatme

A Structured Benchmark for Text-Guided Anomaly Detection: When Language Stops Conditioning the Decision

arXiv:2606.01992v1 Announce Type: cross Abstract: Industrial anomaly detection has historically been a unimodal task. Recent multimodal vision-language models have produced systems that admit textual

A Systematic Benchmark of Intraoperative Ultrasound-to-MR Synthesis for Brain Tumour Surgery

model-releasesarxiv-cs-cv

arXiv:2606.00630v1 Announce Type: new Abstract: Intraoperative ultrasound (ioUS) is a versatile, cost-effective modality in brain tumour surgery, but its interpretation is difficult: acquisition plane

Absorbing Complexity: An Interaction-Native Knowledge Harness for Financial LLM Agents

arXiv:2606.01886v1 Announce Type: new Abstract: Financial AI agents often fail for a simple reason: they make users carry the complexity. A user must repeatedly restate goals, risk preferences, portfo

Adversarial Feeds Steer LLM Agent Decisions Against Their Defaults

arXiv:2606.00914v1 Announce Type: new Abstract: LLM agents increasingly act after consuming ranked external information streams such as social feeds, search results, retrieval contexts, and email queu

safetyarxiv-cs-ai

Agent Tools Orchestration Leaks More: Dataset, Benchmark, and Mitigation

arXiv:2512.16310v3 Announce Type: replace-cross Abstract: LLM-based agents increasingly use multiple external tools to complete complex tasks. We study Tools Orchestration Privacy Risk (TOP-R): an age

Agricultural Landscape Understanding At Country-Scale

arXiv:2411.05359v2 Announce Type: replace-cross Abstract: Comprehensive agricultural landscape understanding is critical for addressing global challenges in food security, climate change, and resource

safetyarxiv-cs-ai

Algorithmic algorithm development with LLMs: A Case Study on LLM-Usage for Contraction Order Optimization in Tensor Networks

arXiv:2606.01975v1 Announce Type: new Abstract: We consider LLM-based algorithm development through a case study on contractionorder optimisation for tensor networks with OpenEvolve. We pay particular

Are Large Reasoning Models Interruptible?

arXiv:2510.11713v4 Announce Type: replace Abstract: Real-world applications of Large Reasoning Models (LRMs) often require reasoning about changing prompts or environments. In this work, we challenge

applicationsarxiv-cs-cl

Attention mechanisms and transfer learning for robust peach leaf damage classification under domain shift

arXiv:2606.02045v1 Announce Type: cross Abstract: Artificial intelligence provides a practical framework for crop damage assessment from imagery data, supporting early decision-making in agricultural

AutoFFS: Adversarial Deformations for Facial Feminization Surgery Planning

arXiv:2603.02288v2 Announce Type: replace Abstract: Facial feminization surgery (FFS) is a key component of gender affirmation for transgender and gender diverse patients, aiming to reshape craniofaci

safetyarxiv-cs-cv

AutoMedBench: Towards Medical AutoResearch with Agentic AI Models

arXiv:2606.01961v1 Announce Type: new Abstract: Autonomous agents are increasingly expected to support end-to-end medical-AI research workflows, moving beyond isolated prediction tasks or short-form c

Bandit Simulation for Average Reward Inference

arXiv:2606.00913v1 Announce Type: cross Abstract: Multi-arm bandit algorithms are increasingly used in online platforms, clinical trials, and social science experiments, but valid statistical inferenc

safetyarxiv-cs-lg

Behavior Cloning of MPC for 3-DOF Robotic Manipulators

arXiv:2606.00383v1 Announce Type: cross Abstract: While Model Predictive Control (MPC) provides strong stability and robustness, it imposes a significant computational burden on real-time systems. Thi

safetyarxiv-cs-lg

Benchmarking Large Language Models for Cryptanalysis and Side-Channel Vulnerabilities

arXiv:2505.24621v3 Announce Type: replace Abstract: Recent advancements in large language models (LLMs) have transformed natural language understanding and generation, leading to extensive benchmarkin

Benchmarks for Vision-Language Models in Urban Perception Should Be Reliability-Aware and Negotiated

arXiv:2606.00871v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly used to generate structured descriptions of street-level imagery for tasks such as streetscape auditing

Beyond Procedure: Substantive Fairness in Conformal Prediction

arXiv:2602.16794v2 Announce Type: replace-cross Abstract: Conformal prediction (CP) offers distribution-free uncertainty quantification for machine learning models, yet its interplay with fairness in

safetyarxiv-cs-lg

Beyond Scalar Rewards: Dense Feedback for LLM Policy Synthesis in Sequential Social Dilemmas

arXiv:2603.19453v2 Announce Type: replace Abstract: We study LLM policy synthesis: using a language model to iteratively generate programmatic agent policies for multi-agent environments. Rather than

Boundary-Protection W8A8 HiFloat8 Quantization for Large-Scale Text-to-Video Diffusion Transformers

model-releasesarxiv-cs-cv

arXiv:2606.00957v1 Announce Type: new Abstract: We present a post-training quantization (PTQ) approach for Wan2.1-T2V-14B, a 14-billion-parameter text-to-video diffusion transformer, targeting the W8A

Breaking the Information Silo: Semantic Personas for Cross-Domain Recommendation

arXiv:2606.01783v1 Announce Type: cross Abstract: Digital platforms increasingly operate as isolated information silos, limiting their ability to construct comprehensive user representations across do

safetyarxiv-cs-ai

CARE-RL: Capability-Aware Reinforcement Learning for Mitigating Cross-Domain Conflicts

arXiv:2606.00609v1 Announce Type: cross Abstract: Reinforcement learning (RL) with verifiable rewards has achieved strong progress in reasoning-oriented LLMs, but extending it to multi-domain RL remai

researcharxiv-cs-ai

Characterization of Multi-Model Agentic AI Systems on General Tasks via Trace-Driven Simulation

arXiv:2606.01725v1 Announce Type: new Abstract: Agentic AI completes tasks through iterative planning, tool use, and reasoning based on observed outcomes. Despite its popularity, its system-level beha

Characterizing Web Search in The Age of Generative AI

arXiv:2510.11560v2 Announce Type: replace-cross Abstract: The advent of LLMs has given rise to generative search, a new search paradigm in which LLMs retrieve information from the web related to a que

researcharxiv-cs-ai

Citation Grounding: Detecting and Reducing LLM Citation Hallucinations via Legal Citation Graphs

arXiv:2606.00898v1 Announce Type: new Abstract: Large language models systematically hallucinate legal citations -- fabricating statute references, citing repealed provisions, and confusing jurisdicti

ClinEnv: An Interactive Multi-Stage Long Horizon EHR Environment for Agents

arXiv:2606.02568v1 Announce Type: new Abstract: Clinical practice is not the selection of an answer from enumerated options: a physician gathers heterogeneous information incrementally and commits to

CLSP-REQA: A Real-Time Quality-Aware Closed-Loop Seizure Prediction Framework with Mamba-BiLSTM and Confidence-Gated Intervention

arXiv:2606.00074v1 Announce Type: cross Abstract: Reliable seizure prediction is a prerequisite for closed-loop neurostimulation therapy, yet existing methods rarely account for the variability in EEG

Context Matters: Repository-Aware Security Analysis of the Agent Skill Ecosystem

arXiv:2603.16572v2 Announce Type: replace-cross Abstract: Agent skills extend local AI agents, such as Claude Code and OpenClaw, with additional functionality. Their growing popularity has led to dedi

ContinuousBench: Can Differentially Private Synthetic Text Improve Capabilities?

arXiv:2606.01849v1 Announce Type: cross Abstract: Differentially private (DP) text synthesis promises to unlock sensitive corpora for model training, but it remains unclear whether DP synthetic data t

Coupling Language Models with Physics-based Simulation for Synthesis of Inorganic Materials

arXiv:2606.00315v1 Announce Type: new Abstract: Modern generative machine learning (ML) models can propose novel inorganic crystalline materials with targeted properties; however, synthesis planning o

Agents

Critic-R: Improving Agentic Search using Instruction-tuned Retrievers with Natural Language Introspective Feedback

arXiv:2606.00590v1 Announce Type: cross Abstract: Agentic search systems iteratively interact with retrieval models to answer complex queries. Despite substantial progress, optimizing retrievers for a

agentsarxiv-cs-ai

Deep Research as Rubric for Reinforcement Learning

arXiv:2606.01091v1 Announce Type: new Abstract: Open-ended reasoning and long-form generation tasks lack reliable automatic verification signals for reward-based policy optimization. Rubrics offer a p

Do Gender Cues Affect LLM Value Trade-offs? Evidence from a Controlled Decision Benchmark

arXiv:2606.02214v1 Announce Type: new Abstract: Large language models are increasingly used in value-sensitive decision settings, where irrelevant demographic cues should not alter judgments. We const

Does Compression Preserve Uncertainty? A Unified Benchmark for Quantized and Sparse LLMs via Conformal Prediction

arXiv:2606.01850v1 Announce Type: new Abstract: Model compression techniques such as quantization and pruning are widely used to reduce the deployment cost of large language models (LLMs), with existi

Agents

Early Diagnosis of Wasted Computation in Multi-Agent LLM Systems via Failure-Aware Observability

arXiv:2606.01365v1 Announce Type: new Abstract: Tool-using multi-agent large language model (LLM) systems spend computation through model tokens, tool calls, retries, and code execution before produci

agentsarxiv-cs-ai

eMoT: evolving Memory-of-Thought via Symbolic Anchoring and Memory Corrosion

arXiv:2606.02054v1 Announce Type: new Abstract: While Large Language Models (LLMs) achieve impressive performance on multi-step reasoning tasks, their reliability is persistently hindered by critical

researcharxiv-cs-ai

EST-PRM: Stress-Testing Process Reward Models Before They Become Load-Bearing

arXiv:2606.00437v1 Announce Type: new Abstract: Process reward models (PRMs) are widely used in language-model training with dense step-level supervision. They assume PRM scores are stable proxies for

researcharxiv-cs-lg

EuraGovExam: A Multilingual Multimodal Benchmark from Real-World Civil Service Exams

arXiv:2603.27223v2 Announce Type: replace-cross Abstract: We present EuraGovExam, a multilingual and multimodal benchmark sourced from real-world civil service examinations across five representative

Local Ai

Evolutionary Discovery of Bivariate Bicycle Codes with LLM-Guided Search

arXiv:2606.02418v1 Announce Type: cross Abstract: Quantum LDPC code discovery requires searching large algebraic design spaces while reliably certifying the parameters and equivalence classes of any c

local-aiarxiv-cs-ai

Evolving to the Aesthetics of a Vision-Language Model

arXiv:2606.00112v1 Announce Type: cross Abstract: Evolutionary systems have demonstrated remarkable results in creative domains, with recent applications in generative typography, design, and music. H

applicationsarxiv-cs-cv

FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search

arXiv:2606.00765v1 Announce Type: new Abstract: LLM-based agents increasingly solve complex tasks through long trajectories involving reasoning steps, tool calls, and inter-agent communication. Howeve

Flow-Based Density Ratio Estimation for Intractable Distributions with Applications in Genomics

arXiv:2602.24201v2 Announce Type: replace Abstract: Estimating density ratios between pairs of intractable data distributions is a core problem in probabilistic modeling, enabling principled compariso

researcharxiv-cs-lg

FlowNar: Scalable Streaming Narration for Long-Form Videos

arXiv:2606.00620v1 Announce Type: new Abstract: Recent Large Multimodal Models (LMMs), primarily designed for offline settings, are ill-suited for the dynamic requirements of streaming video. While re

researcharxiv-cs-cv

From Empathy to Personalized Empathy: Adapting Empathetic Strategies to Individual Users

arXiv:2606.00728v1 Announce Type: new Abstract: As Large Language Models (LLMs) are increasingly deployed in long-term interactions with users, empathy has become an increasingly important capability.

researcharxiv-cs-cl

Local Ai

From Features to Actions: Explainability in Traditional and Agentic AI Systems

arXiv:2602.06841v4 Announce Type: replace Abstract: Over the last decade, Explainable AI has primarily focused on interpreting individual model predictions, producing post-hoc explanations that relate

local-aiarxiv-cs-ai