Search: “evaluation”

MULTISEISMO: A Multimodal Seismic Dataset and Model for Cross-Modal Seismic Understanding

arXiv:2605.26320v1 Announce Type: cross Abstract: The application of generalist multimodal models (GMMs) to specialized scientific domains remains limited due to the scarcity of comprehensive domain-s

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

ODOV: Benchmark the Open-Domain Open-Vocabulary Object Detection

DGX agent

arXiv:2508.01253v2 Announce Type: replace Abstract: Existing studies typically investigate domain shift and category shift as independent problems, however, in real-world scenarios, the two types of s

model-releasesarxiv-cs-cv

27 May 2026

PaTAS: A Framework for Trust Propagation in Neural Networks Using Subjective Logic

arXiv:2511.20586v4 Announce Type: replace Abstract: Trustworthiness has become a key requirement for the deployment of artificial intelligence systems in safety-critical applications. Conventional eva

Persona2Web: Benchmarking Personalized Web Agents for Contextual Reasoning with User History

arXiv:2602.17003v2 Announce Type: replace-cross Abstract: Large language models have advanced web agents, yet current agents lack personalization capabilities. Since users rarely specify every detail

Personalizing Embodied Multimodal Large Language Model Agents over Long-term User Interactions

arXiv:2605.26256v1 Announce Type: new Abstract: Multimodal large language model (MLLM)-based embodied agents have shown strong potential for solving complex tasks in physical environments. However, pe

Pop-Up Distractions Reveal Bag-of-Events Behavior in Video Large Language Models

arXiv:2605.27101v1 Announce Type: cross Abstract: A key capability for video understanding is reliably linking subjects to events across time, yet whether Video Large Language Models (VideoLLMs) actua

researcharxiv-cs-cl

Probing Cultural Awareness in LLMs: A Case Study of Cross-Culture Aesthetic Stylistics

arXiv:2605.27296v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly deployed in diverse cultural contexts, yet their ability to master aesthetic stylistics, i.e., the strateg

Tutorials

RAGEAR: Retrieval-Augmented Graph-Enhanced Academic Recommender

arXiv:2605.26819v1 Announce Type: cross Abstract: We present RAGEAR (Retrieval-Augmented Graph-Enhanced Academic Recommender), a neurosymbolic recommender system for academic course recommendation. RA

tutorialsarxiv-cs-ai

Receipt Replay OOD: A Small Benchmark for Screen Replay Detection Under Domain Shift

model-releasesarxiv-cs-cv

arXiv:2605.26855v1 Announce Type: new Abstract: Public datasets such as DLC-2021, SynID, and KID34K have significantly contributed to research on presentation attack detection for identity documents,

RICE-PO: Turning Retrieval Interactions into Credit Signals for Reasoning Agents

arXiv:2605.26352v1 Announce Type: new Abstract: Retrieval is increasingly moving from one-shot matching toward interactive reasoning, where language agents iteratively inspect evidence, reformulate qu

safetyarxiv-cs-cl

Scaling, Benchmarking, and Reasoning of Vision-Language Agents for Mobile GUI Navigation

arXiv:2605.27134v1 Announce Type: new Abstract: Vision-Language Models (VLMs) have shown rapid progress in mobile GUI navigation. This paper presents a systematic study of data scaling, benchmarking,

Searching the Internet for Challenging Benchmarks at Scale

arXiv:2509.26619v3 Announce Type: replace-cross Abstract: Many static benchmarks are beginning to saturate: as models rapidly improve, they achieve near-perfect scores on fixed test sets, leaving litt

Self-Intersection-Aware 3D Human Motion Generation Using an Efficient Human Sphere Proxy

arXiv:2605.26744v1 Announce Type: new Abstract: Human motion generation has made tremendous progress in recent years, with state-of-the-art approaches surpassing ground truth data in leading evaluatio

researcharxiv-cs-cv

Shadow Unlearning: A Neuro-Semantic Approach to Fidelity-Preserving Faceless Forgetting in LLMs

arXiv:2601.04275v2 Announce Type: replace-cross Abstract: Machine unlearning aims to selectively remove the influence of specific training samples to satisfy privacy regulations such as the GDPR's 'Ri

Sleep-stage efficient classification using a lightweight self-supervised model

arXiv:2605.26295v1 Announce Type: new Abstract: Accurate classification of sleep stages is crucial for diagnosing sleep disorders and automating this process can significantly enhance clinical assessm

researcharxiv-cs-cv

SpaceVista: All-Scale Visual Spatial Reasoning from mm to km

model-releasesarxiv-cs-cv

arXiv:2510.09606v2 Announce Type: replace Abstract: With the current surge in spatial reasoning explorations, researchers have made significant progress in understanding indoor scenes, but still strug

Sparse-LiDAR Prompting of Monocular Geometry Foundations: An Empirical Study Toward Long-Range Driving Depth

arXiv:2605.26456v1 Announce Type: new Abstract: Sparse-LiDAR-prompted depth foundation models (PromptDA, Prior Depth Anything, DMD3C) have shown strong results on indoor scenes or within KITTI's stand

researcharxiv-cs-cv

Spend Your Rollouts Where It Counts: Rollout Allocation for Group-Based RL Post-Training

arXiv:2605.26606v1 Announce Type: cross Abstract: Reinforcement learning (RL) is the dominant paradigm for post-training large language models. However, in the online, on-policy setting, rollout gener

The Coverage Illusion: From Pre-retrieval Routing Failure to Post-retrieval Cascades in a Production RAG System

arXiv:2605.27220v1 Announce Type: new Abstract: In modern RAG pipelines, query augmentation methods such as HyDE and query expansion are applied to every query, resulting in substantial LLM inference

safetyarxiv-cs-cl

Verilog-Evolve: Feedback-Driven and Skill-Evolving Verilog Generation

arXiv:2605.26498v1 Announce Type: new Abstract: Large language models (LLMs) have improved Verilog generation from natural-language specifications, but most pipelines still treat generation as isolate

researcharxiv-cs-cl

When Does Adaptive Guidance Help? Belief-Aware Privileged Distillation for Autonomous Driving Under Partial Observability

arXiv:2605.26155v1 Announce Type: cross Abstract: Guided Soft Actor-Critic (GSAC) distills knowledge from a privileged full-state teacher to a partial-observation student for autonomous driving, but u

When Rule Violations Are Rare: Chimera Training for Logical Anomaly Detection

arXiv:2605.26171v1 Announce Type: new Abstract: Many practical anomalies are not merely rare inputs, but violations of semantic constraints: objects co-occur in structured ways, actions imply precondi

researcharxiv-cs-lg

Workflow Closure Is Not Scientific Closure in Auto-Research Systems

arXiv:2605.26200v1 Announce Type: cross Abstract: This paper argues that workflow closure is not scientific closure in auto-research systems. Current systems can increasingly complete research-like lo

Local Ai

YOLO26-RipeLoc Lite: A lightweight architecture for tomato ripeness detection and picking point localization in greenhouse robotic harvesting

arXiv:2605.27129v1 Announce Type: new Abstract: In greenhouse tomato production, automated harvesting requires accurate detection of ripe tomatoes, ripeness classification, and precise picking-point l

local-aiarxiv-cs-cv

A Contractive Feedback Semantics for Reinforcement Learning

arXiv:2605.24759v1 Announce Type: new Abstract: Discounted reinforcement learning is usually presented through Bellman equations on closed Markov decision processes. This paper develops a compositiona

safetyarxiv-cs-lg

A Multimodal 3D Foundation Model for Light Sheet Fluorescence Microscopy Enables Few-Shot Segmentation, Classification, and Deblurring

arXiv:2605.26026v1 Announce Type: cross Abstract: Light sheet fluorescence microscopy (LSM) enables high-resolution, three-dimensional (3D) imaging of biological specimens, providing rich volumetric d

A Signal-Language Foundation Model for Broad-Spectrum Cardiovascular Assessment from Routine Electrocardiography

arXiv:2605.25446v1 Announce Type: new Abstract: Electrocardiography (ECG) is central to cardiovascular care, but conventional AI models are often restricted to common arrhythmias and may generalize po

Applications

Actionable and diverse counterfactual explanations incorporating domain knowledge and plausibility constraints

arXiv:2511.20236v3 Announce Type: replace Abstract: Counterfactual explanations improve the actionable interpretability of machine learning models by identifying minimal changes required to achieve a

applicationsarxiv-cs-ai

Active Query Synthesis for Preference Learning

arXiv:2605.26072v1 Announce Type: new Abstract: Efficient learning of user preferences is crucial for many modern decision making systems but typically requires costly labeled data. Active learning re

researcharxiv-cs-lg

Adversarial Network Imagination: Causal LLMs and Digital Twins for Proactive Telecom Mitigation

arXiv:2602.13203v2 Announce Type: replace-cross Abstract: Telecommunication networks experience complex failures such as fiber cuts, traffic overloads, and cascading outages. Existing monitoring and d

AION: Next-Generation Tasks and Practical Harness for Time Series

arXiv:2605.25045v1 Announce Type: new Abstract: Time series research is moving beyond fixed forecasting benchmarks toward realistic tasks that combine prediction, contextual reasoning, tool use, and s

Anticipate and Learn: Unleashing Idle-Time Compute in Proactive Agents

arXiv:2605.25971v1 Announce Type: new Abstract: While AI agents demonstrate remarkable capabilities in reasoning and tool use, they remain fundamentally reactive: they compute responses only after exp

Auditing medical multi-agent AI reveals risks of false consensus

arXiv:2510.10185v2 Announce Type: replace-cross Abstract: Large language models are increasingly being assembled into medical multi-agent systems that emulate multidisciplinary consultation through sp

Automated Benchmark Auditing for AI Agents and Large Language Models

arXiv:2605.26079v1 Announce Type: new Abstract: Modern AI benchmarks operate at a complexity that outpaces traditional verification methods. Tasks authored by domain experts often contain implicit ass

Automated Detection and Classification of Delusion-related Content in Naturalistic Audio Diaries Using Multi-Agent Language Models

arXiv:2605.24755v1 Announce Type: new Abstract: Speech monologues recorded in naturalistic settings provide opportunities to characterize mental illness phenomenology and detect symptom exacerbation.

AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discovery

arXiv:2604.05550v2 Announce Type: replace Abstract: Artificial intelligence research increasingly depends on prolonged cycles of reproduction, debugging, and iterative refinement to achieve State-Of-T

agentsarxiv-cs-cl

BandVQ: Band-Wise Vector-Quantized EEG Foundation Model

arXiv:2605.24921v1 Announce Type: new Abstract: A central challenge in electroencephalography (EEG) foundation modeling is learning transferable representations across recordings with diverse tasks, m

researcharxiv-cs-lg

Benchmarking and Learning Real-World Customer Service Dialogue

arXiv:2510.22143v3 Announce Type: replace Abstract: Existing benchmarks and training pipelines for industrial intelligent customer service (ICS) remain misaligned with real-world dialogue requirements

Benchmarking Pathology Foundation Models for Spatial Domain Understanding

arXiv:2605.25764v1 Announce Type: cross Abstract: Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they

Beyond Inference-Only Deployment: Comparing Weight-Based Consolidation Against Cascading Compaction

arXiv:2605.24657v1 Announce Type: new Abstract: Major LLM platforms deploy models in an inference-only configuration: the model serves requests but never updates per-user weights. Users must repeatedl

Applications

Branched Signature Kernel Solvers for ODEs with rough Single-Trajectory signals

arXiv:2605.25826v1 Announce Type: cross Abstract: We develop a branched signature kernel solver for linear and nonlinear ordinary differential equations driven by a single observed trajectory of a pos

applicationsarxiv-cs-lg

Breaking the Chains of Probability: Neutrosophic Logic as a New Framework for Epistemic Uncertainty in Large Language Models

arXiv:2605.24053v1 Announce Type: new Abstract: Large Language Models (LLMs) are predominantly governed by probabilistic frameworks in which the sum of outcome probabilities is constrained to unity. T

Can LoRA Fusion Support Cross-Domain Tasks in Cloud-Edge Collaboration?

arXiv:2605.23913v1 Announce Type: cross Abstract: Cloud-hosted large language models (LLMs) commonly rely on LoRA for domain adaptation, yet domain data are distributed across multiple edge devices an

Contractual Skills: A GovernSpec Design Framework for Enterprise AI Agents

arXiv:2605.22634v2 Announce Type: replace-cross Abstract: Skills have become a practical packaging mechanism for agent instructions, workflows, scripts, and reference materials. In enterprise settings

Local Ai

CopulaSMOTE: A Copula-Based Oversampling Approach for Imbalanced Classification in Diabetes Prediction

arXiv:2506.17326v3 Announce Type: replace Abstract: Class imbalance remains a practical obstacle in the development of clinical prediction models for conditions such as diabetes mellitus, where the nu

local-aiarxiv-cs-lg

Cross-Domain Generalization Limits of Vision Foundation Models in Facial Deepfake Detection

arXiv:2605.24965v1 Announce Type: cross Abstract: The rapid evolution of generative models has enabled the creation of hyper-realistic facial deepfakes, exposing a critical vulnerability in modern dig

DeGRe: Dense-supervised Generative Reranking for Recommendation

arXiv:2605.25749v1 Announce Type: cross Abstract: In multi-stage recommender systems, reranking optimizes overall utility by capturing intra-list contextual dependencies, yet its central challenge lie

Local Ai

DTO: a Differentiable Training Objective for Effective Counterfactual Story Rewriting

arXiv:2605.24885v1 Announce Type: new Abstract: Counterfactual story rewriting is a natural language processing task that requires updating an existing story to reflect a chosen alternative event, yet

local-aiarxiv-cs-cl