Search: “evaluation”

CBX-Bench: A Human-Aligned MLLM Council for Benchmarking Concept Bottleneck Model Explanations

arXiv:2608.15404v1 Announce Type: new Abstract: Concept Bottleneck Models (CBMs) are designed to make visual classification interpretable by expressing predictions through human-understandable concept

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

CEDAR-GRPO: Process-Aware Reinforcement Learning for General Abductive Reasoning in LLMs

DGX agent

arXiv:2608.14791v1 Announce Type: new Abstract: Abductive reasoning, often characterized as inference to the best explanation, is central to explanation under uncertainty, from everyday sense-making a

model-releasesarxiv-cs-ai

18 Aug 2026

Certifying Compressed Language Models: An Audit and a Statistical Toolkit

model-releasesarxiv-cs-lg

arXiv:2608.15046v1 Announce Type: new Abstract: A fraction of a point of benchmark accuracy is the usual evidence that a compressed model is equivalent to its original. That quantity is least informat

Coded Hankel Polynomial Chaos: Spectral Identification of Dominant Polynomial-Chaos Modes

arXiv:2608.16126v1 Announce Type: cross Abstract: Identification of dominant polynomial-chaos modes is usually formulated as a sparse-regression problem on a sampled multivariate polynomial dictionary

researcharxiv-cs-lg

Local Ai

Comprehension of Multilingual Expressions Referring to Target Objects in Visual Inputs

arXiv:2511.11427v2 Announce Type: replace Abstract: Referring Expression Comprehension (REC) requires models to localize objects in images based on different types of natural language descriptions. Ev

local-aiarxiv-cs-cv

Comprehensive Benchmarking of Deep Learning Architectures for Lung Cancer Histopathology

arXiv:2608.15915v1 Announce Type: cross Abstract: Lung cancer remains the leading cause of cancer-related mortality worldwide, while histopathological diagnosis is often affected by inter-observer var

Cross-Domain Industrial Fault Detection by Causal Mechanism Monitoring

arXiv:2608.14666v1 Announce Type: new Abstract: Unsupervised fault detection in industrial systems is dominated by reconstruction based methods that monitor individual sensor marginal distributions. T

Decentralized Federated Learning for Heterogeneous Multi-Task Semantic Communication

arXiv:2608.15256v1 Announce Type: new Abstract: Collaborative training in distributed semantic communication (DSC) networks typically relies on decentralized federated learning (DFL). However, pushing

Depth-guided Multi-view Exposure Bracketing for HDR Robot Vision

arXiv:2608.16014v1 Announce Type: new Abstract: Achieving reliable single-shot high dynamic range (HDR) imaging under extreme illumination conditions remains a long-standing challenge, yet no comprehe

DepthArb: Training-Free Depth-Arbitrated Generation for Occlusion-Robust Image Synthesis

arXiv:2603.23924v2 Announce Type: replace Abstract: Text-to-image models often struggle to synthesize correct occlusion relationships among multiple objects, especially in densely overlapping regions.

DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models

arXiv:2505.14107v5 Announce Type: replace-cross Abstract: The emergence of groundbreaking large language models capable of performing complex reasoning tasks holds significant promise for addressing v

DiSA-IQL: Offline Reinforcement Learning for Robust Soft Robot Control under Distribution Shifts

arXiv:2510.00358v2 Announce Type: replace-cross Abstract: Soft snake robots offer remarkable flexibility and adaptability in complex environments, yet their control remains challenging due to highly n

applicationsarxiv-cs-ai

Do Assessment Instruments Measure the Same Thing for Humans and LLMs? A Latent Structure Analysis

arXiv:2608.15630v1 Announce Type: cross Abstract: The rapid development and growing deployment of large language models (LLMs) have made it increasingly important to understand their capabilities. A c

applicationsarxiv-cs-ai

Domain-Specific Text Embedding Models for Entity Resolution

arXiv:2608.16161v1 Announce Type: cross Abstract: General-purpose text embedding models are designed to capture semantic similarity but are not optimised for distinguishing entity records that represe

applicationsarxiv-cs-ai

Local Ai

DualMiT-Net: Local-Global Transformer-Convolutional Fusion for Breast Mass Segmentation in Mammographic Regions of Interest

arXiv:2608.15019v1 Announce Type: cross Abstract: Breast mass segmentation is an important step in computer-aided mammography, but it remains difficult because masses can have low contrast, irregular

local-aiarxiv-cs-ai

ER-KANs: Efficient and Robust Kolmogorov-Arnold Networks for Data-Scarce Scientific Machine Learning

arXiv:2608.14773v1 Announce Type: cross Abstract: The efficient-KAN literature---covering Chebyshev, wavelet, and radial-basis-function variants of the original Kolmogorov-Arnold Network---has been be

Evolving Executable Pipeline Programs for AutoML with Language Models

model-releasesarxiv-cs-lg

arXiv:2608.16416v1 Announce Type: new Abstract: Automated machine learning (AutoML) systems search for pipelines within a space of preprocessing operators, learners, and hyper-parameters specified in

Fast Test-Time Refinement for Robust Learned Image Compression

arXiv:2608.15113v1 Announce Type: cross Abstract: Learned image compression (LIC) has demonstrated remarkable rate-distortion (RD) performance in benign settings. However, the high representational ca

FinFraudBench: A Heterogeneous Graph Benchmark for Financial Fraud Detection

arXiv:2608.15177v1 Announce Type: cross Abstract: The increasing complexity of digital financial systems has reshaped financial fraud detection from isolated transaction classification into relational

From 'What-If' to 'What-Is': Counterfactual Thinking-Inspired Semantic Alignment for Visual Brain Decoding

arXiv:2608.15163v1 Announce Type: new Abstract: Visual brain decoding reconstructs visual content perceived by a person from neural measurements such as fMRI, providing a computational approach to stu

safetyarxiv-cs-cv

FZ-VLM: A Two Stage Florence-Zephyr Vision Language Model Framework for Pulmonary Nodule Characterization and Clinical Decision Making

arXiv:2608.15004v1 Announce Type: cross Abstract: Lung cancer remains one of the leading causes of cancer-related mortality worldwide, and Computed Tomography (CT) is a primary imaging tool for screen

GEO-Flag: Detecting and Measuring GEO-Optimized Web Content

model-releasesarxiv-cs-lg

arXiv:2608.16824v1 Announce Type: new Abstract: Generative Engine Optimization (GEO) modifies web content to increase its likelihood of being selected and cited by generative search engines. This can

Local Ai

GoalEvolve: From Handcrafted Algorithm Priors to Goal-Driven Evolution of Physical Design Algorithms

arXiv:2608.16733v1 Announce Type: cross Abstract: Physical design algorithms operate within tightly coupled, multi-stage optimization flows, where stage-local gains may vanish or induce downstream deg

local-aiarxiv-cs-ai

GraphLoom: Reliability-Calibrated Graph Evidence Routing for Multimodal KG-RAG

arXiv:2608.15056v1 Announce Type: new Abstract: Multimodal retrieval-augmented generation (RAG) systems often rely on long unstructured contexts or aggressively expanded evidence graphs, which can int

Agents

Grouping Auction-Consensus Algorithm for Decentralized Task Allocation in Multi-Robot Systems

arXiv:2608.15884v1 Announce Type: new Abstract: Decentralized multi-robot task allocation (MRTA) is essential for scalable and resilient autonomous systems. The Consensus-Based Bundle Algorithm (CBBA)

agentsarxiv-cs-ro

Handoff-H1: An Orchestrated Vision-Agent System for Material Quantity Takeoff from Construction Blueprints

arXiv:2608.15032v1 Announce Type: cross Abstract: Converting a set of architectural blueprints into a complete material quantity takeoff requires visual perception across drawing sheets, dimensional a

High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched-Grid

arXiv:2511.23043v2 Announce Type: replace-cross Abstract: We present a probabilistic data-driven weather model providing ensembles of high spatial resolution realizations of 87 variables at arbitrary

HiPHI: A Large-Scale Benchmark for High-Precision Human Motion and Object-Interaction

arXiv:2608.16222v1 Announce Type: cross Abstract: Humanoid intelligence requires learning over an extremely diverse space of whole-body motions and physically grounded interactions. However, existing

Tutorials

Identifying Harm in Personalized, Generative AI Systems Requires User-Centered Auditing at the Interaction Level

arXiv:2608.14692v1 Announce Type: cross Abstract: Personalized, generative AI systems increasingly adapt their behavior to individual users over time, fundamentally changing model behavior. While exis

tutorialsarxiv-cs-ai

Implementation of a Metacognition Framework for Self-Awareness and Self-Regulation in Ensembles of LLMs

arXiv:2608.15400v1 Announce Type: new Abstract: Large Language Models (LLMs) are notorious for struggling with assessing their own uncertainty, detecting knowledge conflicts, or recognizing when probl

Interpretable Cross-Lingual Alignment in Small Language Models: Probing Cultural and Pragmatic Reasoning in Japanese-English Bilingual LLMs

model-releasesarxiv-cs-cl

arXiv:2608.14896v1 Announce Type: new Abstract: Large language models work well on English and behave in poorly understood ways on languages typologically far from it. Japanese is a clean example, whe

IP Protection in the Era of Visual Generative AI: A Survey

arXiv:2608.14730v1 Announce Type: new Abstract: The rapid evolution of visual generative AI has introduced a wide range of intellectual property risks, spanning the unauthorized learning, reproduction

researcharxiv-cs-cv

Agents

JarvisBench: Always-on Intelligence Between Humans and Agents

arXiv:2608.14870v1 Announce Type: new Abstract: Long-horizon agents can execute continuously, but human attention remains intermittent and scarce. This creates a bidirectional coordination problem: us

agentsarxiv-cs-ai

Large Language Model Assisted Operational Monitoring for Battery Energy Storage System Integrated Power Distribution Networks

arXiv:2608.15396v1 Announce Type: new Abstract: Battery energy storage systems (BESS) are increasingly used in distribution networks for voltage regulation and demand response, which increases the vol

Large Language Models and their Awareness of Mechanics and Spatial Geometry

arXiv:2608.14615v1 Announce Type: new Abstract: Large Language Models (LLMs) perform well on established code-generation and mathematical-reasoning benchmarks, but their capabilities in mechanics and

LLM-Based Hierarchical Coordinated Control with Continuation-Aware Policy Learning

arXiv:2608.15041v1 Announce Type: new Abstract: Coordinating multiple interacting units in complex engineering systems is challenging when system interactions are difficult to model, operational infor

LLM Safety Alignment in Low-Resource Languages: A Systematic Literature Review

arXiv:2608.14626v1 Announce Type: cross Abstract: Large Language Models (LLMs) have achieved substantial progress in safety alignment, yet their safety guarantees remain significantly weaker in low-re

MathGen: Revealing the Illusion of Mathematical Competence through Text-to-Image Generation

arXiv:2603.27959v3 Announce Type: replace Abstract: Modern generative models have demonstrated the ability to solve challenging mathematical problems. In many real-world settings, however, mathematica

MITE-Net: SWaP-Optimized 4K Video Tiny Target Perception for Embodied Edge SAR

arXiv:2608.15830v1 Announce Type: new Abstract: Real-time tiny target perception in high-resolution imagery is critical for embodied Search-and-Rescue (SAR) missions. However, strict Size, Weight, and

MLLM-Guided Semantic Correction for Text-to-Video Generation

arXiv:2608.16513v1 Announce Type: cross Abstract: Recent advances in diffusion models and Transformer architectures have led to significant progress in text-to-video generation. However, these models

NumerosityVLM: A Cognitively Inspired Benchmark for Interpreting Numerosity Representations in Vision-Language Models

arXiv:2608.15425v1 Announce Type: cross Abstract: Vision-language models (VLMs) achieve strong performance on high-level multimodal tasks, yet numerosity perception, a cognitive ability that emerges i

OODBench: Out-of-Distribution Benchmark for Large Vision-Language Models

arXiv:2602.18094v2 Announce Type: replace-cross Abstract: Existing Visual-Language Models (VLMs) have achieved significant progress by being trained on massive-scale datasets, typically under the assu

Position: Medical AI Neglects Real Treatment Outcomes

arXiv:2608.14598v1 Announce Type: new Abstract: Medical AI has rapidly improved its ability to perform diagnostic and prognostic tasks that lead to treatment decisions. But understanding of treatment

Projection-based multifidelity linear regression for data-scarce applications

arXiv:2508.08517v2 Announce Type: replace-cross Abstract: Surrogate modeling for systems with high-dimensional quantities of interest remains challenging, particularly when training data are costly to

researcharxiv-cs-lg

Prompting is not enough: supervised baselines and leakage control for measuring shared decision-making with LLMs in pediatric encounters

arXiv:2608.14792v1 Announce Type: cross Abstract: Objectives: To determine whether zero-shot prompting of a large language model (LLM) is sufficient to detect shared decision-making (SDM) behaviors in

Quipu: A Governed Bitemporal Knowledge Graph Store

arXiv:2608.16813v1 Announce Type: new Abstract: Agents now write knowledge graphs, but knowledge-graph stores still carry defaults set when humans curated them: accept writes now and clean later, keep

RamseyGadgets: A Graph Construction Dataset for LLMs

arXiv:2608.14999v1 Announce Type: cross Abstract: Constructing special graphs is an important task within graph theory and computer science. Many popular graph constructions are the result of a compre

Real-time Estimator of Actuator Control and Health (REACH) on an Eel-Inspired Soft Robot

arXiv:2608.14865v1 Announce Type: new Abstract: An actuator health estimation algorithm for a soft swimming robot that can perform anguilliform swimming is developed. Due to harsh operational environm

applicationsarxiv-cs-ro