Search: “evaluation”

ARENA: Automated Red-Teaming for Large Audio Language Models

arXiv:2608.15578v1 Announce Type: cross Abstract: Large audio-language models (LALMs) make it possible to interact with language models through speech, music, and environmental sound, but they also in

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Argumentation for Common Ground: Finding Zones of Possible Agreement between Individuals in Conflict

DGX agent

arXiv:2608.15634v1 Announce Type: new Abstract: How can common ground between societies in conflict be identified when citizens' acceptability of peace agreements is shaped by contested narratives? Su

safetyarxiv-cs-ai

18 Aug 2026

Arm-Aware Guided Dexterous Grasp Generation with Arm-Agnostic Grasp Models

arXiv:2608.16351v1 Announce Type: new Abstract: Dexterous grasp generation that considers arm-related constraints is crucial in real-world scenarios involving arm environment collision avoidance, work

applicationsarxiv-cs-ro

Artificial Intelligence as a Tool for Combating Child Labour: A Real-Time Edge Vision Pipeline for Child Detection and Age Estimation

arXiv:2608.14770v1 Announce Type: cross Abstract: An estimated 138 million children remain in child labour worldwide, and the monitoring systems used by affected sectors, built on periodic household v

Ask, Condition or Abstain: Reinforcement Learning for Missing-Premise Reasoning

model-releasesarxiv-cs-cl

arXiv:2608.16554v1 Announce Type: new Abstract: Answer-only reinforcement learning (RL) trains reasoning models to solve fully specified problems, but many realistic queries omit a premise needed for

Assessing LLMs' mathematical abilities requires understanding the various mechanisms of mathematical creativity

arXiv:2608.16118v1 Announce Type: new Abstract: How should we assess whether large language models can perform mathematical invention? I argue that this question is currently underspecified: mathemati

applicationsarxiv-cs-ai

Automating Learner Assessment: Benchmarking Machine Learning and Deep Learning Models for EEG-Based Familiarity Prediction

arXiv:2608.16541v1 Announce Type: cross Abstract: Objective assessment of learning remains a fundamental challenge in education. Electroencephalography (EEG) provides a direct, non-invasive window int

Automating the Detection of Requirement Dependencies Using Large Language Models

arXiv:2602.22456v2 Announce Type: replace-cross Abstract: Requirements are inherently interconnected through various types of dependencies. Identifying these dependencies is essential, as they underpi

Auxiliary uncertainty signals for LLM-assisted systematic review screening: a benchmark across eight Cohen drug-class reviews

model-releasesarxiv-cs-cl

arXiv:2608.14551v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for title-abstract screening in systematic reviews, but their decisions lack calibrated uncertainty.

BagShift: Measuring How Patch Selection Changes the Evidence Seen by Whole-Slide MIL

arXiv:2608.15970v1 Announce Type: new Abstract: Whole-slide multiple-instance learning (MIL) observes only the patches admitted by its selector. Deployment can alter this selector through compute limi

BDIP-Net: Dual-Interaction Graph Learning for Property Prediction of Bilayer Materials

arXiv:2608.14640v1 Announce Type: cross Abstract: Stacked bilayer materials exhibit rich stacking-dependent properties driven by the interplay between strong intra-layer bonding and weak inter-layer v

Beyond Binary Priorities: Multi-Tier SLA Scheduling for Large Language Model Serving

arXiv:2608.16336v1 Announce Type: cross Abstract: Modern LLM serving deployments must simultaneously satisfy heterogeneous service-level objectives (SLOs) across a diverse population of user tiers, ra

applicationsarxiv-cs-lg

Beyond Correctness: Toward Automated Novelty Verification with Lean 4

arXiv:2608.14669v1 Announce Type: new Abstract: Artificial intelligence systems applied to mathematics verify correctness but not novelty: an automatically generated theorem can compile in Lean withou

Beyond Pass@k: Measuring Reliability and Security of Agentic Code Generation

arXiv:2608.14711v1 Announce Type: new Abstract: AI coding agent benchmarks rank agents with the Chen et al. (2021) pass@k estimator, but current implementations misapply it: they set n to the number o

Beyond Similarity Matching: Structured Reasoning for Open-Vocabulary Referring Segmentation in 3DGS

arXiv:2608.16103v1 Announce Type: new Abstract: Open-vocabulary referring segmentation in 3D Gaussian Splatting (3DGS) requires a neural model to select Gaussian primitives according to free-form lang

safetyarxiv-cs-cv

Tutorials

Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoning

arXiv:2608.15869v1 Announce Type: cross Abstract: Multimodal large language models increasingly use visual chain-of-thought (Visual CoT) to reason about spatial, temporal, and embodied environments. B

tutorialsarxiv-cs-ai

Bias-Corrected Ceilings of Emotion Predictability from Human Label Variation Based on Instance-Level Fano Bounds

arXiv:2608.15619v1 Announce Type: new Abstract: Emotion recognition from text keeps improving on benchmarks, yet whether an accuracy ceiling has been reached is seldom asked with discipline. Our aim i

safetyarxiv-cs-ai

Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability

arXiv:2608.15475v1 Announce Type: cross Abstract: Quantized Vision-Language-Action (VLA) models expose a weight-fault surface: Rowhammer-style faults can corrupt deployed INT8 bits. We present the fir

Bounded Semantic Planning and Deterministic Compilation for Reliable Enterprise Text-to-SQL

arXiv:2608.16663v1 Announce Type: cross Abstract: Direct text-to-SQL asks a language model to do two jobs: interpret the business question and construct the complete relational query. In enterprise sc

BRAID: Learning Equilibrium Maps in Interdependent Security Games via Weight-Tied Iterative Graph Neural Networks

arXiv:2608.14856v1 Announce Type: cross Abstract: Computing Nash equilibria in interdependent security (IDS) games on networks is computationally expensive: best-response dynamics may need hundreds of

Building cost-effective, high-throughput gen AI workflows in Google Dataflow

model-releasesgoogle-cloud-ai

Real-time streaming pipelines are the operational backbone of modern enterprises, continuously processing everything from customer support interactions to transaction logs. Traditionally, streaming DA

CACSurv: Concordance-Aligned Comparative Learning with Large Language Models for Cancer Survival Prediction

arXiv:2608.16594v1 Announce Type: new Abstract: Cancer survival prediction supports treatment planning, risk stratification, and follow-up management. Existing methods use structured clinical variable

CETalk: Continuous Valence-Arousal Control for Audio-Driven 3D Talking Head Generation

arXiv:2608.15110v1 Announce Type: cross Abstract: Emotional 3D talking head generation aims to synthesize expressive facial animations with accurate lip synchronization. However, existing methods ofte

ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligence

arXiv:2608.15788v1 Announce Type: new Abstract: Spatial intelligence requires foundation models to maintain coherent spatial state across interactions with the physical world. However, existing data-c

Characterizing Rhetorical Misalignment in Decision-Making with Language Models

arXiv:2608.14630v1 Announce Type: cross Abstract: Human decision-making is often shaped by a range of well-documented cognitive biases. As large language models (LLMs) become increasingly integrated i

safetyarxiv-cs-ai

Chronocooked: A Benchmark for Implicit Interval Timing in Reinforcement Learning Agents

arXiv:2608.16666v1 Announce Type: new Abstract: This paper presents Chronocooked, a reinforcement learning (RL) benchmark suite for studying implicit interval timing in RL agents. Inspired by Overcook

Class Imbalance and Batch Effects in LLM-Based Screening for Systematic Reviews

arXiv:2608.14737v1 Announce Type: cross Abstract: This study analyses LLMs in imbalanced binary classification, using study screening in systematic reviews as the application domain. An experiment was

Closing the Affective Loop: Multimodal Speaker-Listener Emotion-Dynamics-Aware Empathetic Social Robots

arXiv:2608.16686v1 Announce Type: cross Abstract: Empathetic social robots should respond not only to what users say, but also to how their emotions dynamically evolve during interaction. However, exi

safetyarxiv-cs-cl

CM-MAE: A Physics-Guided Cross-Modal Self-Supervised Learning Framework for Vision-Wireless Applications

arXiv:2608.15972v1 Announce Type: cross Abstract: Synchronized camera and wireless measurements observe the same scene through different physical channels. The central difficulty is that a representat

local-aiarxiv-cs-ai

Computational KJ-Ho: An Analyst-Bias-Free Insight Extraction Framework from Large-Scale Qualitative Data Using Domain-Specialized LLMs

arXiv:2608.16467v1 Announce Type: cross Abstract: The qualitative research methodologies that underpin consumer-insight generation - the KJ method, Grounded Theory, and Thematic Analysis - share a str

safetyarxiv-cs-cl

Concept-based explanation of gene expression prediction from H&E images

arXiv:2608.16669v1 Announce Type: new Abstract: Recent advances in pathology foundation models have enabled accurate prediction of spatial transcriptomics (ST) from routine H&E images. However, existi

Constraint-Aware Synthetic Tabular Data Generation via Inter-Column Constraint Discovery with LLM Agents

arXiv:2608.15109v1 Announce Type: new Abstract: Generating structurally valid synthetic tabular data remains difficult: outputs with high statistical fidelity and downstream utility can still violate

Convolution-Free Holistic Multivariance Decomposition Layer for Efficient Hyperspectral Image Classification Tensor Networks

arXiv:2608.16241v1 Announce Type: new Abstract: Feature extraction for hyperspectral image classification is conventionally addressed using rigid tensor decompositions that fail to capture complex spa

Convolution Smoothed Quantile Regression for XGBoost

arXiv:2608.15290v1 Announce Type: cross Abstract: The increasing availability of large and complex datasets across many scientific disciplines has led to widespread adoption of machine learning (ML) f

Credit Fairness: Online Fairness In Shared Resource Pools

arXiv:2601.17944v2 Announce Type: replace-cross Abstract: We study repeated allocation of shared resources among agents with time-varying demands and capped linear utilities. In this setting, independ

safetyarxiv-cs-ai

CrevasseSeg: A Label-Efficient UAV Crevasse Segmentation Framework

arXiv:2608.15790v1 Announce Type: new Abstract: Crevasse mapping from uncrewed aerial vehicle (UAV) imagery matters for glaciological research and for field safety in glaciated terrain. Yet, pixel-lev

Cross-View Urban Sensing: Mapping Subjective Streetscape Perception via AlphaEarth Embeddings and Urban Context

arXiv:2608.16310v1 Announce Type: new Abstract: Residents' perception of the urban streetscape is an important factor in public health, active mobility, and social wellbeing. Street view imagery (SVI)

CrossView: Can Vision-Language Models Reason Across Cameras?

arXiv:2608.15539v1 Announce Type: new Abstract: Video understanding benchmarks have long centered on single-camera settings, where modern multi-modal language models achieve strong performance across

CulTrace: Tracing Internal Cultural Reasoning in Large Language Models

arXiv:2508.08879v3 Announce Type: replace-cross Abstract: The growing deployment of large language models (LLMs) across diverse cultural contexts necessitates a deeper understanding of models' hidden

Data-Efficient and Interpretable Classification of Circulating Tumor Cell Phenotypes in Microfluidic Devices via Deep Learning

arXiv:2608.16870v1 Announce Type: new Abstract: Accurate classification of circulating tumor cell (CTC) phenotypes can provide valuable information for assessing metastatic potential. Label free micro

local-aiarxiv-cs-lg

DCA-MoE: Spatially Adaptive Cross-Layer Fusion and Density-Routed Experts for Crowd Counting

arXiv:2608.15213v1 Announce Type: new Abstract: Crowd counting must recover reliable local density under severe variations in perspective, head scale, occlusion, and background clutter. Although moder

local-aiarxiv-cs-cv

Decorrelation Is Not Complementarity: Skill, Not Lineage, Governs Trusted-Monitor Ensembles

arXiv:2608.16190v1 Announce Type: cross Abstract: Trusted monitoring has a cheap, trusted model score a stronger untrusted model's actions, and a diverse ensemble of them beats a single stronger monit

researcharxiv-cs-lg

Deep Learning for BioImaging: What Are We Really Learning?

arXiv:2603.13377v2 Announce Type: replace Abstract: Representation learning has driven major advances in natural image analysis by enabling models to acquire high-level semantic features. In microscop

Deep Probabilistic Indoor Gas Source Localization via Physical Dependency-Guided Sequential Inference

arXiv:2608.16221v1 Announce Type: new Abstract: Reliable gas source localization (GSL) is critical to safety in industrial and urban environments, yet remains challenging indoors because walls and obs

local-aiarxiv-cs-ro

Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection

arXiv:2608.16259v1 Announce Type: cross Abstract: The rapid progress of image generation models calls for AI-generated image (AIGI) detectors that are not only accurate but also explainable and reliab

Demand-Driven Vertiport Siting and Discrete-Event Fleet Simulation for On-Demand Urban Air Mobility Network Design

arXiv:2608.14974v1 Announce Type: new Abstract: This paper presents a demand-driven framework for on-demand Urban Air Mobility (UAM) network design that links vertiport siting, fleet simulation, and d

applicationsarxiv-cs-ai

Deploying Frontier Agentic Technology in MOOSEnger, a Multiphysics-Capable AI Assistant

arXiv:2608.15881v1 Announce Type: new Abstract: The Multiphysics Object-Oriented Simulation Environment (MOOSE) is an open-source finite-element framework for building multiphysics simulation applicat

Detector-Augmented SAMURAI for Long-Duration Drone Tracking

arXiv:2601.04798v2 Announce Type: replace Abstract: Robust long-term tracking of drone is a critical requirement for modern surveillance systems, given their increasing threat potential. While detecto