Search: “evaluation”

Adding Voice Cloning to Text-to-Audio-Video Models with a Single Zero-Initialised Layer

arXiv:2608.15690v1 Announce Type: cross Abstract: Text-to-audio-video (T2AV) generation models produce a video and its soundtrack from a textual description, but offer no control over whose voice spea

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

Advancing Open and Reproducible Relational Learning: RelArena-alpha, TabPFN-Rel and RPI

DGX agent

arXiv:2608.16319v1 Announce Type: new Abstract: This first release of Prior Labs in relational learning shows our continued commitment to open science. We open-source three pieces of software that we

applicationsarxiv-cs-lg

18 Aug 2026

AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning

arXiv:2608.14721v1 Announce Type: new Abstract: Vision-language models (VLMs) have been widely employed in understanding and reasoning tasks for unmanned aerial vehicles (UAVs). Existing UAV benchmark

AI’s recursive self-improvement might not come so quickly after all

The AI industry’s boldest promise right now is that AI will soon improve itself, with almost no need for human oversight. LLMs can already write code, generate synthetic data for training, and optimiz

researchmit-tech-review

Hardware

Algorithm-Architecture Co-Design for Efficient VLA Inference via Speculative Inference and Verification

arXiv:2608.15636v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have demonstrated remarkable capabilities in the field of embodied AI, but their high computational cost and limit

hardwarearxiv-cs-ai

An Adaptive Gradient Clipping and Noise Injection Mechanism for Differentially Private Federated Learning

arXiv:2608.15153v1 Announce Type: cross Abstract: Differentially private federated learning must balance privacy protection against model accuracy and training efficiency. Static gradient clipping app

researcharxiv-cs-lg

Agents

An Agentic Framework Using Rules and LLMs for Embedding and Annotating Descriptive Document Layouts: A Plant Science Use Case

arXiv:2608.14587v1 Announce Type: new Abstract: Background: Recent advances in information retrieval (IR) leverage both dense and sparse representations, large language models (LLMs), and specialized

agentsarxiv-cs-ai

Agents

Andy: A Mathematical Agent for Rigorous Proof and Autonomous Research

arXiv:2608.15052v1 Announce Type: new Abstract: Andy is an autonomous mathematical research agent that solves and verifies submitted problems, formulates new research problems, and constructs rigorous

agentsarxiv-cs-ai

Architecture-Dependent Causal Transfer of Activation States Across Large Language Models

model-releasesarxiv-cs-cl

arXiv:2608.16347v1 Announce Type: new Abstract: Direct communication between AI systems relies on natural language as an intermediate layer, incurring encoding/decoding overhead, token cost, and laten

ARENA: Automated Red-Teaming for Large Audio Language Models

arXiv:2608.15578v1 Announce Type: cross Abstract: Large audio-language models (LALMs) make it possible to interact with language models through speech, music, and environmental sound, but they also in

Argumentation for Common Ground: Finding Zones of Possible Agreement between Individuals in Conflict

arXiv:2608.15634v1 Announce Type: new Abstract: How can common ground between societies in conflict be identified when citizens' acceptability of peace agreements is shaped by contested narratives? Su

Applications

Arm-Aware Guided Dexterous Grasp Generation with Arm-Agnostic Grasp Models

arXiv:2608.16351v1 Announce Type: new Abstract: Dexterous grasp generation that considers arm-related constraints is crucial in real-world scenarios involving arm environment collision avoidance, work

applicationsarxiv-cs-ro

Artificial Intelligence as a Tool for Combating Child Labour: A Real-Time Edge Vision Pipeline for Child Detection and Age Estimation

arXiv:2608.14770v1 Announce Type: cross Abstract: An estimated 138 million children remain in child labour worldwide, and the monitoring systems used by affected sectors, built on periodic household v

Ask, Condition or Abstain: Reinforcement Learning for Missing-Premise Reasoning

model-releasesarxiv-cs-cl

arXiv:2608.16554v1 Announce Type: new Abstract: Answer-only reinforcement learning (RL) trains reasoning models to solve fully specified problems, but many realistic queries omit a premise needed for

Applications

Assessing LLMs' mathematical abilities requires understanding the various mechanisms of mathematical creativity

arXiv:2608.16118v1 Announce Type: new Abstract: How should we assess whether large language models can perform mathematical invention? I argue that this question is currently underspecified: mathemati

applicationsarxiv-cs-ai

Automating Learner Assessment: Benchmarking Machine Learning and Deep Learning Models for EEG-Based Familiarity Prediction

arXiv:2608.16541v1 Announce Type: cross Abstract: Objective assessment of learning remains a fundamental challenge in education. Electroencephalography (EEG) provides a direct, non-invasive window int

Automating the Detection of Requirement Dependencies Using Large Language Models

arXiv:2602.22456v2 Announce Type: replace-cross Abstract: Requirements are inherently interconnected through various types of dependencies. Identifying these dependencies is essential, as they underpi

Auxiliary uncertainty signals for LLM-assisted systematic review screening: a benchmark across eight Cohen drug-class reviews

model-releasesarxiv-cs-cl

arXiv:2608.14551v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for title-abstract screening in systematic reviews, but their decisions lack calibrated uncertainty.

BagShift: Measuring How Patch Selection Changes the Evidence Seen by Whole-Slide MIL

arXiv:2608.15970v1 Announce Type: new Abstract: Whole-slide multiple-instance learning (MIL) observes only the patches admitted by its selector. Deployment can alter this selector through compute limi

researcharxiv-cs-cv

BDIP-Net: Dual-Interaction Graph Learning for Property Prediction of Bilayer Materials

arXiv:2608.14640v1 Announce Type: cross Abstract: Stacked bilayer materials exhibit rich stacking-dependent properties driven by the interplay between strong intra-layer bonding and weak inter-layer v

Applications

Beyond Binary Priorities: Multi-Tier SLA Scheduling for Large Language Model Serving

arXiv:2608.16336v1 Announce Type: cross Abstract: Modern LLM serving deployments must simultaneously satisfy heterogeneous service-level objectives (SLOs) across a diverse population of user tiers, ra

applicationsarxiv-cs-lg

Beyond Correctness: Toward Automated Novelty Verification with Lean 4

arXiv:2608.14669v1 Announce Type: new Abstract: Artificial intelligence systems applied to mathematics verify correctness but not novelty: an automatically generated theorem can compile in Lean withou

Beyond Pass@k: Measuring Reliability and Security of Agentic Code Generation

arXiv:2608.14711v1 Announce Type: new Abstract: AI coding agent benchmarks rank agents with the Chen et al. (2021) pass@k estimator, but current implementations misapply it: they set n to the number o

Beyond Similarity Matching: Structured Reasoning for Open-Vocabulary Referring Segmentation in 3DGS

arXiv:2608.16103v1 Announce Type: new Abstract: Open-vocabulary referring segmentation in 3D Gaussian Splatting (3DGS) requires a neural model to select Gaussian primitives according to free-form lang

safetyarxiv-cs-cv

Tutorials

Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoning

arXiv:2608.15869v1 Announce Type: cross Abstract: Multimodal large language models increasingly use visual chain-of-thought (Visual CoT) to reason about spatial, temporal, and embodied environments. B

tutorialsarxiv-cs-ai

Bias-Corrected Ceilings of Emotion Predictability from Human Label Variation Based on Instance-Level Fano Bounds

arXiv:2608.15619v1 Announce Type: new Abstract: Emotion recognition from text keeps improving on benchmarks, yet whether an accuracy ceiling has been reached is seldom asked with discipline. Our aim i

Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability

arXiv:2608.15475v1 Announce Type: cross Abstract: Quantized Vision-Language-Action (VLA) models expose a weight-fault surface: Rowhammer-style faults can corrupt deployed INT8 bits. We present the fir

Bounded Semantic Planning and Deterministic Compilation for Reliable Enterprise Text-to-SQL

arXiv:2608.16663v1 Announce Type: cross Abstract: Direct text-to-SQL asks a language model to do two jobs: interpret the business question and construct the complete relational query. In enterprise sc

BRAID: Learning Equilibrium Maps in Interdependent Security Games via Weight-Tied Iterative Graph Neural Networks

arXiv:2608.14856v1 Announce Type: cross Abstract: Computing Nash equilibria in interdependent security (IDS) games on networks is computationally expensive: best-response dynamics may need hundreds of

Building cost-effective, high-throughput gen AI workflows in Google Dataflow

model-releasesgoogle-cloud-ai

Real-time streaming pipelines are the operational backbone of modern enterprises, continuously processing everything from customer support interactions to transaction logs. Traditionally, streaming DA

CACSurv: Concordance-Aligned Comparative Learning with Large Language Models for Cancer Survival Prediction

arXiv:2608.16594v1 Announce Type: new Abstract: Cancer survival prediction supports treatment planning, risk stratification, and follow-up management. Existing methods use structured clinical variable

CETalk: Continuous Valence-Arousal Control for Audio-Driven 3D Talking Head Generation

arXiv:2608.15110v1 Announce Type: cross Abstract: Emotional 3D talking head generation aims to synthesize expressive facial animations with accurate lip synchronization. However, existing methods ofte

ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligence

arXiv:2608.15788v1 Announce Type: new Abstract: Spatial intelligence requires foundation models to maintain coherent spatial state across interactions with the physical world. However, existing data-c

Characterizing Rhetorical Misalignment in Decision-Making with Language Models

arXiv:2608.14630v1 Announce Type: cross Abstract: Human decision-making is often shaped by a range of well-documented cognitive biases. As large language models (LLMs) become increasingly integrated i

Chronocooked: A Benchmark for Implicit Interval Timing in Reinforcement Learning Agents

arXiv:2608.16666v1 Announce Type: new Abstract: This paper presents Chronocooked, a reinforcement learning (RL) benchmark suite for studying implicit interval timing in RL agents. Inspired by Overcook

Class Imbalance and Batch Effects in LLM-Based Screening for Systematic Reviews

arXiv:2608.14737v1 Announce Type: cross Abstract: This study analyses LLMs in imbalanced binary classification, using study screening in systematic reviews as the application domain. An experiment was

Closing the Affective Loop: Multimodal Speaker-Listener Emotion-Dynamics-Aware Empathetic Social Robots

arXiv:2608.16686v1 Announce Type: cross Abstract: Empathetic social robots should respond not only to what users say, but also to how their emotions dynamically evolve during interaction. However, exi

safetyarxiv-cs-cl

Local Ai

CM-MAE: A Physics-Guided Cross-Modal Self-Supervised Learning Framework for Vision-Wireless Applications

arXiv:2608.15972v1 Announce Type: cross Abstract: Synchronized camera and wireless measurements observe the same scene through different physical channels. The central difficulty is that a representat

local-aiarxiv-cs-ai

Computational KJ-Ho: An Analyst-Bias-Free Insight Extraction Framework from Large-Scale Qualitative Data Using Domain-Specialized LLMs

arXiv:2608.16467v1 Announce Type: cross Abstract: The qualitative research methodologies that underpin consumer-insight generation - the KJ method, Grounded Theory, and Thematic Analysis - share a str

safetyarxiv-cs-cl

Concept-based explanation of gene expression prediction from H&E images

arXiv:2608.16669v1 Announce Type: new Abstract: Recent advances in pathology foundation models have enabled accurate prediction of spatial transcriptomics (ST) from routine H&E images. However, existi

researcharxiv-cs-cv

Constraint-Aware Synthetic Tabular Data Generation via Inter-Column Constraint Discovery with LLM Agents

arXiv:2608.15109v1 Announce Type: new Abstract: Generating structurally valid synthetic tabular data remains difficult: outputs with high statistical fidelity and downstream utility can still violate

Convolution-Free Holistic Multivariance Decomposition Layer for Efficient Hyperspectral Image Classification Tensor Networks

arXiv:2608.16241v1 Announce Type: new Abstract: Feature extraction for hyperspectral image classification is conventionally addressed using rigid tensor decompositions that fail to capture complex spa

Convolution Smoothed Quantile Regression for XGBoost

arXiv:2608.15290v1 Announce Type: cross Abstract: The increasing availability of large and complex datasets across many scientific disciplines has led to widespread adoption of machine learning (ML) f

Credit Fairness: Online Fairness In Shared Resource Pools

arXiv:2601.17944v2 Announce Type: replace-cross Abstract: We study repeated allocation of shared resources among agents with time-varying demands and capped linear utilities. In this setting, independ

CrevasseSeg: A Label-Efficient UAV Crevasse Segmentation Framework

arXiv:2608.15790v1 Announce Type: new Abstract: Crevasse mapping from uncrewed aerial vehicle (UAV) imagery matters for glaciological research and for field safety in glaciated terrain. Yet, pixel-lev

Cross-View Urban Sensing: Mapping Subjective Streetscape Perception via AlphaEarth Embeddings and Urban Context

arXiv:2608.16310v1 Announce Type: new Abstract: Residents' perception of the urban streetscape is an important factor in public health, active mobility, and social wellbeing. Street view imagery (SVI)

researcharxiv-cs-cv

CrossView: Can Vision-Language Models Reason Across Cameras?

arXiv:2608.15539v1 Announce Type: new Abstract: Video understanding benchmarks have long centered on single-camera settings, where modern multi-modal language models achieve strong performance across

CulTrace: Tracing Internal Cultural Reasoning in Large Language Models

arXiv:2508.08879v3 Announce Type: replace-cross Abstract: The growing deployment of large language models (LLMs) across diverse cultural contexts necessitates a deeper understanding of models' hidden