Search: “benchmark”

SaaS-Bench: Can Computer-Use Agents Leverage Real-World SaaS to Solve Professional Workflows?

arXiv:2605.15777v1 Announce Type: new Abstract: Computer-Using Agents (CUAs) are rapidly extending large language models (LLMs) beyond text-based reasoning toward action execution in more complex envi

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Skyra: AI-Generated Video Detection via Grounded Artifact Reasoning

DGX agent

arXiv:2512.15693v2 Announce Type: replace Abstract: The misuse of AI-driven video generation technologies has raised serious social concerns, highlighting the urgent need for reliable AI-generated vid

model-releasesarxiv-cs-cv

18 May 2026

Transformer Scalability Crisis: The First Comprehensive Empirical Analysis of Performance Walls in Modern Language Models

arXiv:2605.15413v1 Announce Type: new Abstract: Despite the remarkable success of transformer architectures in natural language processing, their scalability limitations remain poorly understood throu

Video Models Can Reason with Verifiable Rewards

arXiv:2605.15458v1 Announce Type: new Abstract: Video diffusion models have made rapid progress in perceptual realism and temporal coherence, but they remain primarily optimized for plausible generati

safetyarxiv-cs-cv

Visual Compositional Tuning

arXiv:2504.21850v3 Announce Type: replace Abstract: Visual instruction tuning (VIT) datasets have grown rapidly in scale, yet the informativeness of individual training samples has largely been overlo

researcharxiv-cs-cv

Zero-Shot Goal Recognition with Large Language Models

arXiv:2605.15333v1 Announce Type: new Abstract: Large language models have recently reached near-parity with classical planners on well-known planning domains, yet this competence relies on world-know

AgenticEval: Toward Agentic and Self-Evolving Safety Evaluation of Large Language Models

arXiv:2509.26100v2 Announce Type: replace Abstract: The rapid integration of Large Language Models (LLMs) into high-stakes domains necessitates reliable safety and compliance evaluation. However, exis

AIS: Adaptive Importance Sampling for Quantized RL

arXiv:2605.13907v1 Announce Type: cross Abstract: Reinforcement learning (RL) for large language models (LLMs) is dominated by the cost of rollout generation, which has motivated the use of low-precis

safetyarxiv-cs-ai

Auditing Agent Harness Safety

arXiv:2605.14271v1 Announce Type: new Abstract: LLM agents increasingly run inside execution harnesses that dispatch tools, allocate resources, and route messages between specialized components. Howev

Beyond AI as Assistants: Toward Autonomous Discovery in Cosmology

arXiv:2605.14791v1 Announce Type: cross Abstract: Recent advances in artificial intelligence (AI) agents are pushing AI beyond tools toward autonomous scientific discovery. We discuss two complementar

Beyond Mode-Seeking RL: Trajectory-Balance Post-Training for Diffusion Language Models

arXiv:2605.13935v1 Announce Type: cross Abstract: Diffusion language models are a promising alternative to autoregressive models, yet post-training methods for them largely adapt reward-maximizing obj

Agents

Concurrency without Model Changes: Future-based Asynchronous Function Calling for LLMs

arXiv:2605.15077v1 Announce Type: cross Abstract: Function calling, also known as tool use, is a core capability of modern LLM agents but is typically constrained by synchronous execution semantics. U

agentsarxiv-cs-ai

Denoising-GS: Gaussian Splatting with Spatial-aware Denoising

arXiv:2605.14880v1 Announce Type: new Abstract: Recent advances in 3D Gaussian Splatting (3DGS) have achieved remarkable success in high-fidelity Novel View Synthesis (NVS), yet the optimization proce

EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agents

arXiv:2605.13941v1 Announce Type: cross Abstract: Long-term memory is essential for LLM agents that operate across multiple sessions, yet existing memory systems treat retrieval infrastructure as fixe

Hidden State Poisoning Attacks against Mamba-based Language Models

arXiv:2601.01972v4 Announce Type: cross Abstract: State space models (SSMs) like Mamba offer efficient alternatives to Transformer-based language models, with linear time complexity. Yet, their advers

In-Context Learning for Data-Driven Censored Inventory Control

arXiv:2605.14840v1 Announce Type: new Abstract: We study inventory control with decision-dependent censoring, focusing on the censored or repeated newsvendor (R-NV), where each order quantity determin

Indian Wedding System Optimization (IWSO): A Novel Socially Inspired Metaheuristic with Operational Design and Analysis

arXiv:2605.13871v1 Announce Type: cross Abstract: This paper presents a novel population-based metaheuristic, Indian Wedding System Optimization (IWSO), inspired by the socio-cultural dynamics of trad

MahaVar: OOD Detection via Class-wise Mahalanobis Distance Variance under Neural Collapse

arXiv:2605.14413v1 Announce Type: cross Abstract: Out-of-distribution (OOD) detection is a critical component for ensuring the reliability of deep neural networks in safety-critical applications. In t

MechVerse: Evaluating Physical Motion Consistency in Video Generation Models

arXiv:2605.14843v1 Announce Type: new Abstract: Text- and image-conditioned video generation models have achieved strong visual fidelity and temporal coherence, but they often fail to generate motion

MemReranker: Reasoning-Aware Reranking for Agent Memory Retrieval

arXiv:2605.06132v2 Announce Type: replace Abstract: In agent memory systems, the reranking model serves as the critical bridge connecting user queries with long-term memory. Most systems adopt the 're

Mitigating Mask Prior Drift and Positional Attention Collapse in Large Diffusion Vision-Language Models

arXiv:2605.14530v1 Announce Type: new Abstract: Large diffusion vision-language models (LDVLMs) have recently emerged as a promising alternative to autoregressive models, enabling parallel decoding fo

safetyarxiv-cs-cv

Neural Signals Generate Clinical Notes in the Wild

arXiv:2601.22197v3 Announce Type: replace-cross Abstract: Generating clinical reports that summarize abnormal patterns, diagnostic findings, and clinical interpretations from long-term EEG recordings

pi-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows

arXiv:2605.14678v1 Announce Type: new Abstract: The rise of personal assistant agents, e.g., OpenClaw, highlights the growing potential of large language models to support users across everyday life a

QOuLiPo: What a quantum computer sees when it reads a book

arXiv:2605.14188v1 Announce Type: cross Abstract: What does a book look like to a quantum computer? This paper takes eight classical works of the Renaissance and its late-antique inheritance -- from A

RefDecoder: Enhancing Visual Generation with Conditional Video Decoding

arXiv:2605.15196v1 Announce Type: new Abstract: Video generation powers a vast array of downstream applications. However, while the de facto standard, i.e., latent diffusion models, typically employ h

Rethinking Molecular OOD Generalization via Target-Aware Source Selection

arXiv:2605.13932v1 Announce Type: new Abstract: Robust prediction of molecular properties under extreme out-of-distribution (OOD) scenarios is a pivotal bottleneck in AI-driven drug discovery. Current

Road Maps as Free Geometric Priors: Weather-Invariant Drone Geo-Localization with GeoFuse

arXiv:2605.14925v1 Announce Type: new Abstract: Drone-view geo-localization aims to match a query drone image, often captured under adverse weather conditions (e.g., rain, snow, fog), against a galler

safetyarxiv-cs-cv

ROK-FORTRESS: Measuring the Effect of Geopolitical Transcreation for National Security and Public Safety

arXiv:2605.14152v1 Announce Type: cross Abstract: Safety evaluations for large language models (LLMs) increasingly target high-stakes National Security and Public Safety (NSPS) risks, yet multilingual

Sat3DGen: Comprehensive Street-Level 3D Scene Generation from Single Satellite Image

arXiv:2605.14984v1 Announce Type: cross Abstract: Generating a street-level 3D scene from a single satellite image is a crucial yet challenging task. Current methods present a stark trade-off: geometr

SCOOTER: A Human Evaluation Framework for Unrestricted Adversarial Examples

arXiv:2507.07776v3 Announce Type: replace Abstract: Unrestricted adversarial attacks aim to fool computer vision models without being constrained by ell_p-norm bounds to remain imperceptible to humans

Sheaf-Theoretic Transport and Obstruction for Detecting Scientific Theory Shift in AI Agents

arXiv:2605.14033v1 Announce Type: new Abstract: Scientific theory shift in AI agents requires more than fitting equations to data. An artificial scientific agent must detect whether an existing repres

Stateful Reasoning via Insight Replay

arXiv:2605.14457v1 Announce Type: new Abstract: Chain-of-Thought (CoT) reasoning has become a foundation for eliciting multi-step reasoning in large language models, but recent studies show that its b

TabPFN-3: Technical Report

arXiv:2605.13986v1 Announce Type: new Abstract: Tabular data underpins most high-value prediction problems in science and industry, and TabPFN has driven the foundation model revolution for this modal

Teaching and Evaluating LLMs to Reason About Polymer Design Related Tasks

arXiv:2601.16312v2 Announce Type: replace-cross Abstract: Research in AI4Science has shown promise in many science applications, including polymer design. However, current LLMs are ineffective in this

Local Ai

Venus-DeFakerOne: Unified Fake Image Detection & Localization

arXiv:2605.14091v1 Announce Type: new Abstract: In recent years, the rapid evolution of generative AI has fundamentally reshaped the paradigm of image forgery, breaking the traditional boundaries betw

local-aiarxiv-cs-cv

Tutorials

What Do EEG Foundation Models Capture from Human Brain Signals?

arXiv:2605.11410v2 Announce Type: replace Abstract: Clinical electroencephalogram (EEG) analysis rests on a hand-crafted feature catalog refined over decades, e.g., band power, connectivity, complexit

tutorialsarxiv-cs-ai

XDomainBench: Diagnosing Reasoning Collapse in High-Dimensional Scientific Knowledge Composition

arXiv:2605.14754v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly deployed for knowledge synthesis, yet their capacity for compositional generalization in scientific knowle

Are Compact Rationales Free? Measuring Tile Selection Headroom in Frozen WSI-MIL

arXiv:2605.12575v1 Announce Type: cross Abstract: Whole-slide image (WSI) multiple instance learning (MIL) classifiers can achieve strong slide-level AUC while leaving the full-bag prediction opaque.

researcharxiv-cs-ai

ASAP: Amortized Doubly-Stochastic Attention via Sliced Dual Projection

arXiv:2605.12879v1 Announce Type: new Abstract: Doubly-stochastic attention has emerged as a transport-based alternative to row-softmax attention, with recent Transformer variants using it to reduce a

Bayesian Model Merging

arXiv:2605.12843v1 Announce Type: cross Abstract: Model merging aims to combine multiple task-specific expert models into a single model without joint retraining, offering a practical alternative to m

Agents

Cognifold: Always-On Proactive Memory via Cognitive Folding

arXiv:2605.13438v1 Announce Type: new Abstract: Existing agent memory remains predominantly reactive and retrieval-based, lacking the capacity to autonomously organize experience into persistent cogni

agentsarxiv-cs-ai

CoRe-Gen: Robust Spectrum-to-Structure Generation under Imperfect Fingerprint Conditions

arXiv:2605.12980v1 Announce Type: cross Abstract: Molecular structure elucidation from tandem mass spectra (MS/MS) remains challenging, particularly for de novo generation beyond database coverage. A

DistractMIA: Black-Box Membership Inference on Vision-Language Models via Semantic Distraction

arXiv:2605.12574v1 Announce Type: cross Abstract: Vision-language models (VLMs) are trained on large-scale image-text corpora that may contain private, copyrighted, or otherwise sensitive data, motiva

Do Activation Verbalization Methods Convey Privileged Information?

arXiv:2509.13316v4 Announce Type: replace-cross Abstract: Recent interpretability methods have proposed to translate LLM internal representations into natural language descriptions using a second verb

researcharxiv-cs-lg

Ego2World: Compiling Egocentric Cooking Videos into Executable Worlds for Belief-State Planning

arXiv:2605.13335v1 Announce Type: new Abstract: Embodied agents in household environments must plan under partial observation: they need to remember objects, track state changes, and recover when acti

EVA-Bench: A New End-to-end Framework for Evaluating Voice Agents

arXiv:2605.13841v1 Announce Type: cross Abstract: Voice agents, artificial intelligence systems that conduct spoken conversations to complete tasks, are increasingly deployed across enterprise applica

From Heuristics to Analytics: Forecasting Effort and Progress in Online Learning

arXiv:2605.12788v1 Announce Type: new Abstract: Sustained effort is essential for realizing the benefits of intelligent tutoring systems (ITS), yet many learners disengage or underuse available practi

GeoFlowVLM: Geometry-Aware Joint Uncertainty for Frozen Vision-Language Embedding

arXiv:2605.13352v1 Announce Type: new Abstract: Standard dual-encoder vision-language models that map images and text to deterministic points on a shared unit hypersphere through ell_2 normalization t

researcharxiv-cs-lg