Search: “benchmark”

Reliability Testing of Medical Model Performance under Distributed Deployment

arXiv:2609.36525v1 Announce Type: cross Abstract: Distributed inference has become an indispensable part of deploying medical models under practical latency, memory, and throughput constraints. Althou

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Relic: From Multi-Agent Collaboration to Persistent Organizational Capability

DGX agent

arXiv:2609.32965v2 Announce Type: replace Abstract: Multiple agents may often conflict in an organization: for example, one coding agent changes an interface in a repository, but another continues to

model-releasesarxiv-cs-ai

30 Sept 2026

RepoMAS: Solving Progressively Specified Tasks with Issue-Driven Multi-Agent Systems

arXiv:2609.32490v2 Announce Type: replace Abstract: LLM-based multi-agent systems (MASs) have shown strong potential for solving complex tasks, but most assume that task requirements are sufficiently

Retrieve, Reproduce, Reveal: Dissecting Retrieval-Augmented Software Vulnerability Detection

arXiv:2609.37669v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) is increasingly used to enhance Large Language Model (LLM)-based software vulnerability detection by grounding pr

SalamahBench: Dialect and Category Level Safety Evaluation of Arabic Language Models

arXiv:2603.04410v3 Announce Type: replace-cross Abstract: While different stakeholders are trying to leverage Arabic Language Models (ALMs), safety alignment in ALMs remains largely underexplored, hin

Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation

arXiv:2609.37055v1 Announce Type: new Abstract: Vision-language models (VLMs) increasingly operate in embodied and spatially grounded settings, where accurate understanding of depth, viewpoint, and th

StateTape: Action-Conditioned Evidence Lifecycle Modeling for Long-Horizon Coding Agents

arXiv:2609.36319v1 Announce Type: new Abstract: Despite the recent success of coding agents built on large language models, it remains challenging to run them over long horizons, since every observati

Stochastic World Models for Verifying Vision-Based Neural Feedback Systems

arXiv:2609.38120v1 Announce Type: new Abstract: Verifying a vision-based neural feedback system requires a model of the observations its controller acts upon. Such a model must capture the variation t

Local Ai

The Commit-Abstain Circuit: Why Language Models Hallucinate Instead of Abstaining

arXiv:2609.32964v2 Announce Type: replace Abstract: Language models (LMs) often hallucinate by committing to confident answers rather than abstaining, even when they do not have enough information to

local-aiarxiv-cs-ai

The Layer Mystery of VLA: An Information-Theoretical Analysis of VLA Latent Interface

arXiv:2609.36118v1 Announce Type: new Abstract: Vision-language-action (VLA) policies connect a pretrained vision-language backbone to an action head through a latent interface, but which backbone lay

safetyarxiv-cs-ai

Towards Better Training Signal: Advantage Clipped Policy Optimization

arXiv:2609.36816v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a cornerstone for improving the reasoning capabilities of large language models (LLMs), but the need for on-polic

UnlearningSoup: Is Repeated Tuning Necessary for Large Language Model Unlearning?

arXiv:2609.37076v1 Announce Type: new Abstract: Large language models trained on vast corpora inherently risk memorizing harmful content that may later re-emerge in their outputs. To mitigate this iss

Visual sensitivity is not claim retractability: persistence-aware credit assignment for multimodal reinforcement learning

arXiv:2609.36572v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has been extended to Large Vision-Language Models (LVLMs), and perception-aware methods further en

Agents

WEFT: Scaling Tool-Use Post-Training for General-Purpose Agents

arXiv:2609.36887v1 Announce Type: new Abstract: Recent efforts to scale tool-use post-training have largely centered on the synthesis of executable environments, which constitute only one component of

agentsarxiv-cs-ai

What Comes Next? Omni-StoryBench for Evaluating Story-Grounded Omnimodal Generation

arXiv:2609.37317v1 Announce Type: new Abstract: Omnimodal evaluation should go beyond independent text, image, and speech production: individually plausible outputs may not express a coherent shared e

Local Ai

What Shared Prefixes Hide: Trajectory Dropout for On-Policy Distillation

arXiv:2609.33455v2 Announce Type: replace Abstract: On-policy distillation (OPD) trains a student model on its own trajectories using dense token-level feedback from a stronger teacher model. Since ea

local-aiarxiv-cs-ai

What You Observe Determines How You Identify Causal Effects: Evaluating Causal Models across Observational Views

arXiv:2609.36881v1 Announce Type: new Abstract: Causal foundation models (CFMs) pre-trained on data generated from various structural causal models (SCMs) have been proposed for estimating causal effe

You Cannot Recover What Was Never Measured: Quantifying the Information Ceiling of Ultra-Low-Field MRI Super-Resolution

arXiv:2609.36837v1 Announce Type: new Abstract: Generative super-resolution models can turn portable 64 mT MRI into images that look like 3T scans, and the field evaluates them with PSNR, SSIM, and pi

A Surgical Foundation Model Reveals Task-Dependent Label Efficiency

arXiv:2609.31821v1 Announce Type: new Abstract: Developing label-efficient models is a central challenge in surgical AI due to the high cost and scarcity of expert annotation. While self-supervised fo

Research

A Unified Uncertainty Representation for Graph Neural Networks via Doubly-Spectral Stochastic Expansion

arXiv:2609.35703v1 Announce Type: new Abstract: Reliable deployment of graph neural networks requires calibration, out-of-distribution (OOD) detection, and robustness to distribution shift, yet existi

researcharxiv-cs-lg

Applications

Acoustic domain shift in spoken language identification from systematic domain generalization evaluation to real-world application

arXiv:2609.31759v1 Announce Type: cross Abstract: Domain Generalization (DG) aims to develop models that remain robust to conditions unseen during training. While DG has been systematically studied in

applicationsarxiv-cs-lg

Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence

arXiv:2609.32041v1 Announce Type: new Abstract: Modern Document AI reads contracts, extracts fields, reasons over tables, and grounds answers to page regions, then forgets everything. Processing an am

ARS: Agentic Reward System for Robot Learning

arXiv:2609.34484v1 Announce Type: cross Abstract: Progress reward modeling is the problem of estimating how a robot's behavior changes task progress over time. Reliable estimation requires distinguish

AutoExpert: Automating 3D LiDAR Annotation from Expert-Crafted Guidelines

arXiv:2506.02914v3 Announce Type: replace Abstract: The contemporary paradigm of scaling data annotation, crucial for developing machine learning solutions, is to hire ordinary human annotators and in

AutoRef: Harness Optimization for Agentic Multi-Reference Image Generation

arXiv:2609.35530v1 Announce Type: new Abstract: Recent image generation models can take multiple reference images as input and combine them into a new image. However, multi-reference image generation

BALAR : A Bayesian Agentic Loop for Active Reasoning

arXiv:2605.05386v2 Announce Type: replace-cross Abstract: Large language models increasingly operate in interactive settings where solving a task requires multiple rounds of information exchange with

Agents

Be Careful Who You Trust: Coordination Dynamics under Corrupted Communication in LLM Multi-Agent Games

arXiv:2609.31704v1 Announce Type: cross Abstract: Large language models are increasingly used as interacting agents, but it remains unclear how robust their coordination is when public communication i

agentsarxiv-cs-lg

Research

Beyond Fixed Features: Architecture-Dependent Sensitivity to Node Representations under Heterophily

arXiv:2609.33764v1 Announce Type: new Abstract: Graph Neural Networks (GNNs) perform well on homophilic graphs but struggle in heterophilic settings, where connected nodes often carry dissimilar label

researcharxiv-cs-lg

Local Ai

Binaural Audio-Visual Instance Segmentation

arXiv:2609.32180v1 Announce Type: new Abstract: Audio-visual segmentation (AVS) aims to segment sounding objects at the pixel level by integrating auditory and visual cues. However, existing methods a

local-aiarxiv-cs-cv

Bison: Cross-Dataset Learning for Unseen-Compound Perturbation Prediction

arXiv:2609.32467v1 Announce Type: new Abstract: Predicting transcriptional responses to unseen compounds is limited by fragmented chemical coverage and heterogeneous experimental platforms and gene pa

Black-Box Auditing of Epistemic Reliability in Multi-Agent Debate Distillation

arXiv:2609.32361v1 Announce Type: new Abstract: Debate distillation adapts weaker verifiers using multi-agent debate transcripts to improve their judgement in subsequent debates, but gains on monitore

BREAKING: Grok is helping power America .gov, the U.S. government’s new AI website. 🇺🇸 U.S. Chief Design Officer Joe Gebbia says Grok & Ge…

model-releaseselon-musk--x

BREAKING: Grok is helping power America .gov, the U.S. government’s new AI website. 🇺🇸 U.S. Chief Design Officer Joe Gebbia says Grok & Gemini power the site. Americans can ask questions and get answe

Can Motion-Language Models Ground Structure? STRIDE for Evaluating the Evaluators

arXiv:2609.32462v1 Announce Type: new Abstract: Motion-language models are typically scored by motion-language evaluators, but how well these evaluators ground language structure remains unclear. Here

CausalDriveBench: Evaluating Causal Reasoning in Vision-Language-Action Models for Autonomous Driving

arXiv:2609.32157v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models for autonomous driving produce natural-language reasoning alongside predicted trajectories, but whether this reasoni

Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models

arXiv:2609.32185v1 Announce Type: new Abstract: Pathology vision-language models (VLMs) are conventionally evaluated by accuracy, but accuracy alone does not measure evidence use: it may conflate data

Continual Learning via Self-Probe Gradients

arXiv:2609.32771v1 Announce Type: new Abstract: Adapting pretrained models to new data can cause catastrophic forgetting of previously learned behavior. When only a few past samples remain, they give

Dimension-Specific Imbalance and an Adaptive Hybrid Label Strategy for Multi-Task Affective State Recognition in Classroom Video

arXiv:2609.31750v1 Announce Type: new Abstract: Recognition of student affective states from classroom video is constrained by a class imbalance problem whose true nature is, we argue, under-analyzed.

Domain Generalization under Sampling Pattern Shifts in Irregular Time Series

arXiv:2609.33279v1 Announce Type: new Abstract: Irregularly sampled multivariate time series (ISMTS) are prevalent in real-world applications, where both observation times and available measurements c

DRIFT: Data Selection for LLM Instruction Tuning via On-Policy Attribution

arXiv:2606.18307v2 Announce Type: replace Abstract: Data selection for instruction tuning is usually studied for efficiency, reaching strong performance with a fraction of the training data. We ask wh

EffiPair: Improving the Efficiency of LLM-generated Code with Differential Execution Feedback

arXiv:2604.05137v2 Announce Type: replace-cross Abstract: Large language models (LLMs) can generate functionally correct programs that differ substantially in execution efficiency. Existing inference-

Applications

ENet-GP: Unified Document Image Restoration

arXiv:2609.33758v1 Announce Type: new Abstract: Reliable document digitization in uncontrolled capture settings is challenging because real images exhibit multiple interacting degradations rather than

applicationsarxiv-cs-cv

ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild

arXiv:2609.34817v1 Announce Type: new Abstract: Human dexterity is guided by two eyes watching two hands: binocular vision supplies the metric 3D structure that fine-grained manipulation consumes. Ego

From Knowing to Abstaining: Bridging the Representation-Action Gap in Vision-Language Models

arXiv:2609.32653v1 Announce Type: cross Abstract: The ability of vision-language models (VLMs) to abstain from unanswerable questions is as important as their ability to answer answerable ones accurat

Gradient-Guided Decoupled Adaptation for Geospatial Vision-Language Models

arXiv:2609.32737v1 Announce Type: new Abstract: Existing geospatial vision-language models (Geo-VLMs) typically optimize diverse geospatial tasks through a unified multi-task adaptation paradigm witho

GUI-GenBench: Evaluating Image Generation Models as Interactive GUI Environments

arXiv:2602.09007v3 Announce Type: replace-cross Abstract: An image generation model used as a graphical user interface (GUI) environment must produce not only a plausible screen but also the correct r

Intuition vectors

arXiv:2609.32619v1 Announce Type: new Abstract: Large self-supervised vision models learn representations that support scene segmentation and the semantic decomposition of physical objects. We ask whe

Research

MaLiang-Harness: A Programmable Path to Image and Video Generation

arXiv:2609.34309v1 Announce Type: new Abstract: Executable programs offer explicit control over how images and videos are constructed, but generating runnable code is only the beginning of visual crea

researcharxiv-cs-cv

Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras

arXiv:2609.35658v1 Announce Type: new Abstract: Real-world capture is heterogeneous: perspective, fisheye, and 360^irc panoramic images can coexist within a single reconstruction task, yet most feed-f