Search: “benchmark”

LEGIT: Credentialing Protocol for Trustworthy AI Agent Marketplaces

arXiv:2609.21325v1 Announce Type: new Abstract: Agentic marketplaces are emerging where AI agents with varying capabilities autonomously complete specialized tasks for buyers. A major challenge of suc

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

LEMCA: LLM-Guided Synthesis of Efficient Mode-Switching Control Architectures

DGX agent

arXiv:2609.21319v1 Announce Type: new Abstract: Physical control tasks in the natural world, such as driving or object manipulation, frequently exhibit dramatic variations in sensory and compute compl

researcharxiv-cs-ro

21 Sept 2026

LogicTrack: Auditing Reasoning Trajectories of Large Language Models with Formal Logic Solvers

arXiv:2609.21492v1 Announce Type: new Abstract: Chain-of-Thought (CoT) reasoning has been shown to improve the performance of large language models (LLMs), yet existing optimization methods largely re

researcharxiv-cs-ai

Agents

MACE: Memory-Agent Co-Evolution with Adaptive Memory Graphs for Multi-Agent Systems

arXiv:2609.21533v1 Announce Type: new Abstract: LLM-based multi-agent systems generate collaboration traces that record how agents plan tasks, verify intermediate results, and repair failures. Reusing

agentsarxiv-cs-lg

MAGIC: Marginal-Guided Compression with Optimal Transport for Efficient Visual Document Retrieval

arXiv:2609.21018v1 Announce Type: new Abstract: Recent visual document retrieval (VDR) systems such as ColPali use multi-vector page embeddings, in which patch-level vectors enable fine-grained eviden

researcharxiv-cs-cv

Applications

Maximizing Apache Spark availability: Mitigating compute stockouts with flexible VMs and other best practices

applicationsgoogle-cloud-ai

The surge in AI development has created unprecedented demand for compute capacity around the globe. This can have negative implications for data processing and pipelines with Apache Spark. Whether you

MiMo-V2.6-Pro debuts as the top open weights model on the Artificial Analysis Intelligence Index (46). At $0.13 per Intelligence Index task,…

model-releasesclem-delangue--x

MiMo-V2.6-Pro debuts as the top open weights model on the Artificial Analysis Intelligence Index (46). At 0.13 per Intelligence Index task, it lands on the Intelligence vs. Cost per Task Pareto fronti

MintAct: A Unified Visual Agent for Digital Environments

arXiv:2609.22083v1 Announce Type: new Abstract: We present MintAct, a family of vision-language models that unifies UI grounding, multi-step navigation across mobile, desktop, and web, and visual tool

safetyarxiv-cs-cv

Agents

MIRAGE: Multi-Perspective Creative Language Model Reasoning with Reinforcement Learning Guidance

arXiv:2609.21554v1 Announce Type: new Abstract: Recent advances in Large Language Models (LLMs) have revolutionized artificial intelligence and how human interact with AIs. Despite impressive advancem

agentsarxiv-cs-cl

MOSAIC-SR: Transformer-Guided Symbolic Regression for Scientific Equation Recovery

arXiv:2609.20997v1 Announce Type: new Abstract: Symbolic regression aims to recover closed-form equations from observations, providing interpretable models for scientific discovery. Existing approache

researcharxiv-cs-lg

Tutorials

Multi-Domain Clustering via Measure Quantization

arXiv:2609.21664v1 Announce Type: new Abstract: Clustering is a fundamental task in data analysis, typically addressed through centroid-based methods such as K-means. In this work, we present a genera

tutorialsarxiv-cs-lg

Neural Cellular Automata Learn General Features in their Hidden Channels

arXiv:2609.21870v1 Announce Type: cross Abstract: Modern deep learning models achieve impressive generalization through over-parameterization, but this paradigm often struggles with overfitting and me

P^3-SAM: SAM with Perceptual Parallel Prompt for Few-Shot Strip Steel Surface Defect Segmentation

arXiv:2609.21424v1 Announce Type: new Abstract: Few-shot semantic segmentation (FSS) of strip steel surface defects (S^3D) has posed significant challenges distinct from natural scenes. Unlike natural

local-aiarxiv-cs-cv

Particle Competition and Cooperation for Robust Graph Convolutional Network Learning Under Label Noise

arXiv:2609.22053v1 Announce Type: new Abstract: Graph Convolutional Networks (GCNs) are highly sensitive to label noise, since corrupted supervision can propagate through the graph and degrade learned

Predictable Failure in Multi-Hop Retrieval: Score-Distributional Confidence Scoring and Abstention

arXiv:2609.22056v1 Announce Type: cross Abstract: Multi-hop retrieval failures are not uniformly distributed across queries: they cluster in structurally predictable subpopulations. We prove two resul

safetyarxiv-cs-cl

PRIME: Perception Feedback with Situational Memory Embeddings in VLA Models

arXiv:2609.22040v1 Announce Type: new Abstract: Current Vision-Language-Action (VLA) models for autonomous driving operate primarily through feedforward inference across the perception--reasoning--pla

ProTracer: Proprioception-Guided Failure Diagnosis in Robot Manipulation

arXiv:2609.21369v1 Announce Type: cross Abstract: This paper presents a comprehensive framework for robot manipulation failure analysis that includes binary failure detection, failure categorization,

PSEE: Progressive Sensor Event Expansion for Point-Supervised Temporal Action Localization

arXiv:2609.21462v1 Announce Type: new Abstract: Temporal action localization (TAL) in wearable sensor streams identifies action classes and temporal boundaries, enabling finer-grained activity underst

local-aiarxiv-cs-cv

Purification and Regulation: Comorbidity-Aware Multi-Label Few-Shot Learning for Medical Image Classification

arXiv:2609.21541v1 Announce Type: new Abstract: Multi-label few-shot learning (MLFSL) remains a significant challenge in medical image analysis (MIA). Current metric-based meta-learning methods face t

RAYA: Learning Where and When to Intervene for Robot Recovery

arXiv:2609.21690v1 Announce Type: new Abstract: A robot can predict failure and still be unable to prevent it. By the time a safety mechanism reacts, the nominal plan may already have spent the contro

safetyarxiv-cs-ro

Reconstruction of 4D Mitral Regurgitation Hemodynamics from Sparse Planar Data using Deep Operator Networks with Test-Time Adaptation

arXiv:2609.20857v1 Announce Type: cross Abstract: Quantifying mitral regurgitation severity remains limited by the assumptions of clinical flow convergence methods, while high-fidelity simulation and

researcharxiv-cs-lg

Rectify, Don't Regret: On-Policy Closed-Loop Training for Multimodal Trajectory Prediction

arXiv:2603.23393v2 Announce Type: replace Abstract: Current trajectory prediction models are primarily trained in an open-loop manner, which often leads to covariate shift and compounding errors when

safetyarxiv-cs-ro

Refine Then Fusion: Training-Free 3D Point Cloud Adaptation with Priority Refinement and Multi-Modal Knowledge Fusion

arXiv:2609.21522v1 Announce Type: new Abstract: Recent pre-trained foundation models provide rich multi-modal priors for downstream 3D vision tasks. However, the effectiveness of these representations

REFINEPPO: Learning Continuous Control Policies by Iterative Action Refinement

arXiv:2609.21108v1 Announce Type: new Abstract: Deep reinforcement learning (DRL) has achieved strong performance across a wide range of continuous-control problems. These continuous-control policies,

Reliability-Centered Evaluation of Sparse Longitudinal CT Lesion-Size Forecasting with Conformal Interval Calibration and Gompertz-Inspired Regularization

arXiv:2609.21197v1 Announce Type: new Abstract: Sparse longitudinal CT follow-up limits lesion-size forecasting when only a few prior observations are available. We constructed a five-visit DLT-derive

Rethinking Human-Aligned Evaluation: An Analysis of Semantic Metrics Beyond WER

model-releasesarxiv-cs-cl

arXiv:2609.21663v1 Announce Type: new Abstract: Word Error Rate (WER), the most commonly used metric for Automatic Speech Recognition (ASR), treats every lexical deviation from the reference as equall

Reviser: Revision-Capable Text Generation via Autoregressive Cursor Actions

model-releasesarxiv-cs-cl

arXiv:2609.20830v1 Announce Type: new Abstract: Revision-capable generation is appealing because it can insert or revise earlier content, but many non-autoregressive and edit-based approaches obtain t

RheoSampling: Resolving the One-Hot Dilemma in Stochastic Dynamic-Tree Speculative Decoding

arXiv:2609.21827v1 Announce Type: new Abstract: Speculative decoding accelerates LLM inference by drafting multiple tokens in parallel, with tree-based methods further improving efficiency through hie

researcharxiv-cs-cl

Robust Structureless Monocular Visual Inertial Initialization Exploiting Line Features and Vanishing Points

arXiv:2609.21186v1 Announce Type: cross Abstract: Accurate initialization is essential for reliable visual-inertial odometry (VIO), but it is often ill-conditioned under degenerate motions. Existing m

Tutorials

S3VD: Semantic-Guidance Spatio-Temporal Scanning for Video Deraining

arXiv:2609.21322v1 Announce Type: new Abstract: Heavy rainfall severely degrades outdoor videos by corrupting high-frequency details and introducing motion blur, critically undermining the reliability

tutorialsarxiv-cs-cv

SafeStyle: Calibrated Style Residual Injection for Controllable Style-Leakage Trade-off in Diffusion Stylization

arXiv:2609.21242v1 Announce Type: new Abstract: Reference-guided diffusion stylization aims to transfer visual style from a reference image while preserving the semantics specified by a text prompt. H

Samsone: A Family of Open Small Audio Language Models for On-Device Inference

arXiv:2609.21666v1 Announce Type: cross Abstract: The success of Large Audio Language Models has driven the development of massive multimodal networks exceeding billions of parameters. However, the de

local-aiarxiv-cs-ai

Sandwich-Residuals: Parameter-Efficient Test-time Adaptation of World Models

model-releasesarxiv-cs-ro

arXiv:2609.21740v1 Announce Type: new Abstract: Latent world models enable planning by predicting the effects of actions in a learned representation space, but their predictions can become unreliable

Scaling Discovery through Test-Time Communication

arXiv:2609.21032v1 Announce Type: cross Abstract: Science advances not in isolation but through collaboration, yet existing agentic systems capture little of this. Whether communicating agents help re

SignGPT: Toward LLM-Mediated Sign Language Interaction through Gloss-Free Translation and Generation

arXiv:2609.21709v1 Announce Type: new Abstract: Large language models (LLMs) provide limited support for sign language interaction. Unifying sign language translation (SLT) and generation (SLG) to ena

SIRA: Reasoning-Aware Surgical Instrument Segmentation via Query-Anchored Alignment

arXiv:2609.21402v1 Announce Type: new Abstract: Surgical instrument segmentation (SIS) plays a critical role in robotic assistance and surgical workflow analysis. However, most existing SIS methods fo

Some startups, like Harvey, Abridge, Ramp, and Rogo, are embracing open-weight models or training their own models to reduce expensive reliance on frontier labs (Bloomberg)

Bloomberg: Some startups, like Harvey, Abridge, Ramp, and Rogo, are embracing open-weight models or training their own models to reduce expensive reliance on frontier labs — The $15.6 billion legal st

model-releasestechmeme

SpecOpt: Contact-Diff Reasoning for Agentic Molecule Optimization Toward Binding Specificity

arXiv:2609.21165v1 Announce Type: new Abstract: Off-target protein binding is a major source of adverse effects for small-molecule drugs, yet most structure-based molecular design methods focus on gen

SpecQuant: Speculative Decoding with Multi-Parent Quantization for Adaptive LLM Inference

arXiv:2609.21704v1 Announce Type: new Abstract: Running large language models (LLMs) locally continues to be limited by restrictions of compute and memory on consumer hardware. The popular acceleratio

local-aiarxiv-cs-lg

Agents

StepFun’s new Step 5 Preview model is impressive! Had a chance to test it early. I've been testing it as a coding agent. It’s on the Pareto …

StepFun’s new Step 5 Preview model is impressive! Had a chance to test it early. I've been testing it as a coding agent. It’s on the Pareto frontier for cost vs. capability. It is a very capable model

agentsdair-ai--x

SynthDemo-RL: Breaking the Zero-Reward Barrier in VLA Adaptation with LLM-Guided Synthetic Demonstrations

arXiv:2609.21650v1 Announce Type: cross Abstract: Fine-tuning Vision-Language-Action (VLA) models commonly relies on human teleoperation demonstrations, while reinforcement learning (RL) with sparse b

The Hidden Cost of Digits: Number Normalization and WER in ASR Systems

arXiv:2609.21084v1 Announce Type: cross Abstract: Modern automatic speech recognition (ASR) systems trained on extremely large datasets can produce transcripts with numbers written in Arabic numerals.

researcharxiv-cs-cl

The Stochastic Shift: A New Evaluation Paradigm for Text-to-SQL with AI Operators

arXiv:2609.21133v1 Announce Type: cross Abstract: SQL has been augmented with AI operators, enabling modern data analytics platforms to derive insights from both structured and unstructured data. We o

researcharxiv-cs-ai

Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction

arXiv:2609.21437v1 Announce Type: cross Abstract: We propose LoG-VGGT, a memory-efficient framework for long-sequence 3D reconstruction that balances local temporal modeling with global camera consist

researcharxiv-cs-ai

Time series generation with spectrally aligned latent flow matching

arXiv:2609.21989v1 Announce Type: new Abstract: Latent flow models have proven to be a reliable and cost-effective method for time series generation. However, the latent compression induces unwanted a

Towards Effective Visual-Inertial SLAM with Passive-Only Sensors for Low-Cost Autonomous Underwater Vehicles

model-releasesarxiv-cs-ro

arXiv:2609.21015v1 Announce Type: new Abstract: Improvements to Visual-Inertial Simultaneous Localization and Mapping (VI-SLAM) for low-cost autonomous underwater vehicles (AUVs) are critical for tran

Towards Secure Cloud-Native Computing: Unveiling Kubernetes Misconfigurations with Large Language Models

model-releasesarxiv-cs-cl

arXiv:2609.20834v1 Announce Type: new Abstract: In the rapidly evolving landscape of cloud-native computing, Organizations are increasingly adopting infrastructure models that emphasize scalability, f

Towards the Vision-Sound-Language-Action Paradigm: The HEAR Framework for Sound-Centric Manipulation

arXiv:2603.16086v2 Announce Type: replace-cross Abstract: While recent Vision-Language-Action (VLA) models have begun to incorporate audio, they typically treat sound as static pre-execution prompts o