Search: “benchmark”

SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modeling

arXiv:2606.03169v1 Announce Type: cross Abstract: Recent song generation systems can synthesize realistic audio, yet generating complete songs remains challenging for two reasons. First, explicit song

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skill

DGX agent

arXiv:2606.03980v1 Announce Type: cross Abstract: Reward models (RMs) provide critical feedback signals for LLM post-training, notably in reinforced fine-tuning (RFT) and reinforcement learning (RL) p

model-releasesarxiv-cs-cl

3 Jun 2026

Spectral Asymptotics of Neural Network Loss Landscapes: An Exact Decomposition of the Curvature Exponent

arXiv:2606.02596v1 Announce Type: new Abstract: The curvature exponent alpha in h_k propto sigma_k^alpha -- governing how Hessian eigenvalues scale with gradient singular values -- varies systematical

safetyarxiv-cs-lg

State-Coupled Volatility in Latent Dynamical Systems: Recovery Under Partial Observation

arXiv:2606.02664v1 Announce Type: cross Abstract: Latent state-space models are widely used to study partially observed dynamical systems, yet most formulations assume that process variability is inde

Staying Alive: Uncensored Survival Analysis with Tabular Foundation Models

arXiv:2606.03689v1 Announce Type: cross Abstract: Survival Analysis (SA) is a statistical framework that models the time span until some event of interest occurs. Widely used in several domains, inclu

StepFinder: A Temporal Semantic Framework for Failure Attribution in Multi-Agent Systems

arXiv:2606.03467v1 Announce Type: new Abstract: LLM-based multi-agent systems exhibit remarkable collaborative capabilities in complex multi-step tasks. However, these systems are highly sensitive to

Synthetic Hallucinations, Real Gains: Hard Negatives from Frontier Models for FIM Hallucination Mitigation

arXiv:2606.03130v1 Announce Type: new Abstract: Small open-source code models that power IDE autocomplete still emit hallucinated Fill-in-the-Middle (FIM) completions: syntactically natural calls to m

Tailoring Strictly Proper Scoring Rules for Downstream Tasks: An Application to Causal Inference

arXiv:2606.03332v1 Announce Type: new Abstract: Probabilistic models are typically trained using task-agnostic objectives like log-loss, which can lead to significant errors in downstream estimation.

local-aiarxiv-cs-lg

Template Collapse and Information-Theoretic Limits in Camera rPPG Pulse Morphology Restoration

arXiv:2606.03802v1 Announce Type: new Abstract: Objective: Consumer face camera remote photoplethysmography (rPPG) enables passive cardiovascular monitoring, but whether single-cycle waveform morpholo

researcharxiv-cs-cv

Testing Most Influential Sets

arXiv:2510.20372v4 Announce Type: replace-cross Abstract: Small influential data subsets can dramatically impact model conclusions, with a few data points overturning key findings. While recent work i

Testing the Test: Score-Direction Instability in Class-Split Anomaly Detection

arXiv:2606.02601v1 Announce Type: new Abstract: Within-dataset class-split evaluation is widely used as a proxy for fully unconditional out-of-distribution anomaly detection. We show that this protoco

The DeepSpeak-Agentic Dataset

arXiv:2606.03686v1 Announce Type: new Abstract: We present DeepSpeak-Agentic, a dataset of videos comprising over 37 hours of semi-structured conversations between a human and an embodied AI agent. We

The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset

arXiv:2606.02956v1 Announce Type: new Abstract: Existing autonomous driving datasets have enabled major progress, but fall short in sensor fidelity, map completeness, or geographic diversity. We prese

local-aiarxiv-cs-cv

The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLP

model-releasesarxiv-cs-cl

arXiv:2606.03250v1 Announce Type: new Abstract: Digital healthcare generates vast amounts of clinical text that can support AI-assisted applications, yet German biomedical language models remain limit

Tool-Aware Optimization with Entropy Guidance for Efficient Agentic Reinforcement Learning

arXiv:2606.03762v1 Announce Type: cross Abstract: Agentic reinforcement learning (RL) equips large language models (LLMs) with tool-use capabilities that substantially improve reasoning on complex tas

safetyarxiv-cs-ai

ToolGate: Token-Efficient Pre-Call Control for Tool-Augmented Vision-Language Agents

arXiv:2606.03054v1 Announce Type: new Abstract: Tool-augmented vision-language agents can acquire external perceptual evidence through OCR, detection, segmentation, and other tools, but executing ever

agentsarxiv-cs-ai

Topology-Aware Gaussian Graph Repair for Robust Graph Neural Networks

arXiv:2606.03462v1 Announce Type: new Abstract: Graph neural networks have achieved strong performance on graph-structured data, but their effectiveness depends heavily on the quality of the observed

Toward a Modular Architecture for Embedded AI Agent Systems at the Edge

arXiv:2606.02862v1 Announce Type: new Abstract: The rise of Large Language Models (LLMs) has enabled agentic AI capable of complex reasoning and tool use; however, deploying such autonomy in pervasive

local-aiarxiv-cs-ai

Towards Characterizing Scientific Image Utility and Upgradability

model-releasesarxiv-cs-cv

arXiv:2606.03401v1 Announce Type: new Abstract: Scientific images function as critical evidence in research communication, yet their integrity faces unprecedented threats from AI-generated content tha

Towards Fair Graph Prompting: A Dual-Prompt Mechanism for Mitigating Attribute and Structural Bias

arXiv:2510.23469v2 Announce Type: replace Abstract: Self-supervised pre-training on unlabeled graph data has become a common paradigm for Graph Neural Networks (GNNs). However, an objective gap often

Trading Human Curation for Synthetic Augmentation in RLVR

arXiv:2606.03800v1 Announce Type: cross Abstract: The supply of high-quality training tasks is a central bottleneck for reinforcement learning from verifiable rewards (RLVR) on agentic language models

VLESA: Vision-Language Embodied Safety Agent for Human Activity Monitoring

model-releasesarxiv-cs-cv

arXiv:2606.03954v1 Announce Type: new Abstract: As AI systems increasingly assist humans in physical tasks, ensuring safety becomes paramount -- physical actions carry immediate and irreversible conse

Wavelet Fourier Diffuser: Frequency-Aware Diffusion Model for Reinforcement Learning

arXiv:2509.19305v2 Announce Type: replace-cross Abstract: Diffusion probability models have shown significant promise in offline reinforcement learning by directly modeling trajectory sequences. Howev

We partnered with @FireworksAI_HQ to train open-source models for legal. Here's what we found: 1) Hybrid legal agents can beat frontier mode…

model-releasessonya-huang--x

We partnered with @FireworksAI_HQ to train open-source models for legal. Here's what we found: 1) Hybrid legal agents can beat frontier models on quality and cost by routing selectively to a frontier

When Should LLMs Be Less Specific? Selective Abstraction for Reliable Long-Form Text Generation

arXiv:2602.11908v3 Announce Type: replace Abstract: LLMs are widely used, yet they remain prone to factual errors that erode user trust and limit adoption in high-risk settings. One approach to mitiga

Who Deserves the Reward? SHARP: Shapley Credit-based Optimization for Multi-Agent System

arXiv:2602.08335v2 Announce Type: replace Abstract: Integrating Large Language Models (LLMs) with external tools via multi-agent systems offers a promising new paradigm for decomposing and solving com

safetyarxiv-cs-ai

Will Accurate Fields Mislead Photonic Design? FromGlobal Accuracy to Port Readout

arXiv:2606.03038v1 Announce Type: new Abstract: Neural field surrogates can accelerate photonic design loops, but a surrogate that looks accurate in global field error can still mis-rank candidate dev

WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation

arXiv:2503.07265v4 Announce Type: replace-cross Abstract: Text-to-Image (T2I) models are capable of generating high-quality artistic creations and visual content. However, existing research and evalua

World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning

arXiv:2606.03603v1 Announce Type: cross Abstract: World models and multimodal large language models (MLLMs) provide complementary capabilities for predicting future outcomes from static visual observa

safetyarxiv-cs-cl

Worth Remembering: Surprise-Gated Robot Episodic Memory

arXiv:2606.03787v1 Announce Type: new Abstract: Robots solving generalist tasks need to be able to ground instructions in their past experience, since humans may refer to notable past events when givi

researcharxiv-cs-ro

X-RAY: Mapping LLM Reasoning Capability via Formalized and Calibrated Probes

arXiv:2603.05290v2 Announce Type: replace Abstract: Large language models (LLMs) achieve promising performance, yet their ability to reason remains poorly understood. Existing evaluations largely emph

Zero-Shot 3D Question Answering via Hierarchical View-to-Token Transportation

arXiv:2606.03100v1 Announce Type: new Abstract: Recently, zero-shot 3D scene understanding via 2D Vision-Language Models (VLMs) has gained increasing research interest due to their promising spatial r

researcharxiv-cs-cv

4D Radar Meets LiDAR and Camera: Cooperative Perception under Adverse Weather

arXiv:2606.00416v1 Announce Type: new Abstract: Cooperative perception is important for autonomous driving but remains fragile when cameras and LiDAR degrade in adverse weather. We address this challe

agentsarxiv-cs-cv

Applications

A Biconvex Formulation for Stable Transport of Mixture Models with a Unique Solution

arXiv:2606.02515v1 Announce Type: new Abstract: Optimal transport (OT) provides a principled framework for mapping between probability distributions. Despite extensive progress, applying OT to large-s

applicationsarxiv-cs-lg

A Lightweight Context-Driven Training-Free Network for Scene Text Segmentation and Recognition

arXiv:2503.15639v2 Announce Type: replace-cross Abstract: Modern scene text recognition systems often depend on large end-to-end architectures that require extensive training and are prohibitively exp

A Modelling and Evaluation Framework for EuroCrops-Driven Sentinel-2 Crop Segmentation

arXiv:2606.00676v1 Announce Type: new Abstract: This work presents a configurable pipeline for generating semantic-segmentation-ready agricultural datasets from Sentinel-2 imagery and EuroCrops parcel

safetyarxiv-cs-cv

A Novel Data Augmentation Strategy for Robust Deep Learning Classification of Biomedical Time-Series Data: Application to ECG and EEG Analysis

arXiv:2507.12645v1 Announce Type: cross Abstract: The increasing need for accurate and unified analysis of diverse biological signals, such as ECG and EEG, is paramount for comprehensive patient asses

A Predictive Control Strategy to Offset-Point Tracking for Agricultural Mobile Robots

arXiv:2603.28439v2 Announce Type: replace Abstract: Robots are increasingly being deployed in agriculture to support sustainable practices and improve productivity. They offer strong potential to enab

safetyarxiv-cs-ro

A Primer in Post-Training Reasoning Data: What We Know About How It Works

arXiv:2606.02113v1 Announce Type: cross Abstract: Post-training has become a primary driver of recent progress in large reasoning models, and reasoning data are often the key variable determining whet

A Shared Valence Axis Across Modern LLMs and Human EEG: The Saturation Regularity

arXiv:2606.00129v1 Announce Type: cross Abstract: Large language models (LLMs) have emerged as powerful representation learners whose internal features increasingly align with human cognition. We stud

safetyarxiv-cs-ai

A Task-Centric Theory for Iterative Self-Improvement with Easy-to-Hard Curricula

arXiv:2602.10014v3 Announce Type: replace Abstract: Iterative self-improvement fine-tunes an autoregressive large language model (LLM) on reward-verified outputs generated by the LLM itself. In contra

AblationBench: Evaluating Automated Planning of Ablations in Empirical AI Research

arXiv:2507.08038v3 Announce Type: replace-cross Abstract: Language model agents are increasingly used to automate scientific research, yet evaluating their scientific contributions remains a challenge

Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2606.02459v1 Announce Type: new Abstract: Enabling Vision-Language Models (VLMs) to perform spatial reasoning remains challenging. Existing approaches treat VLMs as passive observers, which is d

Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streams

arXiv:2606.01770v1 Announce Type: cross Abstract: Auto-harness systems such as A-Evolve, GEPA, and Meta-Harness improve LLM agents by optimizing prompts, skills, tools, memories, and supporting infras

agentsarxiv-cs-ai

Adaptive Time Series Reasoning via Segment Selection

arXiv:2602.18645v2 Announce Type: replace Abstract: Time series reasoning tasks often start with a natural language question and require targeted analysis of a time series. Evidence may span the full

safetyarxiv-cs-lg

AEyeDE: An Attention-Based Attribution Framework for AI-Generated Text Detection

arXiv:2606.00016v1 Announce Type: cross Abstract: Detecting AI-generated text is becoming increasingly challenging as modern language models approach human-level fluency and can evade detectors that r

local-aiarxiv-cs-ai

AFUN: Towards an Affordance Foundation Model for Functionality Understanding

arXiv:2606.02551v1 Announce Type: cross Abstract: Affordance understanding bridges visual perception and physical action, serving as an explainable interface for robot manipulation in open and unstruc

local-aiarxiv-cs-cv

Agentic Clustering: Controllable Text Taxonomies via Multi-Agent Refinement

arXiv:2606.01255v1 Announce Type: new Abstract: Recent text-clustering methods use large language models to propose a cluster taxonomy from a corpus and then assign each text to it. These pipelines ar

agentsarxiv-cs-cl