Search: “benchmark”

OpenFinGym: A Verifiable Multi-Task Gym Environment for Evaluating Quant Agents

arXiv:2606.26350v1 Announce Type: new Abstract: Although large language model agents are increasingly applied to quantitative-finance workflows, their evaluation remains fragmented across isolated tas

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

OpenRCA 2.0: From Outcome Labels to Causal Process Supervision

DGX agent

arXiv:2606.27154v1 Announce Type: new Abstract: Root cause analysis (RCA) poses a holistic test of LLM agentic capabilities, such as long-context understanding, multi-step reasoning, and tool use. How

model-releasesarxiv-cs-ai

26 Jun 2026

Orthogonal Hierarchical Decomposition for Structure-Aware Table Understanding with Large Language Models

arXiv:2602.01969v2 Announce Type: replace Abstract: Complex tables with multi-level headers, merged cells and heterogeneous layouts pose persistent challenges for LLMs in both understanding and reason

researcharxiv-cs-cl

PanoImager: Geometry-Guided Novel View Synthesis and Reconstruction from Sparse Panoramic Views

arXiv:2606.27071v1 Announce Type: new Abstract: Panoramic sensing offers wide field-of-view coverage, yet 3D reconstruction from sparse panoramas remains challenging under rotation-dominant, weak-para

researcharxiv-cs-cv

Parametric Generalized Adaptive Moment Features (PG-AMF) for Bearing Fault Diagnosis and Machine Health Monitoring

arXiv:2606.26317v1 Announce Type: cross Abstract: Accurate fault diagnosis of rolling element bearings in rotating machinery is considered essential for ensuring industrial safety and enabling predict

Patent Representation Learning via Self-supervision

arXiv:2511.10657v2 Announce Type: replace-cross Abstract: We study self-supervised patent representation learning with contrastive objectives. A standard baseline constructs positives by encoding the

PathFLIP: Fine-grained Language-Image Pretraining for Versatile Computational Pathology

arXiv:2512.17621v2 Announce Type: replace Abstract: While Vision-Language Models (VLMs) have achieved notable progress in computational pathology (CPath), the gigapixel scale and spatial heterogeneity

safetyarxiv-cs-cv

Paved with True Intents: Intent-Aware Training Improves LLM Safety Classification Across Training Regimes

arXiv:2606.27210v1 Announce Type: new Abstract: We argue that safety classifiers should model user intent as an explicit signal between the prompt and the final label. To study this, we introduce AIMS

safetyarxiv-cs-cl

Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models

arXiv:2606.27373v1 Announce Type: new Abstract: Recently, self-evolving large multimodal models (LMMs) have received attention for improving visual reasoning in a purely unsupervised setting. However,

safetyarxiv-cs-cv

PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation

arXiv:2606.26916v1 Announce Type: new Abstract: Developing physically aware video generation models remains a significant challenge due to the difficulty in capturing diverse physical phenomena, such

researcharxiv-cs-cv

Applications

PMDformer: Patch-Mean Decoupling Information Transformer for Long-term Forecasting

arXiv:2606.26549v1 Announce Type: new Abstract: Long-term time series forecasting (LTSF) plays a crucial role in fields such as energy management, finance, and traffic prediction. Transformer-based mo

applicationsarxiv-cs-ai

PortraitGen: Exemplar-Driven GRPO with Dual-Reward Guidance for Photorealistic Portrait Generation

arXiv:2606.26930v1 Announce Type: new Abstract: Reinforcement Learning like Group Relative Policy Optimization (GRPO) has significantly advanced text-to-image post-training. However, current methods o

Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

arXiv:2606.26631v1 Announce Type: new Abstract: Interleaved multimodal reasoning improves visual grounding by revisiting visual evidence during multi-step generation, yet existing methods typically re

researcharxiv-cs-cv

Agents

PrivacyBench: Privacy Isn't Free in Hybrid Privacy-Preserving Vision Systems

arXiv:2602.18900v2 Announce Type: replace-cross Abstract: Privacy preserving machine learning deployments in sensitive deep learning applications; from medical imaging to autonomous systems; increasin

agentsarxiv-cs-cv

Hardware

ProtoKV: Streaming Video Understanding under Delayed Query with Summary-State Memory

arXiv:2606.26762v1 Announce Type: new Abstract: Streaming video understanding (SVU) must answer queries that arrive asynchronously while visual tokens stream continuously under strict GPU-memory and q

hardwarearxiv-cs-cv

Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation

arXiv:2606.26907v1 Announce Type: new Abstract: While text-to-image (T2I) models have achieved remarkable progress, they struggle with real-world requests that are often underspecified, implicit, or d

R2D-RL: A RoboCup 2D Soccer Environment for Multi-Agent Reinforcement Learning

arXiv:2606.18786v2 Announce Type: replace Abstract: Robot soccer is a challenging testbed for multi-agent reinforcement learning because it combines partial observability, cooperative and adversarial

ReasonCLIP-58M: Visually Grounded Commonsense Reasoning Supervision for CLIP

arXiv:2606.26794v1 Announce Type: cross Abstract: CLIP and its variants are widely adopted visual backbones in multimodal systems, but their pretraining remains dominated by descriptive image-text ali

Reconstruction Alignment Improves Unified Multimodal Models

arXiv:2509.07295v4 Announce Type: replace-cross Abstract: Unified multimodal models (UMMs) unify visual understanding and generation within a single architecture. However, conventional training relies

RedVox: Safety and Fairness Gaps in Speech Models Across Languages

model-releasesarxiv-cs-cl

arXiv:2606.26968v1 Announce Type: new Abstract: Speech-capable models are increasingly deployed in real-world applications across languages. Yet their safety and fairness beyond English settings and u

Reinforcement Fine-Tuning of Flow-Matching Policies for Vision-Language-Action Models

model-releasesarxiv-cs-lg

arXiv:2510.09976v2 Announce Type: replace Abstract: Vision-Language-Action (VLA) models such as OpenVLA, Octo, and pi_0 have shown strong generalization by leveraging large-scale demonstrations, yet t

ReportLogic: Evaluating Logical Quality in Deep Research Reports

arXiv:2602.18446v2 Announce Type: replace-cross Abstract: Users increasingly rely on Large Language Models (LLMs) for Deep Research, using them to synthesize diverse sources into structured reports th

Residual RL-MPC for Robust Microrobotic Cell Pushing Under Time-Varying Flow

arXiv:2603.05448v2 Announce Type: replace-cross Abstract: Contact-rich micromanipulation in microfluidic flow is challenging because small disturbances can break pushing contact and induce large later

Agents

Revisiting Action Factorization for Complex Action Spaces

arXiv:2606.26574v1 Announce Type: new Abstract: Many real-world control problems involve hybrid discrete-continuous action spaces. For example, steering and signaling in autonomous driving, and aiming

agentsarxiv-cs-lg

Ribbon: Scalable Approximation and Robust Uncertainty Quantification

model-releasesarxiv-cs-lg

arXiv:2606.27269v1 Announce Type: cross Abstract: Reliably quantifying predictive uncertainty is difficult for complex, high-dimensional, or misspecified models. Both fully Bayesian and bootstrap resa

Rolling Shutter Relative Pose Estimation Made Practical

arXiv:2606.26863v1 Announce Type: new Abstract: Rolling shutter (RS) cameras equip virtually all consumer devices, yet RS-aware relative pose estimation has remained impractical: the state-of-the-art

RolloutPipe: Overlapping Pipelined Rollout and Training in Disaggregated On-Policy LLM Reinforcement Learning

arXiv:2606.26997v1 Announce Type: cross Abstract: Large language model (LLM) post-training for reasoning increasingly relies on reinforcement learning with verifiable rewards (RLVR), where models lear

safetyarxiv-cs-lg

RoPEMover: Depth-Aware Object Relocation via Positional Embeddings

arXiv:2606.27332v1 Announce Type: new Abstract: Moving an object in a single image requires geometry-consistent spatial rearrangement, including handling occlusions, revealing previously unseen region

Scalable AI-assisted Workflow Management for Detector Design Optimization Using Distributed Computing

arXiv:2603.30014v2 Announce Type: replace-cross Abstract: The Production and Distributed Analysis (PanDA) system, originally developed for the ATLAS experiment at the CERN Large Hadron Collider (LHC),

Local Ai

Scaling Nonlinear Optimization: Many Problems One GPU

arXiv:2606.26341v1 Announce Type: new Abstract: Many robotics problems, including trajectory optimization, inverse kinematics, and contact-rich motion planning, reduce to nonlinear programs (NLPs). Ma

local-aiarxiv-cs-ro

SciFig: Towards Automating Editable Figure Generation for Scientific Papers

arXiv:2601.04390v2 Announce Type: replace Abstract: High-quality methodology figures are central to scientific communication, yet they remain difficult and time-consuming to create. Such figures must

ShareLock: A Stealthy Multi-Tool Threshold Poisoning Attack Against MCP

arXiv:2606.27027v1 Announce Type: cross Abstract: With the rapid evolution of LLM-driven agents, Model Context Protocol (MCP), an open protocol bridging LLMs with external tools, has quickly become fo

Signature filtering: a lightweight enhancement for statistical watermark detection in large language models

model-releasesarxiv-cs-lg

arXiv:2606.18430v2 Announce Type: replace Abstract: Statistical watermarks help organizations attribute large language model (LLM) outputs, yet existing detectors often struggle when watermark signals

Applications

SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learning

arXiv:2603.10446v4 Announce Type: replace Abstract: Sign Language Production (SLP) faces a fundamental trade-off: direct text-to-pose models suffer from regression-to-the-mean effects, while dictionar

applicationsarxiv-cs-cv

Agents

SKILL-DISCO: Distilling and Compiling Agent Traces into Reusable Procedural Skills

arXiv:2606.26669v1 Announce Type: new Abstract: Agents often repeatedly solve similar task instances from scratch, leading to unnecessary reasoning cost and long execution traces. Prior work has explo

agentsarxiv-cs-ai

Soft Token Alignment for Cross-Lingual Reasoning

arXiv:2606.26466v1 Announce Type: new Abstract: Multilingual large language models often produce inconsistent reasoning and answers for semantically equivalent prompts in different languages. Prior wo

safetyarxiv-cs-cl

Local Ai

Speaking Numbers to LLMs: Multi-Wavelet Number Embeddings for Time Series Forecasting

arXiv:2606.26487v1 Announce Type: cross Abstract: Large language models (LLMs) are attractive for context-aware time series forecasting because they can integrate heterogeneous textual signals, yet th

local-aiarxiv-cs-ai

SSI-Policy: Learning Structured Scene Interfaces for Vision-Language Robotic Manipulation

model-releasesarxiv-cs-ro

arXiv:2606.26800v1 Announce Type: new Abstract: Real-world robotic manipulation demands spatial grounding, task-aware reasoning, and precise control. Learning such capabilities becomes particularly ch

Staying VIGILant: Mitigating Visual Laziness via Counterfactual Visual Alignment in MLLMs

arXiv:2606.26387v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) extend large language models (LLMs) with visual perception, enabling joint reasoning over images and text. De

safetyarxiv-cs-cl

STORM: Slot-based Task-aware Object-centric Representation for robotic Manipulation

arXiv:2601.20381v3 Announce Type: replace Abstract: Visual foundation models provide strong perceptual features for robotics, but their dense representations lack explicit object-level structure, limi

safetyarxiv-cs-ro

SymQNet: Amortized Acquisition for Low-Latency Adaptive Hamiltonian Learning

arXiv:2606.12808v3 Announce Type: replace-cross Abstract: Adaptive Hamiltonian learning is central to calibrating and characterizing quantum devices. In an adaptive controller, choosing the next exper

Local Ai

Temporal Validity in Retrieval Memory: Eliminating Stale-Fact Errors for AI Agents over Evolving Knowledge

arXiv:2606.26511v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) gives agents access to accumulated knowledge, but has no model of time. When a fact changes (e.g., a function is

local-aiarxiv-cs-ai

Term-Centric Hierarchy Induction from Heterogeneous Corpora

model-releasesarxiv-cs-cl

arXiv:2606.26963v1 Announce Type: new Abstract: Organizing knowledge from diverse text sources into interpretable hierarchies is crucial for tasks such as policy analysis, innovation monitoring, and e

The Inattentional Gap: Task-Conditioned Language and Vision Models Omit the Safety-Critical Signals They Can Otherwise Report

arXiv:2606.26529v1 Announce Type: cross Abstract: AI safety is evaluated by how reliably a model detects the hazards it is told to find, yet accidents often arise from the hazard no one specified. We

The Open Source Economic Index of AI Adoption and Capability

arXiv:2606.26118v1 Announce Type: cross Abstract: We work towards measuring both AI adoption and the capability of AI to perform discrete labor tasks across various occupations. To measure adoption, w

The strongest models are gated and access is granted only to a select few. Hermes Agent now exposes MoA presets as virtual models, giving yo…

model-releasesnous-research--x

The strongest models are gated and access is granted only to a select few. Hermes Agent now exposes MoA presets as virtual models, giving you capabilities beyond the publicly available frontier: 8% hi

The Verification Horizon: No Silver Bullet for Coding Agent Rewards

arXiv:2606.26300v1 Announce Type: new Abstract: A classical intuition holds that verifying a solution is easier than producing one. For today's coding agents, this intuition is being inverted: as foun

TOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference

arXiv:2606.27161v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) have achieved strong multimodal reasoning capabilities, but their efficiency is limited by the large number of

researcharxiv-cs-ai