Search: “benchmark”

Fin-Bias: Comprehensive Evaluation for LLM Decision-Making under human bias in Finance Domain

arXiv:2605.09106v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in financial contexts, raising critical concerns about reliability, alignment, and susceptibility

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

FreeMOCA: Memory-Free Continual Learning for Malicious Code Analysis

DGX agent

arXiv:2605.09664v1 Announce Type: cross Abstract: As over 200 million new malware samples are identified each year, antivirus systems must continuously adapt to the evolving threat landscape. However,

model-releasesarxiv-cs-lg

12 May 2026

Hierarchical Reinforced Trader (HRT): A Bi-Level Approach for Optimizing Stock Selection and Execution

arXiv:2410.14927v2 Announce Type: replace-cross Abstract: Automated equity trading requires converting noisy market and news signals into executable portfolio decisions under risk, turnover, and trans

Higher Resolution, Better Generalization: Unlocking Visual Scaling in Deep Reinforcement Learning

arXiv:2605.10546v1 Announce Type: new Abstract: Pixel-based deep reinforcement learning agents are typically trained on heavily downsampled visual observations, a convention inherited from early bench

IndustryBench: Probing the Industrial Knowledge Boundaries of LLMs

arXiv:2605.10267v1 Announce Type: new Abstract: In industrial procurement, an LLM answer is useful only if it survives a standards check: recommended material must match operating condition, every par

IPAD-CLIP: Teaching CLIP to Detect Image Local Perceptual Artifacts

arXiv:2605.08664v1 Announce Type: new Abstract: Current image quality assessment methods are heavily biased towards global distortions (e.g., noise, blur), neglecting local perceptual artifacts such a

Is Your Driving World Model an All-Around Player?

arXiv:2605.10858v1 Announce Type: new Abstract: Today's driving world models can generate remarkably realistic dash-cam videos, yet no single model excels universally. Some generate photorealistic tex

Learning from Trials and Errors: Reflective Test-Time Planning for Embodied LLMs

arXiv:2602.21198v2 Announce Type: replace-cross Abstract: Embodied LLMs endow robots with high-level task reasoning, but they cannot reflect on what went wrong or why, turning deployment into a sequen

LLaVA-UHD v4: What Makes Efficient Visual Encoding in MLLMs?

arXiv:2605.08985v1 Announce Type: new Abstract: Visual encoding constitutes a major computational bottleneck in Multimodal Large Language Models (MLLMs), especially for high-resolution image inputs. T

LLM Agents Already Know When to Call Tools -- Even Without Reasoning

arXiv:2605.09252v1 Announce Type: new Abstract: Tool-augmented LLM agents tend to call tools indiscriminately, even when the model can answer directly. Each unnecessary call wastes API fees and latenc

Measure what Matters: Psychometric Evaluation of AI with Situational Judgment Tests

arXiv:2510.22170v2 Announce Type: replace Abstract: Persona conditioning is widely used to steer large language model (LLM) behavior, but it is unclear whether it induces stable behavioral structure o

Research

MedThink: Enhancing Diagnostic Accuracy in Small Models via Teacher-Guided Reasoning Correction

arXiv:2605.08094v1 Announce Type: cross Abstract: Accurate clinical diagnosis requires extensive domain knowledge and complex clinical reasoning capabilities. Although large language models (LLMs) hol

researcharxiv-cs-ai

MicroWorld: Empowering Multimodal Large Language Models to Bridge the Microscopic Domain Gap with Multimodal Attribute Graph

arXiv:2605.10120v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) show remarkable potential for scientific reasoning, yet their performance in specialized domains such as micr

Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness

arXiv:2605.10379v1 Announce Type: new Abstract: Large language models (LLMs) have become capable mathematical problem-solvers, often producing correct proofs for challenging problems. However, correct

Safety

On Variance Reduction in Learning Mean Flows

arXiv:2605.09235v1 Announce Type: cross Abstract: One-step generative modeling has emerged as a leading approach to amortize the inference cost of diffusion and flow-matching models. Among distillatio

safetyarxiv-cs-ai

Research

One Trajectory, One Token: Grounded Video Tokenization via Panoptic Sub-object Trajectory

arXiv:2505.23617v3 Announce Type: replace-cross Abstract: Effective video tokenization is critical for scaling transformer models for long videos. Current approaches tokenize videos using space-time p

researcharxiv-cs-ai

Local Ai

PAAC: Privacy-Aware Agentic Device-Cloud Collaboration

arXiv:2605.08646v1 Announce Type: cross Abstract: Large language model (LLM) agents face a structural tension: cloud agents provide strong reasoning but expose user data, while on-device agents preser

local-aiarxiv-cs-cl

Position: Stop Evaluating AI with Human Tests, Develop Principled, AI-specific Tests instead

arXiv:2507.23009v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have achieved remarkable results on a range of standardized tests originally designed to assess human cognitive a

PRIM: Meta-Learned Bayesian Root Cause Analysis

arXiv:2605.08786v1 Announce Type: new Abstract: Root cause analysis (RCA) in complex systems is challenging due to error propagation across multiple variables, the need for structural causal knowledge

PRISM: Generation-Time Detection and Mitigation of Secret Leakage in Multi-Agent LLM Pipelines

arXiv:2605.10614v1 Announce Type: new Abstract: Multi-agent LLM systems introduce a security risk in which sensitive information accessed by one agent can propagate through shared context and reappear

Recovering Physical Dynamics from Discrete Observations via Intrinsic Differential Consistency

arXiv:2605.08454v1 Announce Type: cross Abstract: Recovering continuous-time dynamics from discrete observations is difficult because local supervision (e.g., pointwise regression targets, derivative

RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild

arXiv:2605.10357v1 Announce Type: cross Abstract: Multimodal misinformation increasingly leverages visual persuasion, where repurposed or manipulated images strengthen misleading text. We introduce ex

Separate First, Fuse Later: Mitigating Cross-Modal Interference in Audio-Visual LLMs Reasoning with Modality-Specific Chain-of-Thought

arXiv:2605.09906v1 Announce Type: new Abstract: Audio and vision provide complementary evidence for audio-visual question answering, yet current audio-visual large language models may suffer from cros

Set Prediction for Next-Day Active Fire Forecasting

arXiv:2605.10298v1 Announce Type: new Abstract: Accurate next-day active fire forecasts can support early warning, disaster response, forest risk assessment, and downstream estimation of fire-related

SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy

arXiv:2605.09598v1 Announce Type: new Abstract: Vision-language models (VLMs) have recently shown strong potential in soccer video understanding. However, given the high complexity of soccer videos du

Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection

arXiv:2605.08583v1 Announce Type: new Abstract: Large language models are increasingly used in scientific writing, yet they can fabricate citation-shaped references that appear plausible but fail bibl

SpatiaLab: Can Vision-Language Models Perform Spatial Reasoning in the Wild?

arXiv:2602.03916v3 Announce Type: replace-cross Abstract: Spatial reasoning is a fundamental aspect of human cognition, yet it remains a major challenge for contemporary vision-language models (VLMs).

Talk to Your Slides: High-Efficiency Slide Editing via Language-Driven Structured Data Manipulation

arXiv:2505.11604v5 Announce Type: replace Abstract: Editing presentation slides is a frequent yet tedious task, ranging from creative layout design to repetitive text maintenance. While recent GUI-bas

TeleResilienceBench: Quantifying Resilience for LLM Reasoning in Telecommunications

arXiv:2605.09929v1 Announce Type: new Abstract: Deploying large language models in telecommunications requires more than task accuracy. In realistic workflows, a model may inherit partially completed

The Metacognitive Probe: Five Behavioural Calibration Diagnostics for LLMs

arXiv:2605.09844v1 Announce Type: new Abstract: The Metacognitive Probe is an exploratory five-task, 15-slot diagnostic that decomposes an LLM's confidence behaviour into five behaviourally-distinct d

The Trap of Trajectory: Towards Understanding and Mitigating Spurious Correlations in Agentic Memory

arXiv:2605.09330v1 Announce Type: cross Abstract: Agentic memory enables LLMs to persist information beyond a single context window and reuse it in later decisions, but it also introduces a new vulner

The World is Not Mono: Enabling Spatial Understanding in Large Audio-Language Models

arXiv:2601.02954v3 Announce Type: replace-cross Abstract: Large audio-language models have made rapid progress in recognizing what is present in an audio clip, but spatial audio-language understanding

TIDE-Bench: Task-Aware and Diagnostic Evaluation of Tool-Integrated Reasoning

arXiv:2605.09544v1 Announce Type: new Abstract: Tool-integrated reasoning has emerged as a promising paradigm for enhancing large language models with external computation, retrieval, and execution ca

Local Ai

Towards Batch-to-Streaming Deep Reinforcement Learning for Continuous Control

arXiv:2603.08588v2 Announce Type: replace-cross Abstract: State-of-the-art deep reinforcement learning (RL) methods have achieved remarkable performance in continuous control tasks, yet their computat

local-aiarxiv-cs-ai

Towards Cross-lingual Values Judgment: A Consensus-Pluralism Perspective

arXiv:2602.17283v2 Announce Type: replace-cross Abstract: As large language models (LLMs) are employed worldwide, existing evaluation paradigms for their multilingual capabilities primarily focus on f

Tracking the Truth: Object-Centric Spatio-Temporal Monitoring for Video Large Language Models

arXiv:2605.08974v1 Announce Type: cross Abstract: While multimodal large language models (MLLMs) have advanced video understanding, they remain highly prone to hallucinations in dynamic scenes. We arg

Transformation-Augmented GRPO for Enhancing Exploration in Reasoning of Large Language Models

arXiv:2601.22478v3 Announce Type: replace Abstract: Group Relative Policy Optimization (GRPO) has become the dominant method for reinforcement learning with verifiable rewards in large language models

Understanding Asynchronous Inference Methods for Vision-Language-Action Models

arXiv:2605.08168v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models offer a promising path to generalist robot control, but their inference latency causes observation staleness when

Safety

Uni-Hand: Universal Hand Motion Forecasting in Egocentric Views

arXiv:2511.12878v4 Announce Type: replace Abstract: Forecasting how human hands move in egocentric views is critical for applications like augmented reality and human-robot policy transfer. Recently,

safetyarxiv-cs-cv

Unifying Scientific Communication: Fine-Grained Correspondence Across Scientific Media

arXiv:2605.05831v2 Announce Type: replace Abstract: The communication of scientific knowledge has become increasingly multimodal, spanning text, visuals, and speech through materials such as research

Safety

Verifier-Free RL for LLMs via Intrinsic Gradient-Norm Reward

arXiv:2605.09920v1 Announce Type: cross Abstract: While Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a promising post-training paradigm for Large Language Models (LLMs

safetyarxiv-cs-ai

Agents

ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models

arXiv:2605.10106v1 Announce Type: cross Abstract: Recent advances in Multi-modal Large Language Models (MLLMs) target 3D spatial intelligence, yet the progress has been largely driven by post-training

agentsarxiv-cs-ai

When (and How) to Trust the Expert: Diagnosing Query-Time Expert-Guided Reinforcement Learning

arXiv:2605.09109v1 Announce Type: new Abstract: Many continuous-control problems ship with a competent but suboptimal controller (a tuned PID, a hand-designed gait). A growing family of methods uses s

Your Simulation Runs but Solves the Wrong Physics: PDE-Grounded Intent Verification for LLM-Generated Multiphysics Simulation Code

arXiv:2605.09360v1 Announce Type: cross Abstract: Execution-based evaluation of LLM-generated code implicitly treats successful execution as a proxy for correctness. In scientific simulation, this pro

2.5-D Decomposition for LLM-Based Spatial Construction

arXiv:2605.07066v1 Announce Type: new Abstract: Autonomous systems that build structures from natural-language instructions need reliable spatial reasoning, yet large language models (LLMs) make syste

A^2RD: Agentic Autoregressive Diffusion for Long Video Consistency

arXiv:2605.06924v1 Announce Type: cross Abstract: Synthesizing consistent and coherent long video remains a fundamental challenge. Existing methods suffer from semantic drift and narrative collapse ov

Decoding the Pulse of Reasoning VLMs in Multi-Image Understanding Tasks

arXiv:2603.04676v2 Announce Type: replace-cross Abstract: Multi-image reasoning remains a significant challenge for vision-language models (VLMs). We investigate a previously overlooked phenomenon: du

Echo: KV-Cache-Free Associative Recall with Spectral Koopman Operators

arXiv:2605.06997v1 Announce Type: new Abstract: Long chain-of-thought reasoning and agentic tool-calling produce traces spanning tens of thousands of tokens, yet Transformer KV caches grow linearly wi