Search: “benchmark”

NGM: A Plug-and-Play Training-Free Memory Module for LLMs

arXiv:2605.16893v1 Announce Type: new Abstract: Recent studies introduce conditional memory modules that decouple knowledge storage from neural computation, enabling more direct knowledge access. Comp

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Not What You Asked For: Typographic Attacks in Household Robot Manipulation

DGX agent

arXiv:2605.18593v1 Announce Type: cross Abstract: Open-vocabulary embodied AI agents increasingly rely on vision-language models such as CLIP for object perception and task grounding. However, the sha

model-releasesarxiv-cs-ai

19 May 2026

Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Tasks

arXiv:2605.18583v1 Announce Type: cross Abstract: Coding agents now run autonomously with shell, file, and network privileges. When a user issues a benign request, the agent sometimes does more than a

Agents

PopuLoRA: Co-Evolving LLM Populations for Reasoning Self-Play

arXiv:2605.16727v1 Announce Type: new Abstract: We introduce PopuLoRA, a population-based asymmetric self-play framework for reinforcement learning with verifiable rewards (RLVR) post-training of LLMs

agentsarxiv-cs-ai

ProtoSiTex: Learning Semi-Interpretable Prototypes for Multi-label Text Classification

arXiv:2510.12534v4 Announce Type: replace Abstract: The rapid growth of user-generated text across digital platforms has intensified the need for interpretable models capable of fine-grained text clas

Local Ai

PySIFT: GPU-Resident Deterministic SIFT for Deep Learning Vision Pipelines

arXiv:2605.17869v1 Announce Type: new Abstract: A widespread assumption in local feature research holds that classical handcrafted descriptors are accuracy-limited relics best replaced by learned alte

local-aiarxiv-cs-cv

Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstruction

arXiv:2605.16981v1 Announce Type: new Abstract: Streaming 3D reconstruction under a strict constant-memory budget hinges on how the recurrent state is updated as the stream evolves. We profile TTT3R-s

researcharxiv-cs-cv

ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Driving

arXiv:2508.13977v3 Announce Type: replace Abstract: Depth estimation is a fundamental component of spatial perception for autonomous driving and other unmanned systems operating in open urban environm

SaaSBench: Exploring the Boundaries of Coding Agents in Long-Horizon Enterprise SaaS Engineering

arXiv:2605.17526v1 Announce Type: cross Abstract: As autonomous coding agents become capable of handling increasingly long-horizon tasks, they have gradually demonstrated the potential to complete end

Safety Geometry Collapse in Multimodal LLMs and Adaptive Drift Correction

arXiv:2605.18104v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) often fail to transfer safety capabilities learned in the text modality to semantically equivalent non-text inp

safetyarxiv-cs-ai

SE-GA: Memory-Augmented Self-Evolution for GUI Agents

model-releasesarxiv-cs-lg

arXiv:2605.16883v1 Announce Type: new Abstract: Autonomous Graphical User Interface (GUI) agents often struggle with multi-step tasks due to constrained context windows and static policies that fail t

SegRAG: Training-Free Retrieval-Augmented Semantic Segmentation

arXiv:2605.17630v1 Announce Type: new Abstract: Here's a trimmed version under 1920 characters: Open-vocabulary segmentation models such as SAM3 achieve strong performance through concept-level text p

researcharxiv-cs-cv

SIREM: Speech-Informed MRI Reconstruction with Learned Sampling

model-releasesarxiv-cs-cl

arXiv:2605.18221v1 Announce Type: cross Abstract: Real-time magnetic resonance imaging (rtMRI) of speech production enables non-invasive visualization of dynamic vocal-tract motion and is valuable for

SpecSem-Net: Integrating Spectral and Semantic Features for Robust AI-generated Video Detection

arXiv:2605.17311v1 Announce Type: new Abstract: The remarkable visual fidelity of recent commercial video generative models, such as Sora and Veo, renders robust AI-generated video detection increasin

STT-Arena: A More Realistic Environment for Tool-Using with Spatio-Temporal Dynamics

arXiv:2605.18548v1 Announce Type: cross Abstract: Large language models (LLMs) deployed in real-world agentic applications must be capable of replanning and adapting when mid-task disruptions invalida

Sustainability via LLM Right-sizing

arXiv:2504.13217v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have become increasingly embedded in organizational workflows. This has raised concerns over their energy consump

SwordBench: Evaluating Orthogonality of Steering Image Representations

arXiv:2605.16372v1 Announce Type: cross Abstract: Steering or intervening on model representations at inference time to correct predictions is essential for AI interpretability and safety, yet existin

Symphony for Speech-to-Text: Supporting Real-Time Medical Voice Interfaces

arXiv:2605.16545v1 Announce Type: cross Abstract: After decades of use in dictation and, more recently, ambient documentation, speech is emerging as a primary modality for interacting with technology

TeleCom-Bench: How Far Are Large Language Models from Industrial Telecommunication Applications?

arXiv:2605.18025v1 Announce Type: new Abstract: While Large Language Models have achieved remarkable integration in various vertical scenarios, their deployment in the telecommunications domain remain

The Token Games: Evaluating Language Model Reasoning with Puzzle Duels

arXiv:2602.17831v2 Announce Type: replace Abstract: Evaluating the reasoning capabilities of Large Language Models is increasingly challenging as models improve. Human curation of hard questions is hi

TIER: Trajectory-Invariant Execution Rewards for Multi-Step Tool Composition

arXiv:2605.16790v1 Announce Type: cross Abstract: Tool use enables large language models to solve complex tasks through sequences of API calls, yet existing reinforcement learning approaches fail to s

UCSF-PDGM-VQA: Visual Question Answering dataset for brain tumor MRI interpretation

arXiv:2605.17140v1 Announce Type: cross Abstract: Brain tumor diagnosis is largely dependent on Magnetic Resonance Imaging (MRI) evaluation, which requires radiologists to synthesize thousands of imag

Use the Online Network If You Can: Towards Fast and Stable Reinforcement Learning

arXiv:2510.02590v2 Announce Type: replace Abstract: The use of target networks is a popular approach for estimating value functions in deep Reinforcement Learning (RL). While effective, the target net

safetyarxiv-cs-lg

VISTA-Bench: Do Vision-Language Models Really Understand Visualized Text as Well as Pure Text?

arXiv:2602.04802v2 Announce Type: replace Abstract: Vision-Language Models (VLMs) have achieved impressive performance in cross-modal understanding across textual and visual inputs, yet existing bench

WavFlow: Audio Generation in Waveform Space

arXiv:2605.18749v1 Announce Type: cross Abstract: Modern audio generation predominantly relies on latent-space compression, introducing additional complexity and potential information loss. In this wo

WebGameBench: Requirement-to-Application Evaluation for Coding Agents via Browser-Native Games

arXiv:2605.17637v1 Announce Type: new Abstract: Coding agents are increasingly used as application builders, yet many evaluations still focus on source code, repository-level tests, or intermediate tr

What Does the AI Doctor Value? Auditing Pluralism in the Clinical Ethics of Language Models

arXiv:2605.18738v1 Announce Type: new Abstract: Medicine is inherently pluralistic. Principles such as autonomy, beneficence, nonmaleficence, and justice routinely conflict, and such ethical dilemmas

When a Zero-Shooter Cheats: Improving Age Estimation via Activation Steering

arXiv:2605.17658v1 Announce Type: new Abstract: Different age-related regulations have been proposed to protect minors from harmful content and interactions online. Automated age estimation is central

researcharxiv-cs-lg

Agentic Discovery of Neural Architectures: AIRA-Compose and AIRA-Design

arXiv:2605.15871v1 Announce Type: new Abstract: Toward recursive self-improvement, we investigate LLM agents autonomously designing foundation models beyond standard Transformers. We introduce a dual-

AnyAct: Towards Human Reenactment of Character Motion From Video

arXiv:2605.15497v1 Announce Type: new Abstract: We study the problem of directly deriving an initial human reenactment from a monocular video of a non-human character. Our goal is not to reconstruct t

Argus: Evidence Assembly for Scalable Deep Research Agents

arXiv:2605.16217v1 Announce Type: cross Abstract: Deep research agents have achieved remarkable progress on complex information seeking tasks. Even long ReAct style rollouts explore only a single traj

CAX-Agent: A Lightweight Agent Harness for Reliable APDL Automation

arXiv:2605.15218v1 Announce Type: new Abstract: Large language models deployed for MAPDL finite-element simulation face practical reliability challenges: without structured execution control, tool enc

Deep Pre-Alignment for VLMs

arXiv:2605.15300v1 Announce Type: new Abstract: Most Vision Language Models (VLMs) directly map outputs from ViT encoders to the LLM via a lightweight projector. While effective, recent analysis sugge

Do Chinese models speak Chinese languages?

arXiv:2504.00289v3 Announce Type: replace-cross Abstract: The release of top-performing open-weight LLMs has cemented China's role as a leading force in AI development. Do these models support languag

Applications

Does Theory of Mind Improvement Really Benefit Human-AI Interactions? Empirical Findings from Interactive Evaluations

arXiv:2605.15205v1 Announce Type: new Abstract: Improving the Theory of Mind (ToM) capability of Large Language Models (LLMs) is crucial for effective social interactions between these AI models and h

applicationsarxiv-cs-ai

Dynamic-TreeRPO: Breaking the Independent Trajectory Bottleneck with Structured Sampling

arXiv:2509.23352v3 Announce Type: replace-cross Abstract: The integration of Reinforcement Learning (RL) into flow matching models for text-to-image (T2I) generation has driven substantial advances in

safetyarxiv-cs-ai

Entity-Centric World Models: Interaction-Aware Masking for Causal Video Prediction

arXiv:2605.15466v1 Announce Type: new Abstract: Learning predictive world models from unlabelled video is a foundational challenge in artificial intelligence. While Joint Embedding Predictive Architec

Flowette: Flow Matching with Graphette Priors for Graph Generation

arXiv:2602.23566v2 Announce Type: replace-cross Abstract: We study generative modeling of graphs with recurring subgraph motifs. We propose Flowette, a continuous flow matching framework that employs

safetyarxiv-cs-ai

From Layers to Networks: Comparing Neural Representations via Diffusion Geometry

model-releasesarxiv-cs-lg

arXiv:2605.15901v1 Announce Type: new Abstract: Diffusion geometry is a manifold learning framework that uses random walks defined by Markov transition matrices to characterize the geometry of a datas

GenShield: Unified Detection and Artifact Correction for AI-Generated Images

arXiv:2605.16122v1 Announce Type: cross Abstract: Diffusion-based image synthesis has made AI-generated images (AIGI) increasingly photorealistic, raising urgent concerns about authenticity in applica

Hierarchical and Holistic Open-Vocabulary Functional 3D Scene Graphs for Indoor Spaces

arXiv:2605.15753v1 Announce Type: cross Abstract: Functional 3D scene graphs offer a versatile and flexible representation for 3D scene understanding and robotic manipulation, defined by object nodes,

Large Language Models as Optimization Controllers: Adaptive Continuation for SIMP Topology Optimization

arXiv:2603.25099v2 Announce Type: replace-cross Abstract: We present a framework in which a large language model (LLM) acts as an online adaptive controller for SIMP topology optimization, replacing c

Long Range Frequency Tuning for QML

arXiv:2602.23409v2 Announce Type: replace-cross Abstract: Angle-encoded variational quantum circuits admit a truncated Fourier series representation of their output, but approximating functions with m

Applications

Metropolis-Scale Road Network Datasets for Fine-Grained Urban Traffic Modeling

arXiv:2510.02278v2 Announce Type: replace Abstract: Modeling traffic dynamics is a critical challenge for urban computing, with applications from real-time traffic management to infrastructure plannin

applicationsarxiv-cs-lg

On the Stability of Growth in Structural Plasticity

arXiv:2605.15435v1 Announce Type: new Abstract: Standard deep-learning pipelines usually choose the network architecture before training and keep it fixed throughout optimization. In contrast, a model

researcharxiv-cs-lg

PhysBrain 1.0 Technical Report

arXiv:2605.15298v1 Announce Type: cross Abstract: Vision-language-action models have advanced rapidly, but robot trajectories alone provide limited coverage for learning broad physical understanding.

Local Ai

Rethinking Predictive Modeling for LLM Routing: When Simple kNN Beats Complex Learned Routers

arXiv:2505.12601v2 Announce Type: replace Abstract: As large language models (LLMs) grow in scale and specialization, routing--selecting the best model for a given input--has become essential for effi

local-aiarxiv-cs-lg

SaaS-Bench: Can Computer-Use Agents Leverage Real-World SaaS to Solve Professional Workflows?

arXiv:2605.15777v1 Announce Type: new Abstract: Computer-Using Agents (CUAs) are rapidly extending large language models (LLMs) beyond text-based reasoning toward action execution in more complex envi