Search: “benchmark”

Unified Deployment-Aware Evaluation of Open Reasoning Language Models

model-releasesarxiv-cs-cl

arXiv:2604.07035v2 Announce Type: replace Abstract: Open reasoning language models are often compared under mixed sample sizes, partially standardized prompts, and accuracy-centered summaries, which m

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Vision Harnessing Agent for Open Ad-hoc Segmentation

DGX agent

arXiv:2605.19410v1 Announce Type: new Abstract: Segmentation has become easy when the concept is known, requiring retrieval of a learned visual grounding from text. It remains hard for open ad-hoc con

model-releasesarxiv-cs-cv

20 May 2026

What Do Evolutionary Coding Agents Evolve?

arXiv:2605.20086v1 Announce Type: cross Abstract: Recent work pairs LLMs with evolutionary search to iteratively generate, modify, and select code using task-specific feedback. These systems have prod

Agents

When Skills Don't Help: A Negative Result on Procedural Knowledge for Tool-Grounded Agents in Offensive Cybersecurity

arXiv:2605.20023v1 Announce Type: new Abstract: Agent Skills, structured packages of procedural knowledge loaded into an LLM agent at inference time, are widely reported to improve task pass rates by

agentsarxiv-cs-ai

World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Tasks

arXiv:2605.19957v1 Announce Type: cross Abstract: World models are widely explored in embodied intelligence, yet they typically predict distinct evolutions of the world and the ego within a single str

WoundFormer: Multi-Scale Spatial Feature Fusion for Multi-Class Wound Tissue Segmentation

arXiv:2605.19868v1 Announce Type: new Abstract: Chronic wounds such as diabetic foot ulcers and pressure injuries require accurate tissue-level assessment to guide treatment planning and monitor heali

AI for Auto-Research: Roadmap & User Guide

arXiv:2605.18661v1 Announce Type: new Abstract: AI-assisted research is crossing a threshold: fully automated systems can now generate research papers for as little as $15, while long-horizon agents c

ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics

arXiv:2605.16582v1 Announce Type: new Abstract: We present ArtMesh, a mesh-native method for reconstructing articulated objects explicitly as connected triangle meshes with per-part rigid motion from

ASPI: Seeking Ambiguity Clarification Amplifies Prompt Injection Vulnerability in LLM Agents

arXiv:2605.17324v1 Announce Type: cross Abstract: Clarification-seeking behavior is widely regarded as a desirable property of LLM agents, enabling them to resolve ambiguity before acting on underspec

Automated Root-Cause Subclassification and No-Code Fix Generation for Invalid Bug Reports

arXiv:2605.17561v1 Announce Type: cross Abstract: Issues faced when using software are reported in the form of bug reports. However, many bug reports are invalid, meaning they do not require code chan

Boundedly Rational Meta-Learning in Sequential Consumer Choice

arXiv:2605.16532v1 Announce Type: new Abstract: Many consumer decisions are repeated choices under uncertainty. Standard models capture these decisions using Bayesian learning and dynamic programming:

Brain-inspired spike-timing plasticity for reliable label-efficient event-camera vision

arXiv:2605.17686v1 Announce Type: new Abstract: Deploying event-camera object detectors is constrained by per-frame labeling requirements and GPU compute demands. This work introduces three local spik

Breaking Annotation Barriers: Generalized Video Quality Assessment via Ranking-based Self-Supervision

arXiv:2505.03631v4 Announce Type: replace Abstract: Video quality assessment (VQA) is essential for quantifying perceptual quality in various video processing workflows, spanning from camera capture s

Causal Intervention-Based Memory Selection for Long-Horizon LLM Agents

arXiv:2605.17641v1 Announce Type: new Abstract: Long-horizon LLM agents rely on persistent memory to support interactions across sessions, yet existing memory systems often retrieve context using sema

CayleyPy RL: Pathfinding and Reinforcement Learning on Cayley Graphs

arXiv:2502.18663v3 Announce Type: replace Abstract: This paper is the second in a series of studies on developing efficient artificial intelligence-based approaches to pathfinding on extremely large g

Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis

arXiv:2605.18451v1 Announce Type: new Abstract: Designing realistic and functional 3D indoor rooms is essential for a wide range of applications, including interior design, virtual reality, gaming, an

ContractBench: Can LLM Agents Preserve Observation Contracts?

arXiv:2605.17281v1 Announce Type: cross Abstract: Tool-augmented LLM agents call APIs whose intermediate outputs, such as presigned URLs, session tokens, and OAuth state parameters, are observation co

D^2Evo: Dual Difficulty-Aware Self-Evolution for Data-Efficient Reinforcement Learning

arXiv:2605.17037v1 Announce Type: cross Abstract: Reinforcement learning (RL) has demonstrated potential for enhancing reasoning in large language models (LLMs). However, effective RL training, which

researcharxiv-cs-ai

DriveSafer: End-to-End Autonomous Driving with Safety Guidance

arXiv:2605.16737v1 Announce Type: cross Abstract: End-to-End (E2E) autonomous driving models have shown growing capability in recent years, with performance improving on increasingly challenging bench

Efficient Lookahead Encoding and Abstracted Width for Learning General Policies in Classical Planning

arXiv:2605.18674v1 Announce Type: new Abstract: Generalized planning aims to learn policies that generalize across collections of instances within a classical planning domain. Recent Graph Neural Netw

EgoExoMem: Cross-View Memory Reasoning over Synchronized Egocentric and Exocentric Videos

arXiv:2605.18734v1 Announce Type: new Abstract: Egocentric memory is widely used in embodied intelligence, but it may be insufficient for comprehensive spatial-temporal reasoning. Inspired by human re

Evidence-Grounded Frontier Mapping and Agentic Hypothesis Generation in Nanomedicine

arXiv:2605.18144v1 Announce Type: new Abstract: Nanomedicine research spans delivery chemistry, immunology, imaging, biomaterials, and disease-specific translational science, yet its conceptual design

extit{Don't Guess, Just Ask}: Resolving Ambiguity in Referring Segmentation via Multi-turn Clarification

arXiv:2605.17531v1 Announce Type: new Abstract: Referring segmentation aims to segment the target objects in images or videos based on the textual query. Despite remarkable progress over the past year

Foundation Models for Credit Risk Prediction: A Game Changer?

arXiv:2605.18147v1 Announce Type: new Abstract: Predictive models play a pivotal role in credit risk management, guiding critical decisions through accurate estimation of default probabilities and los

researcharxiv-cs-lg

Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Models

arXiv:2602.02039v2 Announce Type: replace Abstract: The agency expected of Agentic Large Language Models goes beyond answering correctly, requiring autonomy to set goals and decide what to explore. We

Identifiable Token Correspondence for World Models

arXiv:2605.16457v1 Announce Type: cross Abstract: Transformer-based world models have shown strong performance in visual reinforcement learning, but often suffer from temporal inconsistency in long-ho

Internalizing Tool Knowledge in Small Language Models via QLoRA Fine-Tuning

model-releasesarxiv-cs-cl

arXiv:2605.17774v1 Announce Type: new Abstract: Large language models are increasingly used as planning components in agentic systems, but current tool-use pipelines often require full tool schemas to

Learning How to Cube

arXiv:2605.16632v1 Announce Type: cross Abstract: Despite the effectiveness of Cube-and-Conquer (C&C) for solving challenging Boolean Satisfiability (SAT) problems, no prior work has shown that transf

Leveraging Error Diversity in Group Rollouts for Reinforcement Learning

arXiv:2605.17333v1 Announce Type: new Abstract: Reinforcement Learning from Verifiable Rewards (RLVR) typically samples multiple responses per prompt and assigns binary rewards based on individual cor

researcharxiv-cs-lg

Tutorials

Leveraging Latent Visual Reasoning in Silence

arXiv:2605.18641v1 Announce Type: new Abstract: Latent visual reasoning involves visual evidence more directly in multimodal reasoning by inserting continuous latent tokens before textual generation.

tutorialsarxiv-cs-cv

LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation

arXiv:2410.13846v3 Announce Type: replace-cross Abstract: Scaling language models to handle longer contexts introduces substantial memory challenges due to the growing cost of key-value (KV) caches. M

Lightweight CNN-Based DDoS Detection for Resource-Constrained Edge Networks

arXiv:2309.05646v2 Announce Type: replace-cross Abstract: Distributed Denial of Service (DDoS) attacks remain a persistent threat to the availability of Internet services, edge networks, and cyber-phy

LongMINT: Evaluating Memory under Multi-Target Interference in Long-Horizon Agent Systems

arXiv:2605.18565v1 Announce Type: cross Abstract: Real-world agents operate over long and evolving horizons, where information is repeatedly updated and may interfere across memories, requiring accura

ManiSoft: Towards Vision-Language Manipulation for Soft Continuum Robotics

arXiv:2605.18617v1 Announce Type: cross Abstract: Most existing vision-language manipulation research targets rigid robotic arms, whose fixed morphology limits adaptability in cluttered or confined sp

Merlin's Whisper: Enabling Efficient Reasoning in Large Language Models via Black-box Persuasive Prompting

model-releasesarxiv-cs-cl

arXiv:2510.10528v3 Announce Type: replace Abstract: Large reasoning models (LRMs) have demonstrated remarkable proficiency in tackling complex tasks through step-by-step thinking. However, this length

Multimodal Cultural Heritage Knowledge Graph Extension with Language and Vision Models

arXiv:2605.17669v1 Announce Type: new Abstract: The preservation and interpretation of cultural heritage increasingly rely on digital technologies, among which Knowledge Graphs (KGs) stand out for the

Hardware

Neural-network methods for two-dimensional finite-source reflector design

arXiv:2604.02184v2 Announce Type: replace Abstract: We address the inverse problem of designing two-dimensional reflectors that transform light from a finite, extended source into a prescribed far-fie

hardwarearxiv-cs-lg

NGM: A Plug-and-Play Training-Free Memory Module for LLMs

arXiv:2605.16893v1 Announce Type: new Abstract: Recent studies introduce conditional memory modules that decouple knowledge storage from neural computation, enabling more direct knowledge access. Comp

researcharxiv-cs-ai

Not What You Asked For: Typographic Attacks in Household Robot Manipulation

arXiv:2605.18593v1 Announce Type: cross Abstract: Open-vocabulary embodied AI agents increasingly rely on vision-language models such as CLIP for object perception and task grounding. However, the sha

Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Tasks

arXiv:2605.18583v1 Announce Type: cross Abstract: Coding agents now run autonomously with shell, file, and network privileges. When a user issues a benign request, the agent sometimes does more than a

Agents

PopuLoRA: Co-Evolving LLM Populations for Reasoning Self-Play

arXiv:2605.16727v1 Announce Type: new Abstract: We introduce PopuLoRA, a population-based asymmetric self-play framework for reinforcement learning with verifiable rewards (RLVR) post-training of LLMs

agentsarxiv-cs-ai

ProtoSiTex: Learning Semi-Interpretable Prototypes for Multi-label Text Classification

arXiv:2510.12534v4 Announce Type: replace Abstract: The rapid growth of user-generated text across digital platforms has intensified the need for interpretable models capable of fine-grained text clas

Local Ai

PySIFT: GPU-Resident Deterministic SIFT for Deep Learning Vision Pipelines

arXiv:2605.17869v1 Announce Type: new Abstract: A widespread assumption in local feature research holds that classical handcrafted descriptors are accuracy-limited relics best replaced by learned alte

local-aiarxiv-cs-cv

Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstruction

arXiv:2605.16981v1 Announce Type: new Abstract: Streaming 3D reconstruction under a strict constant-memory budget hinges on how the recurrent state is updated as the stream evolves. We profile TTT3R-s

researcharxiv-cs-cv

ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Driving

arXiv:2508.13977v3 Announce Type: replace Abstract: Depth estimation is a fundamental component of spatial perception for autonomous driving and other unmanned systems operating in open urban environm

SaaSBench: Exploring the Boundaries of Coding Agents in Long-Horizon Enterprise SaaS Engineering

arXiv:2605.17526v1 Announce Type: cross Abstract: As autonomous coding agents become capable of handling increasingly long-horizon tasks, they have gradually demonstrated the potential to complete end

Safety

Safety Geometry Collapse in Multimodal LLMs and Adaptive Drift Correction

arXiv:2605.18104v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) often fail to transfer safety capabilities learned in the text modality to semantically equivalent non-text inp

safetyarxiv-cs-ai

SE-GA: Memory-Augmented Self-Evolution for GUI Agents

arXiv:2605.16883v1 Announce Type: new Abstract: Autonomous Graphical User Interface (GUI) agents often struggle with multi-step tasks due to constrained context windows and static policies that fail t