Search: “benchmark”

Decision-Support and Modeling with Large Language Models for Geothermal Well Arrays

arXiv:2608.22068v1 Announce Type: new Abstract: Geothermal well arrays, which organize multiple geothermal wells into carefully planned geometric configurations, provide opportunities to enhance energ

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Decoupled Physical Modeling and Execution for Physics Reasoning

DGX agent

arXiv:2608.22126v1 Announce Type: cross Abstract: Physics reasoning requires constructing a consistent model of the underlying physical system rather than relying solely on symbolic or formula-based m

researcharxiv-cs-cl

25 Aug 2026

Evaluating Multimodal Narrative Understanding of Popular Hollywood Films

arXiv:2608.21430v1 Announce Type: new Abstract: Multimodal language models increasingly show promise for enabling the large-scale computational analysis of film, opening up new avenues for learning ab

Evaluating the Efficacy of LLMs to Emulate Realistic Human Personalities

arXiv:2402.14879v2 Announce Type: replace-cross Abstract: To enhance immersion and engagement in video games, the design of Affective Non-Player Characters (ANPCs) is a key focus for researchers and p

Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation

arXiv:2409.16183v2 Announce Type: replace Abstract: Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in me

Fidelity-Diversity-Consistency (FDC): Data Pruning for Remote Sensing Change Detection

arXiv:2608.21754v1 Announce Type: new Abstract: Despite the success of data pruning (DP) in reducing training data sizes and improving downstream model performance in classification and segmentation t

From Inertia to Objectivity: Improving Deep Research Agents with Noise Isolation

arXiv:2608.23045v1 Announce Type: new Abstract: Web search agents powered by Large Language Models (LLMs) show strong promise, but deep research tasks expose a recurring failure mode: once an agent ha

GameXpert-Bench: How Far Are Coding Agents from Expert Game Development?

arXiv:2608.21833v1 Announce Type: new Abstract: Recent large language models (LLMs) can operate as coding agents that build complete games from natural language requests. Game development is especiall

Grounded Normative Rule Generation with Structured Search

arXiv:2608.22229v1 Announce Type: new Abstract: Normative rules like institutional charters and workplace policies must be both human-readable and operationally verifiable against actual environment r

Grounding Free-Form Instructions for Fashion Complementary Image Generation

arXiv:2608.23302v1 Announce Type: new Abstract: Fashion complementary image generation (CIG) aims to create garments that stylistically match a seed item based on user intent, making it a natural mult

How Merge-Tolerant Are Vision Transformers for Wheat Phenotyping?

arXiv:2608.23142v1 Announce Type: new Abstract: Vision-based wheat phenotyping requires repeated measurements under deployment constraints, from growth-stage recognition to wheat-head counting and org

Learning to Look Again: Loss-Gap Supervision for Free-form Crop Routing in Vision-Language Models

arXiv:2608.21762v1 Announce Type: cross Abstract: Vision-language models (VLMs) fail many detail-centric questions for a concrete reason: the answer is visible in the image, yet lost after the image i

LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications

arXiv:2608.23058v1 Announce Type: new Abstract: Large language models (LLMs) now support forecasting systems that combine language-based reasoning with temporal data, evidence retrieval, external tool

MASH-Bench: Diagnosing Cross-Source Failure in Mass-Shooting Risk Classification

arXiv:2608.22460v1 Announce Type: new Abstract: Public mass-shooting databases differ substantially in coverage, feature availability, and reporting practices, creating challenges for machine-learning

MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance

arXiv:2608.21867v1 Announce Type: new Abstract: LLM agents are moving from single-prompt use to long task streams in which reusable memory becomes a core capability for terminal, software-engineering,

Motion-Aware Vision-Reference Alignment for Referring Multi-Object Tracking

arXiv:2511.17681v2 Announce Type: replace Abstract: Referring Multi-Object Tracking (RMOT) extends conventional multi-object tracking (MOT) by introducing natural language references for multi-modal f

Mover360: Controllable Object Manipulation in 360{eg} Panoramic Images

arXiv:2608.23238v1 Announce Type: new Abstract: We present Mover360, a controllable object manipulation framework for 360{eg} images. Unlike perspective images, 360{eg} images in equirectangular proje

NeST: Neighborhood-aware semantic alignment and temporal modulation for LLM based time series forecasting

arXiv:2412.04806v2 Announce Type: replace-cross Abstract: Adapting Large Language Models (LLMs) trained on discrete text data, to forecast continuous time series signals is challenging. While finetuni

PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks

arXiv:2608.21381v1 Announce Type: cross Abstract: Personal intelligence is becoming a central frontier for user-facing AI agents. To be helpful in everyday life, agents must understand users across th

Perturb the Thought, Not the Pixels: Latent-Space Rollout Diversification for Reinforcement Learning of Vision-Language Models

arXiv:2608.21595v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) improves the reasoning ability of vision-language models (VLMs), and diversifying the rollouts wit

Quantum Reservoir Computing with Physics-Informed Correction for Reduced-Order PDE Forecasting

arXiv:2608.23119v1 Announce Type: cross Abstract: We study a hybrid proposal--correction architecture for reduced-order PDE forecasting in which a pure-state quantum reservoir computer (QRC) predicts

RAD: Rule-Augmented Relational Anomaly Detection

arXiv:2608.23468v1 Announce Type: new Abstract: Anomaly detection is often applied to data stored in relational databases, yet most existing methods require flattening multiple tables into a single fe

Redteaming Leading Arabic LLMs with ASAS

arXiv:2608.21985v1 Announce Type: new Abstract: As the adoption of large language models (LLMs) grows in Arabic-speaking regions, ensuring their safety and cultural alignment is increasingly critical.

RIBOSPAN: A Long-Context RNA Foundation Model for Versatile RNA Modeling

arXiv:2608.22849v1 Announce Type: new Abstract: Full-length RNAs, particularly messenger RNAs, often exceed the context lengths used to pretrain existing RNA foundation models, limiting complete-trans

Semantics or Structure? Auditing Text Sensitivity in Multimodal Time-Series Forecasting

arXiv:2608.22321v1 Announce Type: new Abstract: Multimodal time-series forecasting has emerged as a promising paradigm in which natural-language context is expected to improve predictive performance.

Agents

Social Graph Mamba: Forecasting Pedestrian Movements Based on Social Context

arXiv:2608.21411v1 Announce Type: new Abstract: Forecasting pedestrian motion has always been fundamental for autonomous navigation in crowded environments. While attention-based methods achieve stron

agentsarxiv-cs-ro

SPAR-Hate: An Auditor-Guided Multi-Agent Framework for Bilingual Hate Speech Parsing

arXiv:2608.22018v1 Announce Type: new Abstract: Hate speech detection has recently shifted from coarse-grained classification to structured parsing, where systems must jointly identify hateful targets

Stress Testing Unlearning Algorithms

arXiv:2608.22527v1 Announce Type: new Abstract: Recently, machine unlearning, the removal of specific training data influence from a model, has gained increasing attention. In large language models (L

SWE Refactor Bench: Can Coding Agents Complete a Long-Horizon, Whole-Repository Stack Migration?

arXiv:2608.23564v1 Announce Type: cross Abstract: Modern software systems accumulate technical debt over decades of development, which makes migration expensive and largely manual. As coding agents be

Towards Comprehensive Basketball Understanding

arXiv:2608.23435v1 Announce Type: cross Abstract: Understanding a basketball game requires recognizing events, localizing actions, identifying players, and relating these to structured game knowledge.

Local Ai

Where World Models Break: Natural-Input Failure Discovery

arXiv:2608.22421v1 Announce Type: new Abstract: World models predict action-conditioned futures and serve as critical internal simulators for downstream planning and control. However, catastrophic pre

local-aiarxiv-cs-ai

AffordAny: Open-World 3D Affordance Grounding from Monocular RGB Images via Vision-Language-Guided Geometric Reasoning

arXiv:2608.20720v1 Announce Type: new Abstract: Open-world 3D affordance grounding requires localizing functional object parts in 3D given free-form language queries. Existing methods typically assume

Research

AGIDefect-4K: A Richly Annotated Dataset for AI-Generated Image Defect Detection, Localization and Explanation

arXiv:2608.20713v1 Announce Type: new Abstract: Generative AI can now produce highly realistic images, yet current models still exhibit subtle but critical defects that undermine their reliability. Wh

researcharxiv-cs-cv

Applying Anthropic Primitives at Large Enterprises: Harness Paradigm for Knowledge Work

arXiv:2608.20622v1 Announce Type: new Abstract: Frontier models have collapsed the cost of writing custom code: a niche problem a specialist sees in their own domain now costs an afternoon. The cost o

AsmEvo: Agentic Assembly-Level Optimization of AMD GPU Kernels with Functional Equivalence Verification

arXiv:2608.20711v1 Announce Type: new Abstract: High-performance ML systems increasingly rely on GPU kernels whose editable source is unavailable, generated, or too distant from final machine code to

Belief Without Behavior: Measuring the Translation of Theory of Mind into Coordinated Social Action in Vision-Language Models

arXiv:2608.20975v1 Announce Type: new Abstract: Effective social interaction requires agents to translate mental state inferences into coordinated behavioral signals across verbal and nonverbal channe

Beyond Endpoint Gains: A Weight-Delta Audit of Medical Specialization

arXiv:2608.20768v1 Announce Type: new Abstract: Specialist language models are usually understood through endpoint gains: the generalist scores lower, the specialist scores higher, and the difference

Coverage-Driven Verification for Safety-by-Design in AI-Based Collision Avoidance Systems

arXiv:2608.20864v1 Announce Type: new Abstract: Artificial Intelligence (AI) offers significant potential for future aviation systems; however, its integration into safety-critical applications requir

EditPPT: Faithful Long-Deck Slide Editing via Structured Tool-Using Multi-Agent with Dual-Modal Validators

arXiv:2608.20381v1 Announce Type: cross Abstract: Automating slide editing requires simultaneously satisfying modification accuracy, preservation fidelity, and robustness to deck length. Existing LLM-

EmotionDialogCN: A Spontaneous Multimodal Dataset for Mandarin Emotional Dialogue

arXiv:2608.20905v1 Announce Type: new Abstract: Face-to-face audiovisual interaction is central to human communication, conveying rich emotional and social cues. However, existing multimodal dialogue

Fine-tuning LLMs for Tourist Trajectory Prediction using Field Experiment Data

arXiv:2608.20830v1 Announce Type: cross Abstract: Evaluating mobility interventions at tourist destinations requires predicting visitor behavior under varying conditions. Traditional methods struggle

GS-Net: Heterogeneous Vehicle Data Reuse via Generalizable Plug-and-Play 3DGS Module

arXiv:2409.11307v2 Announce Type: replace Abstract: End-to-end autonomous driving is increasingly data-driven, yet data reuse across vehicles remains limited. Each new vehicle often requires additiona

Hardware

HIERA: Workload-Aware Planning Across Implementation Spaces for GPU Kernel Optimization

arXiv:2608.21157v1 Announce Type: cross Abstract: High-performance GPU kernels underpin modern deep learning and scientific computing. As workloads become increasingly diverse and GPU hardware evolves

hardwarearxiv-cs-ai

Is Visual Prompting All You Need? Studying VLM Spatial Reasoning under Progressive Visual Scaffolds

arXiv:2608.21170v1 Announce Type: cross Abstract: Vision-language models (VLMs) have advanced rapidly in multimodal reasoning, yet recent work shows that their failures often reflect an interaction be

Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda

arXiv:2608.21107v1 Announce Type: new Abstract: Large Language Models (LLMs) are moving from code completion toward repository-scale agents that retrieve context, edit files, execute tools, and partic

LiLiCorr: Lightweight Likelihood Correlation of Parallel Drafts for Speculative Decoding

arXiv:2608.20530v1 Announce Type: new Abstract: Speculative decoding accelerates language-model inference by drafting future tokens that the target model verifies in parallel. A diffusion-style block

Research

MV2GF: Multi-view Pedestrian Detection with a Visual Geometric Foundation Model

arXiv:2608.20639v1 Announce Type: new Abstract: Multi-View Pedestrian Detection (MVPD) aims to detect pedestrians in the form of a bird's eye view map from multi-view images. Recent MVPD methods adopt

researcharxiv-cs-cv

PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval

arXiv:2603.01493v2 Announce Type: replace-cross Abstract: Personal photo albums are not merely collections of static images but living, ecological archives defined by temporal continuity, social entan