Search: “benchmark”

Mage: Multi-Axis Evaluation of LLM-Generated Executable Game Scenes Beyond Compile-Pass Rate

arXiv:2605.07342v1 Announce Type: cross Abstract: Compile-pass rate is the dominant evaluation signal for LLM code generation, yet for multi-component domain-specific artifacts it can be actively misl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

MaPPO: Maximum a Posteriori Preference Optimization with Prior Knowledge

DGX agent

arXiv:2507.21183v5 Announce Type: replace-cross Abstract: As the era of large language models (LLMs) unfolds, Preference Optimization (PO) methods have become a central approach to aligning LLMs with

safetyarxiv-cs-ai

11 May 2026

MAS-Algorithm: A Workflow for Solving Algorithmic Programming Problems with a Multi-Agent System

arXiv:2605.05949v2 Announce Type: replace Abstract: Algorithmic problem solving serves as a rigorous testbed for evaluating structured reasoning in AI coding systems, as it directly reflects a model's

Mask2Cause: Causal Discovery via Adjacency Constrained Causal Attention

arXiv:2605.07280v1 Announce Type: cross Abstract: Leveraging deep learning for causal discovery in time series remains challenging because existing neural methods predominantly rely on component-wise

MAST: A Multi-fidelity Augmented Surrogate model via Spatial Trust-weighting

arXiv:2602.20974v2 Announce Type: replace Abstract: In engineering design and scientific computing, computational cost and predictive accuracy are intrinsically coupled. High-fidelity simulations prov

researcharxiv-cs-lg

Mathematical Reasoning via Intervention-Based Time-Series Causal Discovery Using LLMs as Concept Mastery Simulators

arXiv:2605.07600v1 Announce Type: cross Abstract: Recent methods for improving LLM mathematical reasoning, whether through MCTS-based test-time search or causal graph-guided knowledge injection, canno

MAVEN: Multi-Agent Verification-Elaboration Network with In-Step Epistemic Auditing

arXiv:2605.07646v1 Announce Type: cross Abstract: While explicit reasoning trajectories enhance model interpretability, existing paradigms often rely on monolithic chains that lack intermediate verifi

MedAction: Towards Active Multi-turn Clinical Diagnostic LLMs

arXiv:2605.07305v1 Announce Type: cross Abstract: Most existing LLM diagnoses are evaluated on static, single-turn settings where complete patient information is provided upfront, an oversimplificatio

Agents

MedExAgent: Training LLM Agents to Ask, Examine, and Diagnose in Noisy Clinical Environments

arXiv:2605.07058v1 Announce Type: cross Abstract: Real-world clinical diagnosis is a complex process in which the doctor is required to obtain information from both interaction with the patient and co

agentsarxiv-cs-ai

MedVIGIL: Evaluating Trustworthy Medical VLMs Under Broken Visual Evidence

arXiv:2605.07919v1 Announce Type: new Abstract: Medical vision--language models (VLMs) are usually evaluated on intact image--question pairs, but trustworthy clinical use requires a stronger property:

MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Text

arXiv:2605.06903v1 Announce Type: cross Abstract: Large language models are now embedded in everyday writing workflows, making reliable AI-generated text detection important for academic integrity, co

MicroBi-ConvLSTM: An Ultra-Lightweight Efficient Model for Human Activity Recognition on Resource Constrained Devices

arXiv:2602.06523v2 Announce Type: replace Abstract: Human Activity Recognition (HAR) on resource constrained wearables requires models that balance accuracy against strict memory and computational bud

MIND: Monge Inception Distance for Generative Models Evaluation

arXiv:2605.06797v1 Announce Type: new Abstract: We propose the Monge Inception Distance (MIND), a metric for evaluating generative models that addresses key limitations of the widely adopted Frechet I

Mind the Gap: Geometrically Accurate Generative Reconstruction from Disjoint Views

arXiv:2605.07550v1 Announce Type: new Abstract: 3D vision systems are fundamentally constrained by their reliance on visual overlap: reconstruction methods require it for geometric alignment, while ge

safetyarxiv-cs-cv

Miner:Mining Intrinsic Mastery for Data-Efficient RL in Large Reasoning Models

arXiv:2601.04731v2 Announce Type: replace Abstract: Current critic-free RL methods for large reasoning models suffer from severe inefficiency when training on positive homogeneous prompts (where all r

Minerva: Reinforcement Learning with Verifiable Rewards for Cyber Threat Intelligence LLMs

arXiv:2602.00513v3 Announce Type: replace Abstract: Cyber threat intelligence (CTI) analysts routinely convert noisy, unstructured security artifacts into standardized, automation-ready representation

researcharxiv-cs-lg

MIPIAD: Multilingual Indirect Prompt Injection Attack Defense with Qwen -- TF-IDF Hybrid and Meta-Ensemble Learning

model-releasesarxiv-cs-cl

arXiv:2605.07269v1 Announce Type: new Abstract: Indirect prompt injection remains a persistent weakness in retrieval-augmented and tool-using LLM systems, and the problem becomes harder to characteris

Model-Driven Policy Optimization in Differentiable Simulators via Stochastic Exploration

arXiv:2605.07520v1 Announce Type: new Abstract: Differentiable planning enables gradient-based optimization of decision-making problems by leveraging differentiable models of system dynamics. However,

Motion-o: Trajectory-Grounded Video Reasoning

arXiv:2603.18856v2 Announce Type: replace-cross Abstract: Recent video reasoning models increasingly produce spatio-temporal evidence chains that localize objects at specific timestamps. While these t

researcharxiv-cs-ai

Multi-Environment POMDPs with Finite-Horizon Objectives

arXiv:2605.07537v1 Announce Type: new Abstract: Partially Observable Markov Decision Processes (POMDPs) are systems in which one agent interacts with a stochastic environment, and receives only partia

Multi-Objective Constraint Inference using Inverse reinforcement learning

arXiv:2605.06951v1 Announce Type: new Abstract: Constraint inference is widely considered essential to align reinforcement learning agents with safety boundaries and operational guidelines by observin

Normalizing Trajectory Models

arXiv:2605.08078v1 Announce Type: new Abstract: Diffusion-based models decompose sampling into many small Gaussian denoising steps -- an assumption that breaks down when generation is compressed to a

researcharxiv-cs-cv

Tutorials

Not All Tokens Learn Alike: Attention Entropy Reveals Heterogeneous Signals in RL Reasoning

arXiv:2605.07660v1 Announce Type: new Abstract: Reinforcement-learning-based post-training has become a key approach for improving the reasoning ability of large language models, but its token-level l

tutorialsarxiv-cs-cl

NPMixer: Hierarchical Neighboring Patch Mixing for Time Series Forecasting

arXiv:2605.07476v1 Announce Type: new Abstract: Multivariate time series forecasting remains a challenge due to the complexity of local temporal dynamics and global dependencies across multiple variab

NS-Net: Decoupling CLIP Semantic Information through NULL-Space for Generalizable AI-Generated Image Detection

arXiv:2508.01248v4 Announce Type: replace Abstract: The rapid progress of generative models, such as GANs and diffusion models, has facilitated the creation of highly realistic images, raising growing

OASES: Outcome-Aligned Search-Evaluation Co-Training for Agentic Search

arXiv:2604.03675v2 Announce Type: replace Abstract: Agentic search enables language models to solve knowledge-intensive tasks by adaptively acquiring external evidence over multiple steps. Reinforceme

Offline Policy Optimization with Posterior Sampling

arXiv:2605.07393v1 Announce Type: new Abstract: A fundamental challenge in model-based offline reinforcement learning (RL) lies in the trade-off between generalization and robustness against exploitat

One of the most important properties of LLMs that we take for granted is that newer, bigger models are just better at everything. The AI Lab…

model-releasesethan-mollick--x

One of the most important properties of LLMs that we take for granted is that newer, bigger models are just better at everything. The AI Labs are pouring effort into economically valuable fields like

Optimal Experiments for Partial Causal Effect Identification

arXiv:2605.06993v1 Announce Type: new Abstract: Causal queries are often only partially identifiable from observational data, and experiments that could tighten the resulting bounds are typically cost

Optimizing Language Models for Crosslingual Knowledge Consistency

arXiv:2603.04678v2 Announce Type: replace-cross Abstract: Large language models are known to often exhibit inconsistent knowledge. This is particularly problematic in multilingual scenarios, where mod

PAIR-Former: Budgeted Relational Multi-Instance Learning for Functional miRNA Target Prediction

arXiv:2602.00465v3 Announce Type: replace-cross Abstract: Functional miRNA--mRNA targeting is a large-bag prediction problem where each transcript yields a heavy-tailed pool of candidate target sites

PaT: Planning-after-Trial for Efficient Test-Time Code Generation

arXiv:2605.07248v1 Announce Type: new Abstract: Beyond training-time optimization, scaling test-time computation has emerged as a key paradigm to extend the reasoning capabilities of Large Language Mo

safetyarxiv-cs-cl

PathPainter: Transferring the Generalization Ability of Image Generation Models to Embodied Navigation

model-releasesarxiv-cs-ro

arXiv:2605.07496v1 Announce Type: new Abstract: Bird's-eye-view (BEV) images have been widely demonstrated to provide valuable prior information for navigation. Given the global information provided b

PerCaM-Health: Personalized Dynamic Causal Graphs for Healthcare Reasoning

arXiv:2605.07267v1 Announce Type: new Abstract: Personalized healthcare decisions require reasoning about how physiological and behavioral variables influence an individual patient over time. Existing

PerfCoder: Large Language Models for Interpretable Code Performance Optimization

arXiv:2512.14018v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have achieved remarkable progress in automatic code generation, yet their ability to produce high-performance cod

Physical Simulators as Do-Operators: Causal Discovery under Latent Confounders for AI-for-Science

arXiv:2605.07467v1 Announce Type: cross Abstract: Existing interventional causal discovery methods -- IGSP, DCDI, ENCO -- assume causal sufficiency (no latent confounders) and rely on virtual interven

PhySPRING: Structure-Preserving Reduction of Physics-Informed Twins via GNN

model-releasesarxiv-cs-ro

arXiv:2605.07687v1 Announce Type: new Abstract: Physics-based digital twins aim to predict the dynamics of real-world objects under interaction, enabling real-to-sim-to-real applications in robotics.

PISTO: Proximal Inference for Stochastic Trajectory Optimization

arXiv:2605.07215v1 Announce Type: new Abstract: Stochastic trajectory optimization methods like STOMP enable planning with non-differentiable costs, offering substantial flexibility over gradient-base

researcharxiv-cs-ro

PolarVLM: Bridging the Semantic-Physical Gap in Vision-Language Models

arXiv:2605.07574v1 Announce Type: new Abstract: Mainstream vision-language models (VLMs) fundamentally struggle with severe optical ambiguities, such as reflections and transparent objects, due to the

PRIMED: Adaptive Modality Suppression for Referring Audio-Visual Segmentation via Biased Competition

arXiv:2605.07154v1 Announce Type: new Abstract: Referring Audio-Visual Segmentation (Ref-AVS) seeks to localize and segment target objects in video frames based on visual, auditory, and textual referr

Proxy3D: Efficient 3D Representations for Vision-Language Models via Semantic Clustering and Alignment

arXiv:2605.08064v1 Announce Type: new Abstract: Spatial intelligence in vision-language models (VLMs) attracts research interest with the practical demand to reason in the 3D world.Despite promising r

safetyarxiv-cs-cv

Prune-OPD: Efficient and Reliable On-Policy Distillation for Long-Horizon Reasoning

arXiv:2605.07804v1 Announce Type: cross Abstract: On-policy distillation (OPD) leverages dense teacher rewards to enhance reasoning models. However, scaling OPD to long-horizon tasks exposes a critica

QuadNorm: Resolution-Robust Normalization for Neural Operators

arXiv:2605.07375v1 Announce Type: new Abstract: Normalization layers in neural operators usually compute statistics by uniformly averaging discrete grid values, making the normalization itself discret

researcharxiv-cs-lg

Quotient Semivalues for False-Name-Resistant Data Attribution

arXiv:2605.07663v1 Announce Type: cross Abstract: Data valuation methods allocate payments and audit training data's contribution to machine-learning pipelines; however, they often assume passive cont

ReasonSTL: Bridging Natural Language and Signal Temporal Logic via Tool-Augmented Process-Rewarded Learning

arXiv:2605.06483v2 Announce Type: replace Abstract: Signal Temporal Logic (STL) is an expressive formal language for specifying spatio-temporal requirements over real-valued, real-time signals. It has

ReCLIP++: Learn to Rectify the Bias of CLIP for Unsupervised Semantic Segmentation

arXiv:2408.06747v4 Announce Type: replace Abstract: Recent works utilize CLIP to perform the challenging unsupervised semantic segmentation task where only images without annotations are available. Ho

safetyarxiv-cs-cv

Local Ai

Reformulating KV Cache Eviction Problem for Long-Context LLM Inference

arXiv:2605.07234v1 Announce Type: cross Abstract: Large language models (LLMs) support long-context inference but suffer from substantial memory and runtime overhead due to Key-Value (KV) Cache growth

local-aiarxiv-cs-ai

Region4Web: Rethinking Observation Space Granularity for Web Agents

arXiv:2605.07134v1 Announce Type: cross Abstract: Web agents perceive web pages through an observation space, yet its granularity has remained an underexamined design choice. Existing work treats obse