Search: “evaluation”

Explicit Reasoning Makes Better Judges: A Systematic Study on Accuracy, Efficiency, and Robustness

arXiv:2509.13332v2 Announce Type: replace Abstract: As Large Language Models (LLMs) are increasingly adopted as automated judges in benchmarking and reward modeling, ensuring their reliability, effici

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Exploring and Exploiting Stability in Latent Flow Matching

DGX agent

arXiv:2605.08398v1 Announce Type: cross Abstract: In this work, we show that Latent Flow-Matching (LFM) models are robust to different types of perturbations, including data reduction and model capaci

researcharxiv-cs-cv

12 May 2026

Exploring the AI Obedience: Why is Generating a Pure Color Image Harder than CyberPunk?

arXiv:2603.00166v2 Announce Type: replace-cross Abstract: Recent advances in generative AI have shown human-level performance in complex content creation. However, we identify a 'Paradox of Simplicity

FraudBench: A Multimodal Benchmark for Detecting AI-Generated Fraudulent Refund Evidence

arXiv:2605.08820v1 Announce Type: cross Abstract: Artificial Intelligence (AI)-generated images have become increasingly realistic and readily adaptable to concrete real-world claims, creating new cha

Free Energy Manifold: Score-Based Inference for Hybrid Bayesian Networks

arXiv:2605.09839v1 Announce Type: cross Abstract: We introduce the Free Energy Manifold (FEM), a score-trained conditional energy model specialized for inference in hybrid Bayesian networks with discr

researcharxiv-cs-ai

Generative Actor-Critic with Soft Bridge Policies

model-releasesarxiv-cs-lg

arXiv:2605.08733v1 Announce Type: new Abstract: Expressive generative policies such as diffusion and flow models are appealing for MaxEnt online reinforcement learning because of their ability to mode

Generative Adversarial Post-Training Mitigates Reward Hacking in Live Human-AI Music Interaction

arXiv:2511.17879v4 Announce Type: replace Abstract: Most applications of generative AI involve a sequential interaction in which a person inputs a prompt and waits for a response, and where reaction t

safetyarxiv-cs-lg

GONE: Structural Knowledge Unlearning via Neighborhood-Expanded Distribution Shaping

model-releasesarxiv-cs-lg

arXiv:2603.12275v1 Announce Type: cross Abstract: Unlearning knowledge is a pressing and challenging task in Large Language Models (LLMs) because of their unprecedented capability to memorize and dige

Agents

HAMLET: A Hierarchical and Adaptive Multi-Agent Framework for Live Embodied Theatrics

arXiv:2507.15518v5 Announce Type: replace Abstract: Creating an immersive and interactive theatrical experience is a long-term goal in the field of interactive narrative. The emergence of large langua

agentsarxiv-cs-ai

IndustryBench: Probing the Industrial Knowledge Boundaries of LLMs

arXiv:2605.10267v1 Announce Type: new Abstract: In industrial procurement, an LLM answer is useful only if it survives a standards check: recommended material must match operating condition, every par

Kinetic-Optimal Scheduling with Moment Correction for Metric-Induced Discrete Flow Matching in Zero-Shot Text-to-Speech

arXiv:2605.09386v1 Announce Type: cross Abstract: Metric-induced discrete flow matching (MI-DFM) exploits token-latent geometry for discrete generation, but its practical use is limited by two issues:

researcharxiv-cs-ai

Language Models Without a Trainable Input Embedding Table: Learning from Fixed Minimal Binary Token Codes

model-releasesarxiv-cs-cl

arXiv:2605.09751v1 Announce Type: new Abstract: Trainable input embedding tables are a standard component of modern language models. We ask whether they are actually necessary at the input interface.

Tutorials

Learning from Acceptance: Cumulative Regret in the Game of Coding

arXiv:2605.09754v1 Announce Type: cross Abstract: Classical coding-theoretic guarantees often rely on trust assumptions, such as requiring sufficiently many honest nodes compared with adversarial ones

tutorialsarxiv-cs-lg

Learning Multi-Indicator Weights for Data Selection: A Joint Task-Model Adaptation Framework with Efficient Proxies

arXiv:2605.09665v1 Announce Type: cross Abstract: Data selection is a key component of efficient instruction tuning for large language models, as recent work has shown that data quality often matters

Learning When to Jump for Off-road Navigation

arXiv:2602.00877v2 Announce Type: replace Abstract: Low speed does not always guarantee safety in off-road driving. For instance, crossing a ditch may be risky at a low speed due to the risk of gettin

safetyarxiv-cs-ro

LimeCross: Context-Conditioned Layered Image Editing with Structural Consistency

arXiv:2605.10319v1 Announce Type: new Abstract: Layered image assets are widely used in real-world creative workflows, enabling non-destructive iteration and flexible re-composition. Recent advances i

Local Ai

LLM-Guided Monte Carlo Tree Search over Knowledge Graphs: Composing Mechanistic Explanations for Drug-Disease Pairs

arXiv:2605.09542v1 Announce Type: new Abstract: Extracting multi-step explanations from knowledge graphs poses a combinatorial challenge requiring both heuristic guidance (as candidates proliferate wi

local-aiarxiv-cs-ai

Low-Cost Neural Radiance Fields

arXiv:2605.09312v1 Announce Type: new Abstract: Neural Radiance Fields (NeRF) achieve high-quality novel-view synthesis, but their long training times and reliance on dense input views limit accessibi

researcharxiv-cs-cv

Agents

Low-Cost Stereo Vision for Robust 3D Positioning of Thin Radiata Pine Branches in Autonomous Drone Pruning

arXiv:2605.08213v1 Announce Type: new Abstract: Manual pruning of radiata pine, a species of major economic importance to New Zealand forestry, is hazardous, labour-intensive, and increasingly constra

agentsarxiv-cs-cv

Local Ai

Mazocarta: A Seeded Procedural Deckbuilder for Instrumented Game Development

arXiv:2605.08319v1 Announce Type: cross Abstract: Mazocarta is a seeded procedural tactical deckbuilder implemented in Rust, compiled to WebAssembly for browser play, and executable natively for simul

local-aiarxiv-cs-ai

MC^2: Monte Carlo Correction for Fast Elliptic PDE Solving

arXiv:2605.09288v1 Announce Type: cross Abstract: Partial differential equation (PDE) solvers underpin scientific computing, but real-world deployment is bounded by compute. Classical Monte Carlo solv

Measuring What Matters: Benchmarking Generative, Multimodal, and Agentic AI in Healthcare

arXiv:2605.08445v1 Announce Type: new Abstract: AI models are increasingly deployed in live clinical environments where they must perform reliably across complex, high-stakes workflows that standard t

Hardware

mHC-SSM: Manifold-Constrained Hyper-Connections for State Space Language Models with Stream-Specialized Adapters

arXiv:2605.08300v1 Announce Type: cross Abstract: Manifold-Constrained Hyper-Connections (mHC) introduce a stability-motivated variant of multi stream residual mixing by constraining residual stream m

hardwarearxiv-cs-ai

Minimizing Worst-Case Weighted Latency for Multi-Robot Persistent Monitoring: Theory and RL-Based Solutions

model-releasesarxiv-cs-ro

arXiv:2605.09633v1 Announce Type: new Abstract: We study multi-robot persistent monitoring on weighted graphs, where node weights encode monitoring priorities and edge weights encode travel distances.

Mirror, Mirror on the Wall: Can VLM Agents Tell Who They Are at All?

arXiv:2605.08816v1 Announce Type: new Abstract: In the animal kingdom, mirror self-recognition is a canonical probe of higher-order cognition, emerging only in some species. We ask whether an analogou

MMVIAD: Multi-view Multi-task Video Understanding for Industrial Anomaly Detection

arXiv:2605.10833v1 Announce Type: cross Abstract: Industrial anomaly detection is critical for manufacturing quality control, yet existing datasets mainly focus on static images or sparse views, which

MonitoringBench: Semi-Automated Red-Teaming for Agent Monitoring

arXiv:2605.09684v1 Announce Type: cross Abstract: We introduce a red-teaming methodology that exposes harder-to-catch attacks for coding-agent monitors, suggesting that current practices may under-eli

Navigating LLM Valley: From AdamW to Memory-Efficient and Matrix-Based Optimizers

arXiv:2605.09176v1 Announce Type: cross Abstract: Training large language models requires optimization algorithms that are not only statistically effective, but also computationally and memory efficie

safetyarxiv-cs-ai

NeurIPS Should Require Reproducibility Standards for Frontier AI Safety Claims

arXiv:2605.08192v1 Announce Type: cross Abstract: Frontier AI safety claims - published assertions that a highly capable general-purpose model is below a threshold of concern, adequately mitigated, or

Tutorials

NICE FACT: Diagnosing and Calibrating VLMs in Quantitative Reasoning for Kinematic Physics

arXiv:2605.08452v1 Announce Type: new Abstract: The ability to derive precise spatial and physical insights is a cornerstone of vision-language models (VLMs), yet their poor performances in related sp

tutorialsarxiv-cs-cv

No Mean Feat: Simple, Strong Baselines for Context Compression

arXiv:2510.20797v2 Announce Type: replace-cross Abstract: Context compression reduces Transformer inference costs by replacing lengthy inputs with shorter pre-computed representations. It carries sign

researcharxiv-cs-ai

Omni-Persona: Systematic Benchmarking and Improving Omnimodal Personalization

arXiv:2605.09996v1 Announce Type: new Abstract: While multimodal large language models have advanced across text, image, and audio, personalization research has remained primarily vision-language, wit

OpenClaw-RL: Train Any Agent Simply by Talking

arXiv:2603.10165v2 Announce Type: replace-cross Abstract: Every agent interaction generates a next-state signal, namely the user reply, tool output, terminal or GUI state change that follows each acti

safetyarxiv-cs-ai

Hardware

Optimal Transport-Guided Adversarial Attacks on Graph Neural Network-Based Bot Detection

arXiv:2602.00318v2 Announce Type: replace-cross Abstract: The rise of bot accounts on social media poses significant risks to public discourse. To address this threat, modern bot detectors increasingl

hardwarearxiv-cs-ai

Perception Without Engagement: Dissecting the Causal Discovery Deficit in LMMs

arXiv:2605.09422v1 Announce Type: new Abstract: Although Large Multimodal Models (LMMs) have achieved strong performance on general video understanding, their susceptibility to textual prior shortcuts

safetyarxiv-cs-cl

Performance and Energy Trade-Off Analysis of Hierarchical Federated Learning for Plant Disease Classification

arXiv:2605.08121v1 Announce Type: cross Abstract: Early detection of plant diseases is critical for improving crop productivity, while it also facilitates the foundations of precision agriculture. Rec

researcharxiv-cs-lg

Personal Visual Context Learning in Large Multimodal Models

arXiv:2605.10936v1 Announce Type: new Abstract: As wearable devices like smart glasses integrate Large Multimodal Models (LMMs) into the continuous first-person visual streams of individual users, the

Pix2Fact: When Vision Is Not Enough -- Benchmarking Fine-Grained VQA with Web Verification on High-Resolution Real-World Scenes

arXiv:2602.00593v2 Announce Type: replace Abstract: Despite progress on general tasks, vision-language models (VLMs) still struggle with challenges that demand both fine-grained visual grounding and e

PlantMarkerBench: A Multi-Species Benchmark for Evidence-Grounded Plant Marker Reasoning

model-releasesarxiv-cs-cl

arXiv:2605.10032v1 Announce Type: new Abstract: Cell-type-specific marker genes are fundamental to plant biology, yet existing resources primarily rely on curated databases or high-throughput studies

PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?

arXiv:2605.08687v1 Announce Type: cross Abstract: Data preparation is a central and time-consuming stage in data analysis workflows. Traditionally, commercial tools have relied on graphical user inter

Primal-Dual Guided Decoding for Constrained Discrete Diffusion

arXiv:2605.09749v1 Announce Type: new Abstract: Discrete diffusion models generate structured sequences by progressively unmasking tokens, but enforcing global property constraints during generation r

safetyarxiv-cs-ai

Probing the Critical Point (CritPt) of AI Reasoning: a Frontier Physics Research Benchmark

arXiv:2509.26574v4 Announce Type: replace Abstract: While large language models (LLMs) with reasoning capabilities are progressing rapidly on high-school math competitions and coding, can they reason

Re^2Math: Benchmarking Theorem Retrieval in Research-Level Mathematics

arXiv:2605.09012v1 Announce Type: new Abstract: Large language models are increasingly capable at closed-world mathematical reasoning, but research assistance also requires source-grounded use of the

Recovering Physical Dynamics from Discrete Observations via Intrinsic Differential Consistency

arXiv:2605.08454v1 Announce Type: cross Abstract: Recovering continuous-time dynamics from discrete observations is difficult because local supervision (e.g., pointwise regression targets, derivative

ReplaySCM: A Benchmark for Executable Causal Mechanism Induction from Interventions

arXiv:2605.08197v1 Announce Type: cross Abstract: Most causal benchmarks for language models score local answers or graph structure. We introduce ReplaySCM, a 1,300 item benchmark for executable causa

RoboMemArena: A Comprehensive and Challenging Robotic Memory Benchmark

model-releasesarxiv-cs-ro

arXiv:2605.10921v1 Announce Type: new Abstract: Memory is a critical component of robotic intelligence, as robots must rely on past observations and actions to accomplish long-horizon tasks in partial

RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild

arXiv:2605.10357v1 Announce Type: cross Abstract: Multimodal misinformation increasingly leverages visual persuasion, where repurposed or manipulated images strengthen misleading text. We introduce ex

Applications

Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Model

arXiv:2311.03600v3 Announce Type: replace Abstract: Robots capable of learning from demonstration (LfD) must exhibit stability while executing learned motion skills. To be effective in the real world,

applicationsarxiv-cs-ro