Search: “evaluation”

Fin-PRM: A Domain-Specialized Process Reward Model for Financial Reasoning in Large Language Models

arXiv:2508.15202v2 Announce Type: replace Abstract: Process Reward Models (PRMs) supervise intermediate reasoning steps in large language models (LLMs), but existing PRMs are mainly trained on general

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

From Where Things Are to What They Are For: Benchmarking Spatial-Functional Intelligence in Multimodal LLMs

DGX agent

arXiv:2605.02130v1 Announce Type: new Abstract: Human-level agentic intelligence extends beyond low-level geometric perception, evolving from recognizing where things are to understanding what they ar

model-releasesarxiv-cs-cv

5 May 2026

How Reasoning Evolves from Post-Training Data: An Empirical Study Using Chess

arXiv:2604.05134v2 Announce Type: replace Abstract: We study how reasoning evolves in a language model -- from supervised fine-tuning (SFT) to reinforcement learning (RL) -- by analyzing how a set of

InfantAgent-Next: A Multimodal Generalist Agent for Automated Computer Interaction

model-releasesarxiv-cs-ai

arXiv:2505.10887v3 Announce Type: replace Abstract: This paper introduces extsc{InfantAgent-Next}, a generalist agent capable of interacting with computers in a multimodal manner, encompassing text, i

Is It Novel and Why? Fine-Grained Patent Novelty Prediction Based on Passage Retrieval

arXiv:2605.02392v1 Announce Type: new Abstract: Novelty assessment is a critical yet complex task in the examination process for patent acceptance, requiring examiners to determine whether an inventio

researcharxiv-cs-cl

LLM-Foraging: Large Language Models for Decentralized Swarm Robot Foraging

model-releasesarxiv-cs-ro

arXiv:2605.01461v1 Announce Type: new Abstract: Swarm foraging algorithms, such as the central-place foraging algorithm (CPFA), typically rely on offline parameter optimization using genetic algorithm

LUMINA: A Grid Foundation Model for Benchmarking AC Optimal Power Flow Surrogate Learning

arXiv:2605.02133v1 Announce Type: new Abstract: AC optimal power flow (ACOPF) is foundational yet computationally expensive in power grid operations, driving learning-based surrogates for large-scale

MedMosaic: A Challenging Large Scale Benchmark of Diverse Medical Audio

arXiv:2605.00969v1 Announce Type: cross Abstract: We present MedMosaic, a medical audio question-answering dataset designed to benchmark language and audio reasoning models under realistic clinical co

Multi-User Dueling Bandits: A Fair Approach using Nash Social Welfare

arXiv:2605.01961v1 Announce Type: new Abstract: Learning from human preference data is becoming a useful tool, from fine-tuning large language models to training reinforcement learning agents. However

safetyarxiv-cs-lg

Multispectral Blind Image Super-Resolution for Standing Dead Tree Segmentation

arXiv:2605.02471v1 Announce Type: new Abstract: Mapping standing dead trees is crucial for acquiring information on the effects of climate change on forests and forest biodiversity. However, leveragin

tutorialsarxiv-cs-cv

Hardware

Need for Speed: Zero-Shot Depth Completion with Single-Step Diffusion

arXiv:2603.10584v2 Announce Type: replace Abstract: We introduce Marigold-SSD, a single-step, late-fusion depth completion framework that leverages strong diffusion priors while eliminating the costly

hardwarearxiv-cs-cv

oMeBench: Towards Robust Benchmarking of LLMs in Organic Mechanism Elucidation and Reasoning

arXiv:2510.07731v3 Announce Type: replace-cross Abstract: Organic reaction mechanisms are the stepwise elementary reactions by which reactants form intermediates and products, and are fundamental to u

On the Characterization and Limits of 4D Radar for Aided Inertial Navigation

arXiv:2605.01773v1 Announce Type: new Abstract: Frequency Modulated Continuous Wave (FMCW) radar is a promising sensor for aided inertial navigation, due to its robustness in environments that challen

tutorialsarxiv-cs-ro

PhaseNet++: Phase-Aware Frequency-Domain Anomaly Detection for Industrial Control Systems via Phase Coherence Graphs

arXiv:2605.00929v1 Announce Type: new Abstract: Multivariate time series anomaly detection in ICS has attracted growing attention due to the increasing threat of cyber-physical attacks on critical inf

Protein-Conditioned Multi-Objective Reinforcement Learning for Full-Length mRNA Design

arXiv:2605.01513v1 Announce Type: new Abstract: Designing therapeutic messenger RNA (mRNA) requires creating full-length transcripts that carefully balance stability, translation efficiency, and immun

safetyarxiv-cs-lg

RamanBench: A Large-Scale Benchmark for Machine Learning on Raman Spectroscopy

arXiv:2605.02003v1 Announce Type: new Abstract: Machine Learning (ML) has transformed many scientific fields, yet key applications still lack standardized benchmarks. Raman spectroscopy, a widely used

Reliability-Oriented Multilingual Orthopedic Diagnosis: A Domain-Adaptive Modeling and a Conceptual Validation Framework

arXiv:2605.02266v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly proposed for clinical decision support including multilingual diagnosis in low-resource settings. However,

safetyarxiv-cs-cl

Rhamba: Region-Aware Hybrid Attention-Mamba Framework for Self-Supervised Learning in Resting-State fMRI

arXiv:2605.01240v1 Announce Type: new Abstract: Self-supervised pretraining is promising for large-scale neuroimaging, yet the impact of region-aware masking and hybrid sequence modeling remains under

researcharxiv-cs-lg

RMGAP: Benchmarking the Generalization of Reward Models across Diverse Preferences

arXiv:2605.01831v1 Announce Type: new Abstract: Reinforcement Learning from Human Feedback has become the standard paradigm for language model alignment, where reward models directly determine alignme

S^3-R1: Learning to Retrieve and Answer Step-by-Step with Synthetic Data

arXiv:2605.01248v1 Announce Type: new Abstract: Reinforcement learning (RL) post-training has enabled newer capabilities in models, such as agentic tool-use for search. However, these models struggle

agentsarxiv-cs-lg

SaLF: Sparse Local Fields for Multi-Sensor Rendering in Real-Time

arXiv:2507.18713v2 Announce Type: replace Abstract: High-fidelity sensor simulation of light-based sensors such as cameras and LiDARs is critical for safe and accurate autonomy testing. Neural radianc

researcharxiv-cs-cv

Selector-Guided Autonomous Curriculum for One-Shot Reinforcement Learning from Verifiable Rewards

arXiv:2605.01823v1 Announce Type: new Abstract: Recently, Reinforcement Learning from Verifiable Rewards (RLVR) has been established as a highly effective technique for augmenting the math reasoning s

Semia: Auditing Agent Skills via Constraint-Guided Representation Synthesis

arXiv:2605.00314v1 Announce Type: cross Abstract: An agent skill is a configuration package that equips an LLM-driven agent with a concrete capability, such as reading email, executing shell commands,

agentsarxiv-cs-ai

Sentra-Guard: A Real-Time Multilingual Defense Against Adversarial LLM Prompts

arXiv:2510.22628v2 Announce Type: replace-cross Abstract: This paper presents a real-time modular defense system named Sentra-Guard. The system detects and mitigates jailbreak and prompt injection att

safetyarxiv-cs-ai

Applications

ShapeGrasp: Simultaneous Visuo-Haptic Shape Completion and Grasping for Improved Robot Manipulation

arXiv:2605.02347v1 Announce Type: new Abstract: Humans grasp unfamiliar objects by combining an initial visual estimate with tactile and proprioceptive feedback during interaction. We present ShapeGra

applicationsarxiv-cs-ro

SignVerse-2M: A Two-Million-Clip Pose-Native Universe of 25+ Sign Languages

arXiv:2605.01720v1 Announce Type: cross Abstract: Existing large-scale sign language resources typically provide supervision only at the level of raw video-text alignment and are often produced in lab

safetyarxiv-cs-cl

Sound Source Localization for Spatial Mapping of Surgical Actions in Dynamic Scenes

arXiv:2510.24332v3 Announce Type: replace-cross Abstract: Purpose: Surgical scene understanding is key to advancing computer-aided and intelligent surgical systems. Current approaches predominantly re

agentsarxiv-cs-cv

Applications

Stochastic Modeling of Human-Machine Authentication Channels under Partial Information Leakage

arXiv:2605.02102v1 Announce Type: cross Abstract: Reliable and secure human-machine communication is fundamental to IoT and cyber-physical ecosystems, where smartphones and wearables commonly serve as

applicationsarxiv-cs-lg

StyleShield: Exposing the Fragility of AIGC Detectors through Continuous Controllable Style Transfer

arXiv:2605.00924v1 Announce Type: new Abstract: AI-generated content (AIGC) detectors are increasingly deployed in high-stakes settings such as academic integrity screening, yet their reliability rest

The 2026 ACII Dyadic Conversations (DaiKon) Workshop & Challenge

arXiv:2605.02672v1 Announce Type: cross Abstract: The 2026 ACII Dyadic Conversations (ACII-DaiKon) Workshop & Challenge introduces a benchmark for modeling interpersonal affect and social dynamics in

Local Ai

TIQA: Human-Aligned Perceptual Text Quality Assessment in Generated Images

arXiv:2603.07119v2 Announce Type: replace Abstract: Recent text-to-image models have improved global realism, but text rendering remains a persistent failure mode: images may look convincing overall,

local-aiarxiv-cs-cv

U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning

arXiv:2605.02765v1 Announce Type: cross Abstract: LLMs are increasingly used for end-user task planning, yet their black-box nature limits users' ability to ensure reliability and control. While recen

tutorialsarxiv-cs-lg

UCATSC: Uncertainty-Aware Constrained Traffic Signal Control Under Vision-Based Partial Observability

arXiv:2602.07784v3 Announce Type: replace Abstract: Camera-based adaptive traffic signal control is inherently partially observable: detections can be missed, vehicle speeds and distances can be noisy

safetyarxiv-cs-cv

Understanding the Performance Plateau in Text-to-Video Retrieval: A Comprehensive Empirical and Linguistic Analysis

model-releasesarxiv-cs-cv

arXiv:2605.00826v1 Announce Type: cross Abstract: Text-to-video retrieval enables users to find relevant video content using natural language queries, a task that has grown increasingly important with

Virtual Scanning for NSCLC Histology: Investigating the Discriminatory Power of Synthetic PET

arXiv:2605.02746v1 Announce Type: new Abstract: Accurate histological differentiation between adenocarcinoma (ADC) and squamous cell carcinoma (SCC) is critical for personalized treatment in non-small

researcharxiv-cs-cv

Virtual Speech Therapist: A Clinician-in-the-Loop AI Speech Therapy Agent for Personalized and Supervised Therapy

arXiv:2605.01101v1 Announce Type: cross Abstract: This paper develops Virtual Speech Therapist (VST), an intelligent agent-based platform that streamlines stuttering assessment and delivers customized

safetyarxiv-cs-cl

WildTableBench: Benchmarking Multimodal Foundation Models on Table Understanding In the Wild

model-releasesarxiv-cs-cv

arXiv:2605.01018v1 Announce Type: new Abstract: Using multimodal foundation models to analyze table images is a high-value yet challenging application in consumer and enterprise scenarios. Despite its

A Deep Learning-Based CCTV System for Automatic Smoking Detection in Fire Exit Zones

arXiv:2508.11696v3 Announce Type: replace Abstract: A deep learning real-time smoking detection system for CCTV surveillance of fire exit areas is proposed due to critical safety requirements. The dat

safetyarxiv-cs-cv

AgentFloor: How Far Up the tool use Ladder Can Small Open-Weight Models Go?

arXiv:2605.00334v1 Announce Type: cross Abstract: Production agentic systems make many model calls per user request, and most of those calls are short, structured, and routine. This raises a practical

Agentic AI for Substance Use Education: Integrating Regulatory and Scientific Knowledge Sources

arXiv:2605.00383v1 Announce Type: new Abstract: The delivery of traditional substance education has remained problematic due to challenges in scalability, personalization, and the currency of informat

agentsarxiv-cs-cl

Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integration

model-releasesarxiv-cs-cv

arXiv:2605.00310v1 Announce Type: new Abstract: Super-resolution (SR) techniques have made major advances in reconstructing high-resolution images from low-resolution inputs. The increased resolution

Budget Constraints as Riemannian Manifolds

arXiv:2605.00649v1 Announce Type: new Abstract: Assigning one of K options to each of N groups under a total cost budget is a recurring problem in machine learning, appearing in mixed-precision quanti

researcharxiv-cs-lg

Can Coding Agents Reproduce Findings in Computational Materials Science?

arXiv:2605.00803v1 Announce Type: cross Abstract: Large language models are increasingly deployed as autonomous coding agents and have achieved remarkably strong performance on software engineering be

Certain Head, Uncertain Tail: Expert-Sample for Test-Time Scaling in Fine-Grained MoE

arXiv:2602.02443v2 Announce Type: replace Abstract: Test-time scaling improves LLM performance by generating multiple candidate solutions, yet token-level sampling requires temperature tuning that tra

researcharxiv-cs-lg

CompleteRXN: Toward Completing Open Chemical Reaction Databases

arXiv:2605.00222v1 Announce Type: new Abstract: Chemical reaction datasets such as USPTO suffer from substantial incompleteness, frequently missing byproducts, co-reactants, and stoichiometric coeffic

Efficient Mutation Testing of Quantum Machine Learning Models

arXiv:2605.00107v1 Announce Type: cross Abstract: Quantum machine learning integrates the strengths of quantum computing and machine learning, enabling models to learn complex features using fewer par

tutorialsarxiv-cs-lg

FedACT: Concurrent Federated Intelligence across Heterogeneous Data Sources

arXiv:2605.00011v1 Announce Type: new Abstract: Federated Learning (FL) enables collaborative intelligence across decentralized data source devices in a privacy-preserving way. While substantial resea

Flow matching for Sentinel-2 super-resolution: implementation, application, and implications

arXiv:2605.00367v1 Announce Type: new Abstract: Developing robust techniques for super-resolution of satellite imagery involves navigating commonly observed trade-offs between spectral fidelity and pe

researcharxiv-cs-cv