Search: “evaluation”

Response-free item difficulty modelling for multiple-choice items with fine-tuned transformers: Component-wise representation and multi-task learning

arXiv:2605.16991v1 Announce Type: cross Abstract: Response-free item difficulty modelling promises to reduce reliance on response-based calibration but is intrinsically difficult on reading-comprehens

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Responsible Agentic AI Requires Explicit Provenance

DGX agent

arXiv:2605.17169v1 Announce Type: new Abstract: Agentic AI is rapidly proliferating across diverse real-world domains such as software engineering, yet public trust has not kept pace. The central reas

model-releasesarxiv-cs-ai

19 May 2026

Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review

arXiv:2605.17548v1 Announce Type: cross Abstract: Code review has evolved for decades, from informal peer checking to today's pull request (PR) workflows, yet it remains a largely manual, uneven, and

safetyarxiv-cs-ai

Rethinking Generative Image Pretraining: How Far Are We From Scaling Up Next-Pixel Prediction?

arXiv:2511.08704v2 Announce Type: replace Abstract: This paper investigates the scaling properties of autoregressive next-pixel prediction, a simple, end-to-end yet under-explored framework for unifie

researcharxiv-cs-cv

Reversa: A Reverse Documentation Engineering Framework for Converting Legacy Software into Operational Specifications for AI Agents

arXiv:2605.18684v1 Announce Type: cross Abstract: Legacy systems concentrate business rules, architectural decisions, and operational exceptions that often remain implicit in code, data, configuration

Applications

Revisiting Long-term Time Series Forecasting: An Investigation on Linear Mapping

arXiv:2305.10721v2 Announce Type: replace-cross Abstract: Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exi

applicationsarxiv-cs-ai

Applications

RHINO: Reconstructing Human Interactions with Novel Objects from Monocular Videos

arXiv:2605.17014v1 Announce Type: new Abstract: Reconstructing people, objects, and their interactions in 3D is a long-standing goal for intelligent systems. Often the input is RGB video from a moving

applicationsarxiv-cs-cv

Right Predictions, Misleading Explanations: On the Vulnerability of Vision-Language Model Explanations

arXiv:2605.16651v1 Announce Type: new Abstract: Explanation mechanisms are increasingly used to support transparency and trust in vision-language models (VLMs), particularly in settings where model de

safetyarxiv-cs-cv

Applications

Robust Player-Conditional Champion Ranking for League of Legends: Style Similarity, Mastery Priors, and Archetype-Constrained Discovery

arXiv:2605.18338v1 Announce Type: cross Abstract: Champion recommendation in multiplayer online battle arena games is usually framed informally as a problem of metagame strength, personal comfort, or

applicationsarxiv-cs-lg

Tutorials

Rover: Context-aware Conflict Resolution with LLM

arXiv:2605.17279v1 Announce Type: cross Abstract: Code merging is a significant challenge, particularly in large-scale projects. Existing solutions, including program analysis and machine learning, sh

tutorialsarxiv-cs-ai

ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Driving

arXiv:2508.13977v3 Announce Type: replace Abstract: Depth estimation is a fundamental component of spatial perception for autonomous driving and other unmanned systems operating in open urban environm

SaaSBench: Exploring the Boundaries of Coding Agents in Long-Horizon Enterprise SaaS Engineering

arXiv:2605.17526v1 Announce Type: cross Abstract: As autonomous coding agents become capable of handling increasingly long-horizon tasks, they have gradually demonstrated the potential to complete end

SADP: Subgoal-Aware Diffusion Policy for Explainable Robots Learned from Foundation Model Generated Demonstrations

arXiv:2605.16871v1 Announce Type: new Abstract: Explainable robots require not only successful task execution but also the ability to expose internal decision-making process in a user-friendly manner.

safetyarxiv-cs-ro

Scale-Invariant Neural Network Optimization: Norm Geometry and Heavy-Tailed Noise

arXiv:2605.18528v1 Announce Type: cross Abstract: A growing lesson from neural network optimization is that optimizer design should respect how the model is parametrized. Scale-invariant methods becom

SCARED-C: Corrected Camera Poses for Endoscopic Depth Estimation

arXiv:2605.16628v1 Announce Type: new Abstract: The SCARED dataset is a widely used benchmark for endoscopic depth estimation, offering ground-truth 3D reconstructions captured with a structured light

SE-GA: Memory-Augmented Self-Evolution for GUI Agents

model-releasesarxiv-cs-lg

arXiv:2605.16883v1 Announce Type: new Abstract: Autonomous Graphical User Interface (GUI) agents often struggle with multi-step tasks due to constrained context windows and static policies that fail t

See Silhouettes in Motion with Neuromorphic Vision

arXiv:2605.17984v1 Announce Type: cross Abstract: Quasi-bimodal objects, such as text, road signs, and barcodes, play a basic yet vital role in daily visual communication. By boiling these down to cle

researcharxiv-cs-cv

Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback

model-releasesarxiv-cs-cl

arXiv:2605.17448v1 Announce Type: cross Abstract: Computer-aided design (CAD) is the backbone of modern industrial design, yet learned CAD generators still fall short of real engineering pipelines: th

Self-Supervised Learning for Sparse Matrix Reordering

arXiv:2605.17403v1 Announce Type: new Abstract: Rearranging the rows or columns of a sparse matrix using an appropriate ordering can significantly reduce fill-ins, i.e., new nonzeros introduced during

Semantic Generative Tuning for Unified Multimodal Models

arXiv:2605.18714v1 Announce Type: cross Abstract: Unified multimodal models (UMMs) strive to consolidate visual understanding and visual generation within a single architecture. However, prevailing tr

Shallow Deep Learning Can Still Excel in Fine-Grained Few-Shot Learning

arXiv:2507.22041v2 Announce Type: replace Abstract: Deep learning has witnessed the extensive utilization across a wide spectrum of domains, including fine-grained few-shot learning (FGFSL) which heav

researcharxiv-cs-cv

Shift Detection and Adaptation for Network Intrusion Detection

arXiv:2508.15100v2 Announce Type: replace-cross Abstract: Distribution shift, a change in the statistical properties of data over time, poses a critical challenge for deep learning anomaly detection s

SIREM: Speech-Informed MRI Reconstruction with Learned Sampling

model-releasesarxiv-cs-cl

arXiv:2605.18221v1 Announce Type: cross Abstract: Real-time magnetic resonance imaging (rtMRI) of speech production enables non-invasive visualization of dynamic vocal-tract motion and is valuable for

Local Ai

Sketch Then Paint: Hierarchical Reinforcement Learning for Diffusion Multi-Modal Large Language Models

arXiv:2605.16842v1 Announce Type: new Abstract: Diffusion Multi-Modal Large Language Models (dMLLMs) are powerful for image generation, but optimizing them through reinforcement learning (RL) remains

local-aiarxiv-cs-ai

SkillJect: Effectively Automating Skill-Based Prompt Injection for Skill-Enabled Agents

arXiv:2602.14211v2 Announce Type: replace-cross Abstract: Agent skills are increasingly used to extend LLM agents with task-specific instructions, executable scripts, and auxiliary resources. While im

SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolution

arXiv:2605.18401v1 Announce Type: cross Abstract: Long-horizon LLM agents leave traces that could become reusable experience, but raw trajectories are noisy and hard to govern. We treat Agent Skills a

SkyNative: A Native Multimodal Framework for Remote Sensing Visual Evidence Reasoning

arXiv:2605.17949v1 Announce Type: new Abstract: Remote sensing vision-language models commonly rely on pretrained visual encoders to convert images into semantic features before language-model reasoni

SLEIGHT-Bench: A Benchmark of Evasion Attacks Against Agent Monitors

arXiv:2605.16626v1 Announce Type: cross Abstract: Since autonomous coding agents generate complex behaviors at high-volume, we may want to use other LLMs to monitor actions to reduce the risk from dan

SPATIOROUTE: Dynamic Prompt Routing for Zero-Shot Spatial Reasoning

arXiv:2605.18209v1 Announce Type: cross Abstract: Spatial question answering over egocentric video is a challenging task that requires Vision-Language Models (VLMs) to reason about 3D object positions

Spatiotemporal Robustness of Temporal Logic Tasks using Multi-Objective Reasoning

arXiv:2603.29868v2 Announce Type: replace Abstract: The reliability of autonomous systems depends on their robustness, i.e., their ability to meet their objectives under uncertainty. In this paper, we

SpecSem-Net: Integrating Spectral and Semantic Features for Robust AI-generated Video Detection

arXiv:2605.17311v1 Announce Type: new Abstract: The remarkable visual fidelity of recent commercial video generative models, such as Sora and Veo, renders robust AI-generated video detection increasin

Local Ai

Speech-Guided Multimodal Learning for Vocal Tract Segmentation in Real-Time MRI

arXiv:2605.18466v1 Announce Type: new Abstract: Segmenting vocal tract articulators in real-time MRI (rtMRI) is a challenging dynamic image segmentation problem characterized by low contrast, rapid mo

local-aiarxiv-cs-cv

Hardware

Spherical Harmonic Optimal Transport: Application to Climate Models Comparisons

arXiv:2605.18389v1 Announce Type: new Abstract: Optimal transport provides a powerful framework for comparing measures while respecting the geometry of their support, but comes with an expensive compu

hardwarearxiv-cs-lg

SSL4RL: Revisiting Self-supervised Learning as Intrinsic Reward for Visual-Language Reasoning

arXiv:2510.16416v4 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fai

safetyarxiv-cs-ai

STAG-CN: Spatio-Temporal Apiary Graph Convolutional Network for Disease Onset Prediction in Beehive Sensor Networks

arXiv:2603.14462v2 Announce Type: replace-cross Abstract: Honey bee colony losses threaten global pollination services, yet current monitoring systems treat each hive as an isolated unit, ignoring the

Statistical Limits and Efficient Algorithms for Differentially Private Federated Learning

arXiv:2605.18656v1 Announce Type: cross Abstract: Federated Learning is a leading framework for training ML and AI models collaboratively across numerous user devices or databases. We study the trade-

StatQAT: Statistical Quantizer Optimization for Deep Networks

arXiv:2605.17745v1 Announce Type: cross Abstract: Quantization is essential for reducing the computational cost and memory usage of deep neural networks, enabling efficient inference on low-precision

Strategic Over-Parameterization for Generalizable Low-Rank Adaptation

arXiv:2605.16470v1 Announce Type: cross Abstract: Adapting large language models (LLMs) to downstream tasks via full fine-tuning is increasingly impractical due to its computational and memory demands

Stretch-ICP: A Continuous-Trajectory Registration and Deskewing Algorithm in Scenarios of Aggressive Motions

arXiv:2605.17264v1 Announce Type: new Abstract: Robust robotic autonomy remains challenging in complex environments, where loss of stability on uneven or slippery terrain can induce extreme accelerati

researcharxiv-cs-ro

STRIDE: A Self-Reflective Agent Framework for Reliable Automatic Equation Discovery

arXiv:2605.17790v1 Announce Type: new Abstract: LLM-based equation discovery offers a promising route to recovering symbolic laws from data, but many systems still rely on generation-centered loops th

STT-Arena: A More Realistic Environment for Tool-Using with Spatio-Temporal Dynamics

arXiv:2605.18548v1 Announce Type: cross Abstract: Large language models (LLMs) deployed in real-world agentic applications must be capable of replanning and adapting when mid-task disruptions invalida

Supervising the search process produces reliable and generalizable information-seeking agents

arXiv:2502.13957v3 Announce Type: replace-cross Abstract: Large language models (LLMs) are transforming web search by shifting from document ranking to synthesizing answers, and are increasingly deplo

SuReNav: Superpixel Graph-based Constraint Relaxation for Navigation in Over-constrained Environments

arXiv:2602.06807v2 Announce Type: replace-cross Abstract: We address the over-constrained planning problem in semi-static environments. The planning objective is to find a best-effort solution that av

safetyarxiv-cs-ai

Tutorials

Surface-Form Neural Sparse Retrieval: Robust Fuzzy Matching for Industrial Music Search

arXiv:2605.17762v1 Announce Type: new Abstract: Music search at the scale of Amazon Music presents a unique challenge: queries frequently deviate from indexed metadata due to misspellings, transpositi

tutorialsarxiv-cs-ai

SurgLQA: Scalable Long-Horizon Surgical Video Question Answering

arXiv:2605.17915v1 Announce Type: new Abstract: Surgical Video Question Answering (VideoQA) provides a promising paradigm for dynamic intraoperative interpretation, enabling real-time decision support

Symphony for Speech-to-Text: Supporting Real-Time Medical Voice Interfaces

arXiv:2605.16545v1 Announce Type: cross Abstract: After decades of use in dictation and, more recently, ambient documentation, speech is emerging as a primary modality for interacting with technology

SynVA: A Modular Toolkit for Vessel Generation and Aneurysm Editing

arXiv:2605.17620v1 Announce Type: cross Abstract: Intracranial aneurysms (IAs), characterized by unpredictable growth and risk of rupture, are a major cause of stroke and can lead to life-threatening

Hardware

Systematic Optimization of Real-Time Diffusion Model Inference on Apple M3 Ultra

arXiv:2605.16259v1 Announce Type: cross Abstract: While real-time image generation using diffusion models has advanced rapidly on NVIDIA GPUs, systematic optimization research on non-CUDA platforms su

hardwarearxiv-cs-ai