Search: “evaluation”

MobileExplorer: Accelerating On-Device Inference for Mobile GUI Agents via Online Exploration

arXiv:2605.26546v1 Announce Type: new Abstract: Mobile graphical user interface (GUI) agents enable AI models to autonomously operate smartphones on behalf of users. However, most existing systems foc

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Modernising Reinforcement Learning-Based Navigation for Embodied Semantic Scene Graph Generation

DGX agent

arXiv:2603.25415v2 Announce Type: replace Abstract: Semantic world models enable embodied agents to reason about objects, relations, and spatial context beyond purely geometric representations. In Org

safetyarxiv-cs-ai

27 May 2026

MolPIF: A Parameter Interpolation Flow Model for Molecule Generation

model-releasesarxiv-cs-lg

arXiv:2507.13762v4 Announce Type: replace Abstract: Motivation: Structure-based drug design (SBDD) has advanced with deep generative models, but bridging the gap between continuous atomic coordinates

MONA: Muon Optimizer with Nesterov Acceleration for Scalable Language Model Training

arXiv:2605.26842v1 Announce Type: cross Abstract: The Muon optimizer has recently offered a promising alternative to AdamW for large language model training, leveraging matrix orthogonalization to pro

local-aiarxiv-cs-cl

More Expressive Feedforward Layers: Part I. Token-Adaptive Mixing of Activations

arXiv:2605.26647v1 Announce Type: cross Abstract: Feedforward network (FFN) layers account for a large fraction of parameters and nonlinear expressivity in Transformer-based large language models (LLM

Hardware

Morphling: Fast, Fused, and Flexible GNN Training at Scale

arXiv:2512.01678v5 Announce Type: replace Abstract: Graph Neural Networks (GNNs) present a fundamental hardware challenge by fusing irregular, memory-bound graph traversals with regular, compute-inten

hardwarearxiv-cs-lg

Multi-Agent Causal Discovery Using Large Language Models

arXiv:2407.15073v4 Announce Type: replace Abstract: Causal discovery aims to identify causal relationships between variables and is a fundamental problem across the sciences. Traditional statistical c

Multi-Modal Building Inspection via Perceiver IO Fusion of Satellite and Street-Level Imagery

arXiv:2605.26381v1 Announce Type: new Abstract: We present a multi-modal classification framework that fuses satellite and street-level imagery through a Perceiver IO architecture operating on spatial

Hardware

Multi-Robot Box Transport over Different Surfaces with Decentralized Role-based Proportional Control

arXiv:2605.26430v1 Announce Type: new Abstract: Collaborative transport of objects via pushing by multiple robots has many applications, ranging from construction and warehouse environments to post di

hardwarearxiv-cs-ro

Negligible in Size, Significant in Effect: On Scale Vectors in Large Language Models

arXiv:2605.26895v1 Announce Type: cross Abstract: Normalization layers in modern large language models (LLMs) consist of a deterministic normalization operation and a learnable scale vector. While the

Agents

Neural Bayesian Sequential Routing

arXiv:2605.26147v1 Announce Type: new Abstract: Human decision-making is sequential and uncertainty-aware, yet standard neural networks often rely on static, dense forward computation with limited vis

agentsarxiv-cs-lg

Safety

Neuro-Symbolic Verification of LLM Outputs for Data-Sensitive Domains (extended preprint)

arXiv:2605.26942v1 Announce Type: new Abstract: LLMs deployed in high-stakes domains face fundamental reliability challenges: hallucinations, inconsistencies, and privacy vulnerabilities introduce una

safetyarxiv-cs-ai

Applications

No Data? No Problem: Robust Vision-Tabular Learning with Missing Values

arXiv:2512.19602v2 Announce Type: replace Abstract: Large-scale medical biobanks provide imaging data complemented by extensive tabular information, such as clinical measurements or demographics. Howe

applicationsarxiv-cs-cv

Normalizing Flows on Quotient Manifolds via Boundary Quotients

arXiv:2511.22882v3 Announce Type: replace Abstract: We introduce boundary quotients and present a framework for learning densities on manifolds that arise as boundary quotients of simpler domains. We

Not All Tokens Matter Equally: Dynamic In-context Vector Distillation with Decisive-Token Supervision for Long-form Medical Report Generation

arXiv:2605.27194v1 Announce Type: new Abstract: Distilling demonstration effects into hidden-space interventions offers a lightweight alternative to full finetuning. However, existing multimodal varia

researcharxiv-cs-cl

OMD-GraphRAG: Enhancing GraphRAG with Ontology-Guided Extraction, Multi-Dimensional Clustering and Dual-Channel Fusion

arXiv:2603.25152v3 Announce Type: replace Abstract: Retrieval-Augmented Generation (RAG) systems face significant challenges in complex reasoning, multi-hop queries, and domain-specific QA. While exis

On the Error-Correcting Effects of Stochasticity in Discrete Diffusion

arXiv:2605.26582v1 Announce Type: cross Abstract: Discrete diffusion models achieve strong performance in text and image generation, but their inference remains slow and must inherently balance sampli

On the Robustness of Machine Unlearning for Vision-Language Models

arXiv:2605.26992v1 Announce Type: new Abstract: Vision-language models (VLMs) may memorize undesirable information from training data, motivating growing interest in machine unlearning. In this work,

On the Sensitivity of Instruction-tuned LLMs to Harmful Sentences in Long Inputs

model-releasesarxiv-cs-cl

arXiv:2510.05864v2 Announce Type: replace Abstract: Large language models (LLMs) increasingly operate on long inputs, yet their behavior when harmful sentences are sparsely embedded within such inputs

Tutorials

ORCA: An End-to-End Interactive Copilot for Optimized Root Cause Analysis

arXiv:2605.27022v1 Announce Type: new Abstract: Causal analysis is a crucial task in many domains, including manufacturing, social science, and medicine. However, despite recent progress, the conceptu

tutorialsarxiv-cs-ai

OSMa-Bench++: Toward Open-Ended Benchmarking of Semantic Mapping for Manipulation with Prompt-Generated Synthetic Scenes

model-releasesarxiv-cs-cv

arXiv:2605.26831v1 Announce Type: new Abstract: Semantic mapping methods are increasingly used as intermediate scene representations for downstream robotic reasoning and manipulation, yet their evalua

Parsimonious Learning-Augmented Online Metric Matching

arXiv:2605.26886v1 Announce Type: cross Abstract: Learning-augmented algorithms have received significant attention in recent years, particularly in the context of online optimization. Motivated by th

PATE-TabTransGAN: Differentially Private Synthetic Tabular Data Generation via Transformer-Based Student Discrimination

arXiv:2605.26802v1 Announce Type: new Abstract: Generating high-fidelity synthetic tabular data under formal differential privacy guarantees remains an open challenge. Methods that provide strong theo

Tutorials

Personalized Generative Models for Contextual Debiasing

arXiv:2605.26353v1 Announce Type: cross Abstract: Different visual patterns appear with different frequencies in the world: e.g., beach balls appear on sand more often than they do on a road. These st

tutorialsarxiv-cs-ai

PIDM-DP: Physics-Informed Diffusion with Dormand-Prince Integration for Chaotic System Identification and State Reconstruction across Multiple Dynamical Regimes

model-releasesarxiv-cs-lg

arXiv:2605.26619v1 Announce Type: new Abstract: Reconstructing continuous state trajectories of chaotic dynamical systems from sparse, noisy observations remains a fundamental open problem in nonlinea

PLAID: A Unified Data Model for Machine Learning on Heterogeneous Physics Simulations

arXiv:2505.02974v3 Announce Type: replace Abstract: Machine learning-based surrogate models have emerged as a powerful tool to accelerate simulation-driven scientific workflows, but their adoption is

Plan Then Action:High-Level Planning Guidance Reinforcement Learning for LLM Reasoning

arXiv:2510.01833v2 Announce Type: replace Abstract: Large language models (LLMs) demonstrate strong reasoning abilities via Chain-of-Thought (CoT), but their token-level generation encourages local de

local-aiarxiv-cs-ai

Agents

PolyFusionAgent: A Multimodal Foundation Model and Autonomous AI Assistant for Polymer Property Prediction and Inverse Design

arXiv:2605.26543v1 Announce Type: new Abstract: Polymer discovery is central to fields ranging from energy storage to biomedicine, but it is hindered by an astronomically large chemical design space a

agentsarxiv-cs-ai

Position: AI Safety Requires Effective Controllability

arXiv:2605.27117v1 Announce Type: new Abstract: AI safety is still largely framed as alignment: training models to follow human preferences, safety policies, and normative constraints. That framing ha

Pretraining Data Exposure in Large Language Models: A Survey of Membership Inference, Data Contamination, and Security Implications

arXiv:2605.26133v1 Announce Type: cross Abstract: Large Language Models (LLMs) have become the predominant paradigm in NLP, advancing both research and industry. As model sizes and pretraining data gr

Probabilistic Recurrent Intention Switching Model

arXiv:2605.26998v1 Announce Type: new Abstract: Inverse reinforcement learning (IRL) recovers reward functions from observed behavior, yet traditional methods assume a single stationary reward that ca

Probing Minimalist Phase Structure in LLMs: What Universal Dependencies Cannot Represent

arXiv:2605.26431v1 Announce Type: new Abstract: Structural probes train on Universal Dependencies (UD), which does not encode formal-syntactic abstractions such as phase boundaries or phase-internal c

researcharxiv-cs-cl

Prototyping an End-to-End Multi-Modal Tiny-CNN for Cardiovascular Sensor Patches

arXiv:2510.18668v2 Announce Type: replace-cross Abstract: The vast majority of cardiovascular diseases may be preventable if early signs and risk factors are detected. Cardiovascular monitoring with b

local-aiarxiv-cs-cv

Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning

arXiv:2605.27318v1 Announce Type: new Abstract: Video spatial reasoning requires accumulating viewpoint-dependent evidence over time while retaining information useful to the question being asked. Exi

Hardware

Qrita: High-performance Top-k and Top-p using Pivot-based Truncation and Selection

arXiv:2602.01518v2 Announce Type: replace Abstract: Despite their importance in model sampling, efficient implementation of Top-k and Top-p algorithms for large vocabularies remains a significant chal

hardwarearxiv-cs-ai

Quality Without Usefulness: LLM-Generated XAI Narratives as Trust Heuristics Rather Than Decision Aids

arXiv:2605.26770v1 Announce Type: new Abstract: Prior work shows that Large Language Models (LLMs) can transform Explainable AI (XAI) outputs into Natural Language Explanations (NLEs) that score highl

researcharxiv-cs-cl

Safety

Quantized Keys Steal Attention: Bias Correction for KV-Cache Compression in Video Diffusion

arXiv:2605.26266v1 Announce Type: cross Abstract: Chunk-wise autoregressive video diffusion models rely on a KV cache of previously generated chunks to avoid redundant computation, but this cache quic

safetyarxiv-cs-ai

R^3: 3D Reconstruction via Relative Regression

arXiv:2605.26519v1 Announce Type: new Abstract: Recent feed-forward geometry foundation models have demonstrated impressive generalization by recovering depth and poses in a single forward pass. Howev

Ratio-Variance Regularized Policy Optimization

arXiv:2605.26784v1 Announce Type: cross Abstract: Standard on-policy reinforcement learning relies on heuristic clipping to enforce trust regions, but this mechanism imposes a severe cost by indiscrim

local-aiarxiv-cs-ai

RCSP: Risk-Sensitive Conjectural Scenario Planning for Safe Dynamic Robot Navigation

model-releasesarxiv-cs-ro

arXiv:2605.26348v1 Announce Type: new Abstract: Mobile robots can fail before they collide: a velocity that is safe now may commit the robot to a passage that moving obstacles will soon close. We stud

Reasoning, Code, or Both? How Large Language Models Handle Variations in Math Questions

arXiv:2605.26414v1 Announce Type: new Abstract: Large Language Models (LLMs) achieve impressive accuracy on mathematical reasoning benchmarks, yet their performance drops when problems are modified wi

ReCA: Multi-Shot Long Video Extrapolation via Recursive Context Allocation

arXiv:2605.26525v1 Announce Type: cross Abstract: Minute-scale cinematic video generation is a central challenge for generative video models. Existing paradigms address only fragments of this challeng

Reliable Extraction of Clinical Follow-Up Instructions: A Hybrid Neural-Symbolic Pipeline

arXiv:2605.26560v1 Announce Type: cross Abstract: Objective. Outpatient notes carry follow-up instructions pairing actions with future times ('MRI brain in two weeks'). Extracting (action, date) pairs

ReMoE: Boosting Expert Reuse through Router Fine-Tuning in Memory-Constrained MoE LLM Inference

arXiv:2605.27081v1 Announce Type: cross Abstract: Fine-grained Mixture-of-Experts (MoE) models sparsely activate only a subset of experts per token, reducing activated computation while maintaining hi

RepoMirage: Probing Repository Context Reasoning in Code Agents with Perturbations

arXiv:2605.26177v1 Announce Type: cross Abstract: Code agents are currently having skillful performance on repository-level software engineering benchmarks, but it remains unclear whether success on e

Rethinking the Multilingual Reasoning Gap with Layer Swap

model-releasesarxiv-cs-cl

arXiv:2605.26735v1 Announce Type: new Abstract: Recent reasoning Large Language Models produce a chain-of-thought (CoT) predominantly in English, even when prompted in non-English languages. Prior wor

Safety

Rethinking the Trust Region in LLM Reinforcement Learning

arXiv:2602.04879v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has become a cornerstone for fine-tuning Large Language Models (LLMs), with Proximal Policy Optimization (PPO) ser

safetyarxiv-cs-ai

RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion Generation

arXiv:2605.26241v1 Announce Type: new Abstract: Success in generative modeling across language, image, and video demonstrates that large, well-curated datasets are the key driver for building capable