Search: “evaluation”

arXiv:2609.26621v1 Announce Type: new Abstract: Greedy decoding from large language models is commonly treated as deterministic. We show it is not precision-invariant: the same model, prompt, and deco

hardwarearxiv-cs-lg

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

gwBenchmarks: Stress-Testing LLM Agents on High-Precision Gravitational Wave Astronomy

DGX agent

arXiv:2605.11269v2 Announce Type: replace-cross Abstract: Modern gravitational wave astronomy relies on modeling tasks that often require months of graduate-level effort, including building fast wavef

model-releasesarxiv-cs-ai

23 Sept 2026

JAMB: Joint Action-Motion Diffusion for Bimanual Manipulation

arXiv:2609.25322v1 Announce Type: new Abstract: Coordinated bimanual manipulation is challenging because the motion of either arm can alter the shared 3D scene and thereby affect the other arm. Yet mo

KwaiMind Technical Report

arXiv:2609.26375v1 Announce Type: new Abstract: Commercial image editing requires product identity preservation, accurate text rendering, and user appeal alongside general editing quality. We present

Latent Commonality Expectation-Maximisation for Box-supervised Tree Crown Instance Segmentation

arXiv:2609.26549v1 Announce Type: new Abstract: Individual tree crown segmentation from aerial imagery underpins tree-level carbon accounting, biodiversity, and restoration monitoring at landscape sca

Linear probing enables Ship-Radiated Noise recognition with pretrained audio embeddings

arXiv:2601.08358v2 Announce Type: replace Abstract: Even though the ocean covers the majority of the planet's surface, it remains the least explored ecosystem. As light and radio waves do not propagat

researcharxiv-cs-lg

MatcherCompass: A Deployment-Aware Benchmark to Guide Image Matcher Selection in the Wild

model-releasesarxiv-cs-ro

arXiv:2609.25688v1 Announce Type: new Abstract: Field robots operating across time of day and sensing modalities require accurate image correspondences within onboard time and resource budgets. Howeve

MATES: Learning Multi-Agent Interactions by Transforming Observations for Frozen Single-Agent Policies

arXiv:2609.26010v1 Announce Type: cross Abstract: Multi-agent reinforcement learning (MARL) commonly trains decentralized policies from scratch, requiring agents to acquire individual task competence

MicroPush: A Lightweight Simulator for Sim-to-Real Microrobotic Pushing and Assembly

arXiv:2602.23607v2 Announce Type: replace Abstract: Developing learning-based autonomy for microrobotic manipulation is difficult because physical trials are slow, variable, and poorly suited to large

Modular Norm RandOpt: Population-Efficient Ensembling through Architecture-Aware Perturbations

model-releasesarxiv-cs-lg

arXiv:2609.25745v1 Announce Type: new Abstract: RandOpt samples weight-perturbed language models and ensembles top-ranked candidates through plurality voting, but its global perturbation scale ignores

Applications

MultiViewDx: Evidence-Linked Multi-View Clinical Diagnosis

arXiv:2410.14948v2 Announce Type: replace Abstract: Medical multimodal large language models (MLLMs) can perform well on existing medical visual question answering (MedVQA) benchmarks, but their train

applicationsarxiv-cs-cl

OpenQlaw: An Agentic AI Assistant for Analysis of 2D Quantum Materials

arXiv:2603.17043v2 Announce Type: replace Abstract: Physics-aware multimodal large language models (MLLMs) can localize and characterize two-dimensional (2D) material flakes from optical microscopy im

local-aiarxiv-cs-cv

PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulation

arXiv:2609.22353v1 Announce Type: new Abstract: Mobile river monitoring robots must interpret obstacles and water boundaries that geographic waypoints alone cannot describe. On resource constrained pl

local-aiarxiv-cs-ai

PARTE: Plane-Assisted Robust Transformation Estimation for Point Cloud Registration

arXiv:2609.25375v1 Announce Type: new Abstract: Global point-cloud registration remains challenging when limited overlap, repetitive geometry, and sensor noise produce correspondence sets dominated by

researcharxiv-cs-ro

Peerify: Benchmarking Peer-Review Claim Verification

arXiv:2609.25046v1 Announce Type: new Abstract: Peer review plays a central role in scholarly publishing, yet verifying whether reviewer claims are supported by manuscript evidence remains a largely m

Reasoning Topology Matters: A Controlled Study of LLM-Based Cybersecurity Analysis

arXiv:2609.24710v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly used in cybersecurity, where accurate analysis often requires multi-step and context-dependent reasoning

Receptiveness, Not Sycophancy: Distinguishing Engagement from Deference in Language Models

arXiv:2609.26579v1 Announce Type: new Abstract: A central concern with language models is sycophancy: their tendency to defer to users' views at the expense of independent substantive judgment. In par

researcharxiv-cs-cl

RoofLang: Enabling AI-Driven Architecting of LLM Inference Systems

arXiv:2609.12551v2 Announce Type: replace-cross Abstract: AI is beginning to make substantive contributions to LLM inference optimization. Existing AI optimizations are predominantly profiling-based.

RouteRLT: Learning When and Which RL Specialist Should Control a Vision-Language-Action Policy

arXiv:2609.26467v1 Announce Type: new Abstract: Vision-language-action (VLA) models provide broad manipulation competence, but often struggle during the precision-critical stages that dominate contact

RULER: Instance-aware Rubric Rewards for SVG Generation

arXiv:2609.25270v1 Announce Type: new Abstract: Generating Scalable Vector Graphics (SVG) code from natural-language instructions is an open-ended task without absolute visual ground truth, leaving bo

Same Chart, Different Story: Bias in Vision-Language Chart Interpretation

arXiv:2609.26210v1 Announce Type: new Abstract: Vision-language models (VLMs) are increasingly used to interpret charts and generate natural-language explanations for socially consequential data. Howe

Agents

Small-world Networks of Agents Brainstorm AI Risks to Support Ideation

arXiv:2609.24859v1 Announce Type: cross Abstract: The ideation phase of participatory AI risk assessment often starts with a blank slate or a limited list of predefined risks, making it difficult to s

agentsarxiv-cs-ai

SpeakerMem-R1: Speaker-Centered Dual-Track Memory for Multi-Party Dialogue

arXiv:2609.26780v1 Announce Type: new Abstract: Long-term conversational memory in multi-party settings requires more than retrieving relevant content from long-term conversations: it must distinguish

local-aiarxiv-cs-cl

The Endless Exam: Mathematical Constructions from Today's Models toward Superintelligence

arXiv:2609.24555v1 Announce Type: new Abstract: We introduce the Endless Exam, a benchmark for measuring mathematical progress from today's models toward artificial superintelligence through fourteen

TimeLitmus: A Diagnostic Benchmark for Cross-Modal Understanding and Explanation Faithfulness in Event-Conditioned Time-Series Prediction

arXiv:2609.24677v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to make predictions from numerical time-series histories and textual events. Yet accuracy alone canno

Towards Hierarchical GNNs for multi-grid power flow: generalization across operating scenarios

arXiv:2609.26603v1 Announce Type: new Abstract: Hierarchical latent communication improves the generalization of a multi-grid power-flow model to new operating scenarios. The module exchanges informat

researcharxiv-cs-lg

Towards Systematic Qualification of Vision-Language Models for Automotive Perception Systems

arXiv:2609.25945v1 Announce Type: new Abstract: The field of Artificial Intelligence has been adopted for many application domains. Vision Language Models are one of the recently advanced AI technique

Trustworthy Agentic AI: Failure Modes, Mitigation Strategies, and a Lifecycle Framework for Autonomous LLM Systems

arXiv:2609.22712v1 Announce Type: new Abstract: Agentic AI systems built on large language models can plan over multiple steps, use external tools, retain information in memory, and coordinate with ot

safetyarxiv-cs-ai

TV-AudioRemover: Joint Text-Visual Guided Sound Removal with Multi-Task Hard-Mixture Curriculum

arXiv:2609.25864v1 Announce Type: cross Abstract: Visual object removal can eliminate a target from video frames, yet its acoustic trace persists in the soundtrack, causing obvious audio-visual incons

Applications

Ultra Strong Machine Learning: LLM-Generated Explanations Do Not Yet Suffice for Teaching Humans Active Learning Strategy

arXiv:2509.00961v3 Announce Type: replace-cross Abstract: Active learning is a general learning mechanism shared by artificial and human learners. Whether AI can teach humans such a strategy that tran

applicationsarxiv-cs-lg

Understanding Reliability in LLM-based Human Behavior Simulation

arXiv:2609.25066v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to simulate human survey responses and behavioral reactions, yet unreliable simulations can mislead s

safetyarxiv-cs-cl

Variable-Resolution Virtual Maps for Autonomous Exploration with Unmanned Surface Vehicles (USVs)

arXiv:2603.22667v2 Announce Type: replace Abstract: Autonomous exploration by unmanned surface vehicles (USVs) in near-shore waters requires reliable localisation and consistent mapping over extended

local-aiarxiv-cs-ro

VeriSoftBench: Repository-Scale Formal Verification Benchmarks for Lean

arXiv:2602.18307v2 Announce Type: replace-cross Abstract: Large language models have achieved striking results in interactive theorem proving, particularly in Lean. However, most benchmarks for LLM-ba

What Drives Hierarchy-Aware Image Retrieval? Taxonomy Alignment, Objective Choice, and Geometry

arXiv:2609.25638v1 Announce Type: new Abstract: Foundation vision models provide strong generic representations, yet high class-level retrieval accuracy does not necessarily imply that an embedding re

When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning

arXiv:2603.02266v2 Announce Type: replace-cross Abstract: Test-Time Scaling has shown notable efficacy in addressing complex problems through scaling inference compute. However, within Large Audio-Lan

Agents

When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems

arXiv:2609.23700v1 Announce Type: cross Abstract: Large language model agents are now privileged principals that take consequential actions: editing code repositories, operating inboxes, completing pu

agentsarxiv-cs-ai

A discrete generative model of neuronal spiking activity on microelectrode arrays

arXiv:2609.23907v1 Announce Type: new Abstract: Generative models of neural activity could help characterize tissue dynamics, compare experimental conditions, and simulate population activity for appl

researcharxiv-cs-lg

A paired synthetic construction-site image dataset for robust computer vision under adverse conditions

arXiv:2609.24075v1 Announce Type: new Abstract: Computer-vision systems used for construction monitoring can degrade under adverse environmental and visual conditions, yet such conditions remain under

Tutorials

Adapting Boltz-2 with limited experimental activity data improves early enrichment in virtual screening

arXiv:2609.24302v1 Announce Type: cross Abstract: Virtual screening aims to prioritize active compounds from large chemical libraries within a limited experimental budget. When applying Boltz-2 to vir

tutorialsarxiv-cs-lg

An Empirical Survey and Benchmark of Learned Distance Indexes for Road Networks

model-releasesarxiv-cs-lg

arXiv:2602.04068v2 Announce Type: replace Abstract: The calculation of shortest-path distances in road networks is a core operation in navigation systems, location-based services, and spatial analytic

An Evolutionary Agentic Approach for Open-ended Image Quality Perception

arXiv:2609.22942v1 Announce Type: new Abstract: Generative models are rapidly expanding image quality assessment (IQA) beyond traditional fidelity factors to emerging dimensions such as physical plaus

Analyzing Public Discourse on Urbanism: Topic Clustering, Sentiment Analysis and Retrieval-Augmented Generation using YouTube Comments

arXiv:2609.22705v1 Announce Type: new Abstract: Online discourse about urban issues - walkability, cycling infrastructure, public transit, housing density, and street safety - is voluminous but unstru

safetyarxiv-cs-cl

Anatomically Faithful Artifact Suppression in SENSE Accelerated Brain MRI

arXiv:2609.22390v1 Announce Type: cross Abstract: Background: Four-fold accelerated sensitivity encoding (SENSE4) can shorten brain MRI acquisition time but may amplify noise and result in residual al

researcharxiv-cs-cv

Apollo Restore: A Foundation LLM for Historical Greek Optimized for Fill-in-the-Middle Restoration of Ancient Greek Texts

arXiv:2609.22455v1 Announce Type: new Abstract: We present Apollo Restore, a 24-billion-parameter large language model for restoring lacunae---physical gaps---in fragmentary Ancient Greek texts. Fine-

Assessing Adversarial Robustness of Latent Reasoning Models

arXiv:2609.22228v1 Announce Type: new Abstract: Large language models increasingly rely on long chain-of-thought (CoT) trajectories for complex reasoning, but autoregressive generation brings substant

researcharxiv-cs-cl

BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents

arXiv:2609.23490v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly execute multi-step workflows through tool use and interaction with users and environments. However, curre

BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models

arXiv:2511.18921v2 Announce Type: replace Abstract: Backdoor attacks undermine the reliability and trustworthiness of machine learning systems by injecting hidden behaviors that can be maliciously act

BadWAM: When World-Action Models Dream Right but Act Wrong

arXiv:2607.15207v2 Announce Type: replace Abstract: World-action models (WAMs) are emerging as a promising foundation for embodied control: rather than predicting actions alone, they learn representat

safetyarxiv-cs-lg