Search: “evaluation”

arXiv:2609.39955v1 Announce Type: new Abstract: Single-step retrosynthesis models are commonly evaluated by their ability to recover recorded reactions. In practice, chemists may need to choose among

tutorialsarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

DashVMC: Real-Time Discrete World Model Control in Geometry Dash

DGX agent

arXiv:2609.40003v1 Announce Type: new Abstract: World-model agents are usually evaluated in simulators that can wait for the policy; live games impose the opposite constraint, requiring capture, predi

safetyarxiv-cs-lg

1 Oct 2026

Diffusion-2BC: Hybrid Diffusion and Regression Training for Offline Behavior Cloning in Autonomous Driving

arXiv:2609.38472v1 Announce Type: cross Abstract: Behavior cloning provides an offline route to autonomous-driving policy learning, but mean-squared-error regression is poorly matched to demonstration

Do Self-Evolving Skills Generalize to Held-Out Tasks?

arXiv:2609.39148v1 Announce Type: new Abstract: AI agents can externalize what they learn from past tasks into reusable skills, such as procedures, checklists, code, or other executable artifacts, tha

agentsarxiv-cs-ai

Does This Action Still Explain the Task? Reverse Scoring for Diffusion Language Model Agents

arXiv:2609.38536v1 Announce Type: cross Abstract: Diffusion-based large language models (dLLMs) promise to break the sequential latency bottleneck of autoregressive agents through parallel decoding, b

agentsarxiv-cs-ai

EngramBench: A Capability-Grounded Benchmark for Skill-Evolution Harnesses

arXiv:2609.39284v1 Announce Type: cross Abstract: While large language models have achieved remarkable success in isolated code generation, authentic software engineering requires sustained reasoning,

From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning

arXiv:2609.39566v1 Announce Type: new Abstract: Foundation models can serve as clinical agents through tool-use harnesses. However, conventional medical benchmarks assess reasoning over preselected ev

Front-to-Back: Benchmarking Vision-Language Models for Asymmetric Cross-View Vehicle Re-Identification

arXiv:2609.39492v1 Announce Type: new Abstract: Matching the same vehicle across front and rear cameras is difficult because the cameras do not share a view and the vehicle's appearance changes substa

GateSPINE: Gated Cross-View Fusion for Lumbar Spine MRI Report Generation

arXiv:2609.40091v1 Announce Type: cross Abstract: Automated report generation can ease the burden radiolo gists face when interpreting multi-sequence MRI studies. Unlike CT, MRI examinations comprise

Safety

GLARE: Generating Listening Heads with Appropriate Reactions

arXiv:2609.40317v1 Announce Type: new Abstract: While talking head generation has advanced rapidly, generating natural listener behavior in dyadic conversations, which know when to react, how to react

safetyarxiv-cs-cv

GraphMAS: A Systematic Benchmark of Multi-Agent Coordination for Graph Learning

arXiv:2609.39777v1 Announce Type: new Abstract: LLM-based multi-agent systems coordinate specialized reasoning through aggregation, interaction, and adaptive control, yet their potential for graph lea

In a Streaming World, Should You Stand Still? A Comprehensive Benchmark of Anomaly Detection in Streams

arXiv:2609.39215v1 Announce Type: cross Abstract: Time series anomaly detection (TSAD) is increasingly deployed in streaming settings, where data arrive sequentially and may exhibit non-stationarity.

KilometerVision: A New Frontier for Large-Scale Spatial Intelligence in VLMs

arXiv:2609.39588v1 Announce Type: new Abstract: We push the frontier of large-scale spatial intelligence in Vision-Language Models (VLMs) and introduce the first benchmark that probes geographical lay

Learning from Research: Toward Lifelong Agent Harness Evolution

arXiv:2609.40169v1 Announce Type: new Abstract: Language agents are expected to solve increasingly complex tasks, creating a growing need for continual improvement. One promising approach is to evolve

Linguistic Loopholes in LLM Unlearning: From a 174-Language Benchmark to Coverage-Aware Unlearning

arXiv:2609.40286v1 Announce Type: cross Abstract: Unlearning a fact in one language does not guarantee its removal in others as changing the query or even the requested answer language can reopen seem

Listening to the Wise Few: Query-Key Alignment Unlocks Latent Correct Answers in Large Language Models

model-releasesarxiv-cs-cl

arXiv:2410.02343v2 Announce Type: replace Abstract: Large language models (LLMs) routinely fail to output the correct option in multiple-choice question answering (MCQA) while encoding the answer inte

LLM Persona Unlearning

model-releasesarxiv-cs-cl

arXiv:2609.39882v1 Announce Type: new Abstract: Pre-training equips large language models (LLMs) with a broad repertoire of behavioral patterns associated with roles, styles, values, and goals. Post-t

Make Code as Policy Great Again: Frontier Agents Write, Call, and Evolve Robot Tools

arXiv:2609.39018v1 Announce Type: cross Abstract: Frontier models can control robots, but reasoning through every reach, grasp, and retreat makes manipulation slow and token-intensive. We revisit code

Safety

More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models

arXiv:2609.38827v1 Announce Type: new Abstract: Direct-decision models turn text into low-latency structured labels and scores, making them attractive for classification and automatic evaluation. Yet

safetyarxiv-cs-ai

NavHarness: Adaptive Goals for Agentic Vision-Language Navigation

arXiv:2609.39915v1 Announce Type: new Abstract: Vision-Language Navigation (VLN) requires embodied agents to generate actions based on instructions and observations. General-purpose multimodal agents

local-aiarxiv-cs-cv

Network-based Spatial Context Retrieval for Open-weight LLMs: A Faithfulness Benchmark for Grounded Geographic Reasoning

arXiv:2609.39437v1 Announce Type: new Abstract: Large language models (LLMs) encode substantial latent geographic knowledge, yet they reason poorly over space and are unreliable when queried from coor

Occlusion-Aware, Quasi-Static, Stability-Oriented Trajectory Planning on Uneven Terrain

arXiv:2609.39105v1 Announce Type: new Abstract: Autonomous navigation in unstructured off-road environments requires reasoning about both vehicle--terrain interaction and environmental unknowns. We pr

agentsarxiv-cs-ro

On the Relaxation of Conditional Independence Assumption for Image Segmentation

arXiv:2609.38930v1 Announce Type: cross Abstract: In semantic segmentation, a recent line of RankSEG methods directly optimizes Dice/IoU scores at inference time, improving alignment with evaluation m

local-aiarxiv-cs-ai

Privacy in Personalized AI Is a System Property, Not Just a Model Property

arXiv:2609.38289v1 Announce Type: cross Abstract: In personalized AI applications, such as conversational assistants and recommender systems, users interact not with models in isolation but with broad

researcharxiv-cs-lg

Applications

Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction

arXiv:2609.39960v1 Announce Type: new Abstract: 4D scene reconstruction aims to recover the evolving geometry, appearance, and motion of dynamic environments from visual observations. Despite substant

applicationsarxiv-cs-cv

Applications

ReLaG: A Scalable Framework Generalizing Random Splits to Data with Latent Relations

arXiv:2609.38538v1 Announce Type: cross Abstract: Random splitting can yield non-independent train--test subsets when a dataset contains related samples, as is common in certain applications such as b

applicationsarxiv-cs-ai

Right Answers, Costly Models: The Efficiency Gap in LLM-based Optimization Modeling

arXiv:2609.38884v1 Announce Type: cross Abstract: Optimization modeling formulates real-world decision problems as mathematical programs that solvers can use to find optimal decisions. Large language

RoPE at the End of Its Rope? Theory, Diagnosis, and Mitigation of Long-Context Failures

model-releasesarxiv-cs-cl

arXiv:2609.39929v1 Announce Type: cross Abstract: Long-context failures of RoPE-based language models can arise from RoPE's intrinsic tradeoff between maintaining stable token preferences and distingu

STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction

arXiv:2609.40245v1 Announce Type: cross Abstract: Robot navigation in dynamic, human-centered environments requires socially-compliant decisions grounded in robust scene understanding. Recent Vision-L

StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometry

arXiv:2609.40244v1 Announce Type: new Abstract: Mobile robots and vehicles carry synchronized multi-camera rigs, yet many streaming 3D foundation models are designed for monocular input, leaving effic

Systematically Exploring the Capabilities of GPT-6 Astra as Embodied Policies

arXiv:2609.38537v1 Announce Type: new Abstract: GPT-6 Astra exhibits a remarkable ability to generate numerical robot actions, extending its role beyond high-level planning. To assess Astra's capabili

local-aiarxiv-cs-ro

TACTIC: Temporal and Context-Aware LLM Tactical Planning for Roadside LiDAR Attacks

arXiv:2609.39969v1 Announce Type: cross Abstract: Physical LiDAR attacks are often evaluated using fixed primitives and manually selected parameters, despite their strong dependence on surrounding tra

local-aiarxiv-cs-ai

The Nixtlaverse: An Open-Source Ecosystem for Forecasting

arXiv:2609.39741v1 Announce Type: new Abstract: Large forecasting applications often combine statistical, machine-learning, and neural models. These families solve the same problem but differ in fitte

Warm-starting PDE solvers with any-dimensional machine learning

arXiv:2609.38916v1 Announce Type: cross Abstract: Any-dimensional machine learning models, such as graph neural networks (GNNs), can be naturally trained and evaluated on inputs of different sizes and

researcharxiv-cs-lg

What Streaming Anomaly Detection Finds (and Misses) in Industrial Time Series

arXiv:2609.39232v1 Announce Type: cross Abstract: EDF relies on continuous monitoring of its power plants to detect anomalies as soon as they occur. Given the absence of a universally optimal streamin

When a Kindergartener Solves Calculus: Measuring Capability Leakage in Role-Prompted Reasoning Models

arXiv:2609.39846v1 Announce Type: cross Abstract: We investigate the problem of role-capability leakage (RCL), in which a role-prompted reasoning model generates convincing in-role text while continui

When Does Randomized Oversight Align AI Agents That Can Conceal?

arXiv:2609.38262v1 Announce Type: cross Abstract: Oversight changes the evidence it relies on. We ask when randomized audits and scoring align AI agents that can conceal misconduct and alter records.

agentsarxiv-cs-ai

X-Planner: Event-Structured Task Planning for Embodied Intelligence

arXiv:2609.25187v2 Announce Type: replace Abstract: Task planning bridges high-level instructions and executable behavior in long-horizon manipulation, yet modern Vision-Language-Action (VLA) systems

Zero2Repo: Can Coding Agents Build Repositories from Scratch?

arXiv:2609.38269v1 Announce Type: cross Abstract: Coding agents are increasingly asked to build software rather than patch it, yet benchmarks for from-scratch repository construction are mostly limite

A Benchmark & Dataset for Detecting AI-Manipulated Visual Evidence in the Court System

arXiv:2609.37783v1 Announce Type: cross Abstract: Photographic evidence is becoming increasingly vulnerable to forms of alteration and fabrication that existing legal and technical workflows are not w

A foundation model for energy and radiation systems built on heterogeneous scientific interfaces

arXiv:2609.38067v1 Announce Type: new Abstract: Scientific foundation models are commonly evaluated after heterogeneous physical problems have already been translated into a compatible gridded, tokeni

Safety

A Spectral Theory of Distortion in LLM Graph Reconstruction: Sharp Bounds and Empirical Characterization

arXiv:2609.38161v1 Announce Type: new Abstract: Evaluations of graph reconstruction by language models typically report a single aggregate distance between the original and the reconstructed graph. We

safetyarxiv-cs-lg

AerialDojo-200K: A Large-Scale Benchmark Suite for Open-World Aerial Object-Goal Search

arXiv:2609.36066v1 Announce Type: cross Abstract: Open-world aerial object-goal search is a foundational yet challenging task, requiring aerial agents to autonomously explore large-scale, unstructured

AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interaction

arXiv:2609.37853v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed as social agents, yet credible human-like interaction requires more than fluent responses or pers

agentsarxiv-cs-cl

ARK: A Dual-Axis Multimodal Retrieval Benchmark along Reasoning and Knowledge

arXiv:2602.09839v2 Announce Type: replace Abstract: Existing multimodal retrieval benchmarks largely emphasize semantic matching on daily-life images and offer limited diagnostics of professional know

AS^2D: Accelerating On-Demand Audio Understanding on Mobile Devices

arXiv:2609.37617v1 Announce Type: cross Abstract: Speculative decoding accelerates autoregressive generation by using a smaller drafter to propose tokens for batched verification by a larger target. H

b11282

model-releasesllama-cpp-releases

musa : define CUDA_ARCH for device passes (#29508) The MUSA vendor header never defined CUDA_ARCH, so every architecture test in the shared ggml-cuda sources evaluated to 0. Kernel bodies gated on the

Tutorials

Benchmarking graph-based models for in-silico toxicity prediction in drug discovery

arXiv:2609.37555v1 Announce Type: new Abstract: Drug discovery is a costly and high-risk process, where toxicity-related failures remain a major cause of attrition in both preclinical and clinical sta

tutorialsarxiv-cs-lg