Search: “evaluation”

MOLA LiDAR-Inertial Odometry (MOLA-LIO) on the COMFORT Localization Benchmark

arXiv:2609.25813v1 Announce Type: new Abstract: This short report documents our entry to the COMFORT Localization Benchmark (IROS 2026), evaluated on the GrandTour dataset recorded with the Boxi paylo

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

One Domain, Many Tongues: Composing Domain and Language LoRAs for Cross-Lingual Remote-Sensing MLLMs without Paired Data

DGX agent

arXiv:2609.26097v1 Announce Type: new Abstract: Remote-sensing (RS) multimodal large language models (MLLMs) are trained and evaluated only in English, while text-only instruction data covers over 100

researcharxiv-cs-cl

23 Sept 2026

PINNForge: Execution-Grounded Evolutionary Design of Physics-Informed Neural Networks for PDE Solving via Large Language Models

arXiv:2609.23023v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) require coordinated choices over network representation, sampling, loss construction, and optimization, while e

researcharxiv-cs-ai

Predictive Uncertainty for Neural CAE Surrogates

arXiv:2609.25430v1 Announce Type: new Abstract: Neural surrogates can substantially accelerate computer-aided engineering (CAE) workflows, but their use in design requires uncertainty estimates that r

researcharxiv-cs-lg

Same Quantity, Different Answer: Numerical Representation Invariance in Language Models

arXiv:2609.25009v1 Announce Type: new Abstract: Numerically equivalent word problems should yield the same canonical answer whether a quantity is written as a decimal, fraction, percentage, number wor

SelfOp: An Optimization Algorithm for Self-Improving Security Agents

model-releasesarxiv-cs-ai

arXiv:2609.22792v1 Announce Type: cross Abstract: LLM agents are increasingly used for security tasks: vulnerability discovery, exploit reproduction, and patch generation. Improving them at the model

Agents

Social Influence and the Allocation of Scientific Attention in AI Populations

arXiv:2609.22408v1 Announce Type: new Abstract: AI systems are becoming participants in the evaluation and use of scientific research. They encounter citation counts, download statistics and lists of

agentsarxiv-cs-ai

The Price of Safety: Benign-Case Utility and Token Overhead of Memory-Poisoning Defenses in LLM Agents

arXiv:2609.22818v1 Announce Type: cross Abstract: Memory-poisoning defenses for LLM agents are typically evaluated by their ability to prevent attacks. However, the traffic they process is rarely adve

safetyarxiv-cs-ai

Truth for Believable AI: Expressed Doubt, Provenance, and Belief Revision as an Engineerable Stance

arXiv:2609.26035v1 Announce Type: new Abstract: Conversational agents often express answers in a uniformly confident register. We test whether expressed uncertainty, provenance-aware assertion, and ex

You Should Be Properly Scoring Your Odometry

arXiv:2609.25900v1 Announce Type: new Abstract: When we evaluate the performance of our odometry, it is common practice to score the estimated track against a ground truth. Unfortunately, scoring uses

applicationsarxiv-cs-ro

A Hybrid Quantum Neural Network to Analyse Big Experimental Powder X-ray Diffraction Data

arXiv:2609.22376v1 Announce Type: cross Abstract: Quantitative analysis of experimental powder X-ray diffraction data remains challenging when evaluating complex multiphase materials and noisy measure

applicationsarxiv-cs-lg

A Patient World Model for Early Forecasting of Digital Health Campaign Outcomes: Capabilities and Limits

arXiv:2609.23333v1 Announce Type: new Abstract: Digital direct-to-consumer (DTC) health campaigns are usually measured after the fact. In-flight forecasting commonly relies on a separate classifier fo

researcharxiv-cs-lg

A Red-Team Study of Anthropic Fable 5 & Opus 4.8 Models

arXiv:2606.18193v2 Announce Type: replace-cross Abstract: We evaluate the adversarial robustness of three frontier large language models (LLMs) developed by Anthropic, Opus 4.8, Fable 5 and its succes

safetyarxiv-cs-cl

A Temporal Knowledge Graph for Music Festival Lineup Forecasting

arXiv:2609.24467v1 Announce Type: new Abstract: Music festival lineups emerge from complex relationships among artists, genres, releases, labels, and past performances, making the prediction of future

applicationsarxiv-cs-lg

ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulation

arXiv:2609.24124v1 Announce Type: new Abstract: Active perception and manipulation are crucial for robots to interact with complex scenes. Existing benchmarks struggle to evaluate how robots effective

AI-inferred expressed well-being and collective-action discourse in climate-change campaigns on X

arXiv:2609.22096v1 Announce Type: new Abstract: Climate campaigns are often evaluated through attention and mobilization, but less is known about the well-being language that accompanies them. Whether

researcharxiv-cs-cl

Anatomy of a Closed-Loop Collapse: A Causal Case Study of a Compressed VLA Policy

arXiv:2609.23048v1 Announce Type: cross Abstract: Compressed manipulation policies can pass offline evaluation while failing in closed-loop execution; this dissociation is established in prior work an

safetyarxiv-cs-lg

Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT

arXiv:2609.22291v1 Announce Type: new Abstract: This paper presents a comprehensive experimental evaluation and detailed analysis of state-of-the-art multi-object tracking algorithms, with an emphasis

researcharxiv-cs-cv

DFD-Lab: A Modular Audio-Visual Deepfake Detection Pipeline

arXiv:2609.23830v1 Announce Type: new Abstract: Comparing audio-visual deepfake detectors requires coordinating dataset adaptation, temporal input representation, model interfaces and experimental con

researcharxiv-cs-cv

ETH-TraceBench: A Large-Scale Event-Stream Benchmark for Ethereum DeFi under Temporal, Protocol, and Contract Shift

model-releasesarxiv-cs-lg

arXiv:2609.23659v1 Announce Type: new Abstract: Ethereum decentralized finance (DeFi) provides a public, time-stamped record of transaction-level event streams, but the same public symbols can create

Federated Multilingual Speech-LLMs: Architecture and Aggregation Strategy Benchmarking

arXiv:2609.23825v1 Announce Type: new Abstract: We present a comprehensive benchmark of Federated Learning (FL) for multilingual Automatic Speech Recognition (ASR), evaluating four Speech-LLM architec

Agents

FRAMES: Failure Recovery And Monitoring of Embodied Skills for Humanoid Loco-Manipulation

arXiv:2609.22538v1 Announce Type: new Abstract: Large language model (LLM) planners can decompose natural-language instructions and select reusable robot skills, but choosing the correct skill does no

agentsarxiv-cs-ro

Graph Learning for Cross-Subject, Cross-Population EEG Emotion Decoding and Model-Derived Spatial-Spectral Neural Signatures

arXiv:2609.22103v1 Announce Type: cross Abstract: Electroencephalography (EEG) provides a noninvasive means of capturing emotion-related neural dynamics, yet reliable EEG emotion decoding lacks models

researcharxiv-cs-lg

Infectious Bovine Pinkeye Detection Using Computer Vision and Imbalance-Aware Learning

arXiv:2609.23714v1 Announce Type: new Abstract: Infectious bovine pinkeye is a contagious ocular disease that adversely affects cattle health, welfare, and agricultural productivity. Conventional diag

researcharxiv-cs-cv

Large language models in medical time series analysis

arXiv:2609.22262v1 Announce Type: cross Abstract: Medical time series (MedTS), including electrocardiograms (ECG), electroencephalograms (EEG), photoplethysmography (PPG), and vital-sign recordings, a

applicationsarxiv-cs-lg

M3GA-Wild: A Large-Scale Dataset and Benchmark for Multi-Modal Multi-session Ground-to-Aerial Place Recognition in Forests

model-releasesarxiv-cs-cv

arXiv:2609.23003v1 Announce Type: new Abstract: We present M3GA-Wild, the first benchmark for multi-modal, multi-session ground-to-aerial place recognition in forests. M3GA-Wild unifies and extends ex

MIS-Bench: Benchmarking Multimodal LLMs for Psychotherapeutic Interpersonal Skills Assessment

arXiv:2609.22778v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are increasingly used as evaluators, yet their reliability in professional assessment tasks that require expert

Moonworks Lunara: Modeling Artistic Intelligence

model-releasesarxiv-cs-cv

arXiv:2609.22272v1 Announce Type: new Abstract: We formulate Artistic Intelligence as exploration driven world realization, leaving space for creative possibility while preserving the semantic, artist

ORDER: A Fictitious-World Benchmark for Domain-Adaptive Embodied AI

arXiv:2609.22285v1 Announce Type: new Abstract: Adapting language models to new domains via continual pre-training raises a basic evaluation problem: if the training corpus overlaps with what the mode

Local Ai

ORION-CMR: On-scanner Reporting with Integrated Foundation Model for End-to-End Cardiac MRI Analysis and Interpretation

arXiv:2609.23950v1 Announce Type: cross Abstract: Cardiovascular magnetic resonance (CMR) provides comprehensive cardiac assessment but remains underutilized because of the complexity of acquisition,

local-aiarxiv-cs-cv

Perplexity Cost Understates What Activation Quantisation Breaks

arXiv:2609.23125v1 Announce Type: new Abstract: Activation quantisation is usually evaluated with an aggregate metric, perplexity, averaged over every token a model predicts. We ask whether that avera

safetyarxiv-cs-lg

PII-TRACE: A Benchmark for Context-Aware PII Detection in Multi-Turn LLM Conversations

arXiv:2609.22200v1 Announce Type: new Abstract: LLM assistants and agentic systems log long multi-turn conversations. AI providers often scan these conversations for Personally Identifiable Informatio

Privacy Personalization Trade offs in LLMs: The Impact of Stylometric Signal Reduction on User-Specific Text Generation

arXiv:2609.22112v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated the ability to generate user-specific text with high stylistic fidelity. However, the personal data that

R-GEAN: Regimen-Guided Edit Action Network for Within-Admission Medication Change Prediction

model-releasesarxiv-cs-lg

arXiv:2609.22959v1 Announce Type: cross Abstract: The medications prescribed to a patient often change during a hospital admission as clinicians start, stop, or continue therapies. We study whether mo

Agents

SCRAMPPI: Contingency-Constrained Planning using Hamilton-Jacobi Reachability

arXiv:2603.26995v2 Announce Type: replace Abstract: Autonomous robots commonly aim to achieve a nominal objective while minimizing a cost. Without contingency preparation, this can leave them vulnerab

agentsarxiv-cs-ro

Semi-automated reconstruction of indoor geometry from 360-degree video for CFD-based airflow analysis in classrooms

model-releasesarxiv-cs-cv

arXiv:2609.23425v1 Announce Type: new Abstract: Computational Fluid Dynamics (CFD) is widely used to evaluate ventilation and contaminant transport in occupied buildings, but deployment at scale is li

Shared Execution-Clock Drifting Policy for Dynamic Precision Manipulation

arXiv:2609.23305v1 Announce Type: new Abstract: Manipulation under time constraints requires both accurate actions and an execution rhythm that matches the evolving scene. This becomes critical when a

safetyarxiv-cs-ro

SmallSatSim: A GPU-Accelerated Microgravity Robotics Toolkit for Planning, Control, and Policy Learning

arXiv:2603.14598v2 Announce Type: replace Abstract: Microgravity rendezvous and close proximity operations (RPO) is a growing area of interest for applications spanning in-space assembly and manufactu

safetyarxiv-cs-ro

The Evidence Ladder for Reinforcement Learning in Healthcare: From Retrospective Policies to Trusted Interventions

arXiv:2609.23374v1 Announce Type: new Abstract: Reinforcement learning (RL) offers a natural language for healthcare decisions whose conse- quences unfold over time, yet most reported progress remains

safetyarxiv-cs-lg

Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Tasks

arXiv:2609.23435v1 Announce Type: cross Abstract: Multi-omics sequences contain complex biological patterns, yet deciphering their mechanisms for automated scientific discovery remains challenging. As

Toward Human-in-the-Loop Robot Failure Recovery: Bridging Communication Gaps in Human-Robot Collaboration

arXiv:2609.24055v1 Announce Type: new Abstract: Robots can recover from failures by asking bystanders for help, but effective human-in-the-loop recovery requires communication that accounts for differ

Local Ai

Transferring Visual Explanations: How Cross-Architecture Knowledge Distillation Affects Model Interpretability

arXiv:2609.23561v1 Announce Type: new Abstract: Deploying efficient neural networks is essential in resource-constrained environments, yet compact models often sacrifice interpretability - a critical

local-aiarxiv-cs-cv

Used, Mentioned, or Condemned? A Controlled Contrast-Set Diagnostic for the Use-Mention Distinction in Code-Mixed Hinglish Misogyny Detection

arXiv:2609.22261v1 Announce Type: new Abstract: Lexicon-driven misogyny detectors cannot, by construction, distinguish a slur used against a woman from the same slur mentioned in counter-speech ('don'

Vox-Infinity: Benchmarking the Limits of Long-Context Spoken Language Models

arXiv:2609.22452v1 Announce Type: new Abstract: Long-context understanding remains a fundamental challenge for large language models, as excessively long inputs often lead models to forget salient inf

WPBench: A Comprehensive Benchmark for Wind Power Forecasting

model-releasesarxiv-cs-lg

arXiv:2609.24444v1 Announce Type: new Abstract: Accurate, reliable, and deployable wind power forecasting is critical for power system dispatch, renewable energy integration, and electricity market op

Local Ai

XSQ-AST: An Explainable Audio Spectrogram Transformer Framework for Localising Synthetic Speech Artifacts

arXiv:2609.24770v1 Announce Type: cross Abstract: Localising artifacts in synthetic speech remains challenging, as most evaluation methods yield only global quality scores. This paper presents XSQ-AST

local-aiarxiv-cs-lg

A Lie Detector Test for Language Models: Reading Knowledge a Model Won't Reveal

model-releasesarxiv-cs-ai

arXiv:2609.21996v1 Announce Type: new Abstract: Large language models can hold knowledge they do not report. A model may sandbag on a capability evaluation, or answer against what it internally knows,

21 Sept 2026

A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies