Search: “evaluation”

A Patient World Model for Early Forecasting of Digital Health Campaign Outcomes: Capabilities and Limits

arXiv:2609.23333v1 Announce Type: new Abstract: Digital direct-to-consumer (DTC) health campaigns are usually measured after the fact. In-flight forecasting commonly relies on a separate classifier fo

researcharxiv-cs-lg

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

A Red-Team Study of Anthropic Fable 5 & Opus 4.8 Models

DGX agent

arXiv:2606.18193v2 Announce Type: replace-cross Abstract: We evaluate the adversarial robustness of three frontier large language models (LLMs) developed by Anthropic, Opus 4.8, Fable 5 and its succes

safetyarxiv-cs-cl

22 Sept 2026

Applications

A Temporal Knowledge Graph for Music Festival Lineup Forecasting

arXiv:2609.24467v1 Announce Type: new Abstract: Music festival lineups emerge from complex relationships among artists, genres, releases, labels, and past performances, making the prediction of future

applicationsarxiv-cs-lg

ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulation

model-releasesarxiv-cs-ro

arXiv:2609.24124v1 Announce Type: new Abstract: Active perception and manipulation are crucial for robots to interact with complex scenes. Existing benchmarks struggle to evaluate how robots effective

AI-inferred expressed well-being and collective-action discourse in climate-change campaigns on X

arXiv:2609.22096v1 Announce Type: new Abstract: Climate campaigns are often evaluated through attention and mobilization, but less is known about the well-being language that accompanies them. Whether

researcharxiv-cs-cl

Anatomy of a Closed-Loop Collapse: A Causal Case Study of a Compressed VLA Policy

arXiv:2609.23048v1 Announce Type: cross Abstract: Compressed manipulation policies can pass offline evaluation while failing in closed-loop execution; this dissociation is established in prior work an

Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT

arXiv:2609.22291v1 Announce Type: new Abstract: This paper presents a comprehensive experimental evaluation and detailed analysis of state-of-the-art multi-object tracking algorithms, with an emphasis

researcharxiv-cs-cv

DFD-Lab: A Modular Audio-Visual Deepfake Detection Pipeline

arXiv:2609.23830v1 Announce Type: new Abstract: Comparing audio-visual deepfake detectors requires coordinating dataset adaptation, temporal input representation, model interfaces and experimental con

researcharxiv-cs-cv

ETH-TraceBench: A Large-Scale Event-Stream Benchmark for Ethereum DeFi under Temporal, Protocol, and Contract Shift

model-releasesarxiv-cs-lg

arXiv:2609.23659v1 Announce Type: new Abstract: Ethereum decentralized finance (DeFi) provides a public, time-stamped record of transaction-level event streams, but the same public symbols can create

Federated Multilingual Speech-LLMs: Architecture and Aggregation Strategy Benchmarking

arXiv:2609.23825v1 Announce Type: new Abstract: We present a comprehensive benchmark of Federated Learning (FL) for multilingual Automatic Speech Recognition (ASR), evaluating four Speech-LLM architec

FRAMES: Failure Recovery And Monitoring of Embodied Skills for Humanoid Loco-Manipulation

arXiv:2609.22538v1 Announce Type: new Abstract: Large language model (LLM) planners can decompose natural-language instructions and select reusable robot skills, but choosing the correct skill does no

agentsarxiv-cs-ro

Graph Learning for Cross-Subject, Cross-Population EEG Emotion Decoding and Model-Derived Spatial-Spectral Neural Signatures

arXiv:2609.22103v1 Announce Type: cross Abstract: Electroencephalography (EEG) provides a noninvasive means of capturing emotion-related neural dynamics, yet reliable EEG emotion decoding lacks models

researcharxiv-cs-lg

Infectious Bovine Pinkeye Detection Using Computer Vision and Imbalance-Aware Learning

arXiv:2609.23714v1 Announce Type: new Abstract: Infectious bovine pinkeye is a contagious ocular disease that adversely affects cattle health, welfare, and agricultural productivity. Conventional diag

researcharxiv-cs-cv

Applications

Large language models in medical time series analysis

arXiv:2609.22262v1 Announce Type: cross Abstract: Medical time series (MedTS), including electrocardiograms (ECG), electroencephalograms (EEG), photoplethysmography (PPG), and vital-sign recordings, a

applicationsarxiv-cs-lg

M3GA-Wild: A Large-Scale Dataset and Benchmark for Multi-Modal Multi-session Ground-to-Aerial Place Recognition in Forests

model-releasesarxiv-cs-cv

arXiv:2609.23003v1 Announce Type: new Abstract: We present M3GA-Wild, the first benchmark for multi-modal, multi-session ground-to-aerial place recognition in forests. M3GA-Wild unifies and extends ex

MIS-Bench: Benchmarking Multimodal LLMs for Psychotherapeutic Interpersonal Skills Assessment

arXiv:2609.22778v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are increasingly used as evaluators, yet their reliability in professional assessment tasks that require expert

Moonworks Lunara: Modeling Artistic Intelligence

model-releasesarxiv-cs-cv

arXiv:2609.22272v1 Announce Type: new Abstract: We formulate Artistic Intelligence as exploration driven world realization, leaving space for creative possibility while preserving the semantic, artist

ORDER: A Fictitious-World Benchmark for Domain-Adaptive Embodied AI

model-releasesarxiv-cs-ro

arXiv:2609.22285v1 Announce Type: new Abstract: Adapting language models to new domains via continual pre-training raises a basic evaluation problem: if the training corpus overlaps with what the mode

Local Ai

ORION-CMR: On-scanner Reporting with Integrated Foundation Model for End-to-End Cardiac MRI Analysis and Interpretation

arXiv:2609.23950v1 Announce Type: cross Abstract: Cardiovascular magnetic resonance (CMR) provides comprehensive cardiac assessment but remains underutilized because of the complexity of acquisition,

local-aiarxiv-cs-cv

Perplexity Cost Understates What Activation Quantisation Breaks

arXiv:2609.23125v1 Announce Type: new Abstract: Activation quantisation is usually evaluated with an aggregate metric, perplexity, averaged over every token a model predicts. We ask whether that avera

PII-TRACE: A Benchmark for Context-Aware PII Detection in Multi-Turn LLM Conversations

arXiv:2609.22200v1 Announce Type: new Abstract: LLM assistants and agentic systems log long multi-turn conversations. AI providers often scan these conversations for Personally Identifiable Informatio

Privacy Personalization Trade offs in LLMs: The Impact of Stylometric Signal Reduction on User-Specific Text Generation

arXiv:2609.22112v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated the ability to generate user-specific text with high stylistic fidelity. However, the personal data that

R-GEAN: Regimen-Guided Edit Action Network for Within-Admission Medication Change Prediction

model-releasesarxiv-cs-lg

arXiv:2609.22959v1 Announce Type: cross Abstract: The medications prescribed to a patient often change during a hospital admission as clinicians start, stop, or continue therapies. We study whether mo

SCRAMPPI: Contingency-Constrained Planning using Hamilton-Jacobi Reachability

arXiv:2603.26995v2 Announce Type: replace Abstract: Autonomous robots commonly aim to achieve a nominal objective while minimizing a cost. Without contingency preparation, this can leave them vulnerab

agentsarxiv-cs-ro

Semi-automated reconstruction of indoor geometry from 360-degree video for CFD-based airflow analysis in classrooms

model-releasesarxiv-cs-cv

arXiv:2609.23425v1 Announce Type: new Abstract: Computational Fluid Dynamics (CFD) is widely used to evaluate ventilation and contaminant transport in occupied buildings, but deployment at scale is li

Shared Execution-Clock Drifting Policy for Dynamic Precision Manipulation

arXiv:2609.23305v1 Announce Type: new Abstract: Manipulation under time constraints requires both accurate actions and an execution rhythm that matches the evolving scene. This becomes critical when a

safetyarxiv-cs-ro

SmallSatSim: A GPU-Accelerated Microgravity Robotics Toolkit for Planning, Control, and Policy Learning

arXiv:2603.14598v2 Announce Type: replace Abstract: Microgravity rendezvous and close proximity operations (RPO) is a growing area of interest for applications spanning in-space assembly and manufactu

safetyarxiv-cs-ro

The Evidence Ladder for Reinforcement Learning in Healthcare: From Retrospective Policies to Trusted Interventions

arXiv:2609.23374v1 Announce Type: new Abstract: Reinforcement learning (RL) offers a natural language for healthcare decisions whose conse- quences unfold over time, yet most reported progress remains

Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Tasks

arXiv:2609.23435v1 Announce Type: cross Abstract: Multi-omics sequences contain complex biological patterns, yet deciphering their mechanisms for automated scientific discovery remains challenging. As

Toward Human-in-the-Loop Robot Failure Recovery: Bridging Communication Gaps in Human-Robot Collaboration

model-releasesarxiv-cs-ro

arXiv:2609.24055v1 Announce Type: new Abstract: Robots can recover from failures by asking bystanders for help, but effective human-in-the-loop recovery requires communication that accounts for differ

Local Ai

Transferring Visual Explanations: How Cross-Architecture Knowledge Distillation Affects Model Interpretability

arXiv:2609.23561v1 Announce Type: new Abstract: Deploying efficient neural networks is essential in resource-constrained environments, yet compact models often sacrifice interpretability - a critical

local-aiarxiv-cs-cv

Used, Mentioned, or Condemned? A Controlled Contrast-Set Diagnostic for the Use-Mention Distinction in Code-Mixed Hinglish Misogyny Detection

arXiv:2609.22261v1 Announce Type: new Abstract: Lexicon-driven misogyny detectors cannot, by construction, distinguish a slur used against a woman from the same slur mentioned in counter-speech ('don'

Vox-Infinity: Benchmarking the Limits of Long-Context Spoken Language Models

arXiv:2609.22452v1 Announce Type: new Abstract: Long-context understanding remains a fundamental challenge for large language models, as excessively long inputs often lead models to forget salient inf

WPBench: A Comprehensive Benchmark for Wind Power Forecasting

model-releasesarxiv-cs-lg

arXiv:2609.24444v1 Announce Type: new Abstract: Accurate, reliable, and deployable wind power forecasting is critical for power system dispatch, renewable energy integration, and electricity market op

Local Ai

XSQ-AST: An Explainable Audio Spectrogram Transformer Framework for Localising Synthetic Speech Artifacts

arXiv:2609.24770v1 Announce Type: cross Abstract: Localising artifacts in synthetic speech remains challenging, as most evaluation methods yield only global quality scores. This paper presents XSQ-AST

local-aiarxiv-cs-lg

A Lie Detector Test for Language Models: Reading Knowledge a Model Won't Reveal

arXiv:2609.21996v1 Announce Type: new Abstract: Large language models can hold knowledge they do not report. A model may sandbag on a capability evaluation, or answer against what it internally knows,

A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies

arXiv:2609.21817v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have become a prominent paradigm for mapping multimodal inputs, including semantic instructions, visual observations

safetyarxiv-cs-ro

AutoRecLab: Describe the Experiment, Get the Code!

arXiv:2609.21863v1 Announce Type: new Abstract: Empirical evaluation is central to recommender-systems (RecSys) research, but turning experimental designs into executable code remains a manual and err

CIBuzzBench: A Benchmark for Cross-Lingual Understanding of Chinese Internet Buzzwords

arXiv:2609.21722v1 Announce Type: cross Abstract: Chinese social media has generated a vast and continually evolving lexicon of internet buzzwords whose meanings are often non-literal and deeply roote

Complex Problem Solving in Large Language Models: A Statistical Control Survey and Diagnostic Framework

arXiv:2609.20973v1 Announce Type: cross Abstract: Complex problem solving (CPS) with large language models (LLMs) is often framed as a matter of stronger reasoning or longer generation. Yet early-step

Constraint Decay: The Fragility of LLM Agents in Backend Code Generation

arXiv:2605.06445v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) agents demonstrate strong performance in autonomous code generation under loose specifications. However, production

agentsarxiv-cs-ai

FairLMs: A Turnkey Library for Fairness in Language Models

arXiv:2609.21296v1 Announce Type: cross Abstract: Fairness research on language models involves measuring bias, applying mitigation methods, and examining the evidence on which an evaluation rests. Ex

Fewer Steps, Better Actions: Rethinking Flow-Matching Inference for VLA Policies

arXiv:2609.21216v1 Announce Type: cross Abstract: Vision-language-action (VLA) policies based on flow matching generate action chunks through repeated evaluations of an action expert. Increasing the n

safetyarxiv-cs-ai

From Discharge Notes to Patient Understanding: Persona-Grounded, Open-Ended Simulation of LLMs as Discharge Educators

arXiv:2609.20827v1 Announce Type: new Abstract: Hospital discharge education is an interactive teaching task: a clinician adapts a discharge plan to a patient's literacy, recall, and personality. Exis

agentsarxiv-cs-cl

LEGIT: Credentialing Protocol for Trustworthy AI Agent Marketplaces

arXiv:2609.21325v1 Announce Type: new Abstract: Agentic marketplaces are emerging where AI agents with varying capabilities autonomously complete specialized tasks for buyers. A major challenge of suc

mu^2-Bench: A Multilingual Machine Unlearning Benchmark

arXiv:2609.20945v1 Announce Type: new Abstract: Undesired information such as harmful content and private data propagates through Multilingual Large Language Models (LLMs) via direct training and indi

Offline Multimodal Large Language Models for Decision Support in Air Operations

arXiv:2609.21390v1 Announce Type: new Abstract: Air operations rely on complex rules, established procedures, and time-critical analysis under limited connectivity and strict security constraints. In

researcharxiv-cs-ai

Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interaction

arXiv:2609.21392v1 Announce Type: new Abstract: Natural audio-visual interaction is emerging as an important interface for AI assistants, allowing users to communicate through speech and vision rather