Search: “evaluation”

Trustworthy Agentic AI: Failure Modes, Mitigation Strategies, and a Lifecycle Framework for Autonomous LLM Systems

arXiv:2609.22712v1 Announce Type: new Abstract: Agentic AI systems built on large language models can plan over multiple steps, use external tools, retain information in memory, and coordinate with ot

safetyarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

TV-AudioRemover: Joint Text-Visual Guided Sound Removal with Multi-Task Hard-Mixture Curriculum

DGX agent

arXiv:2609.25864v1 Announce Type: cross Abstract: Visual object removal can eliminate a target from video frames, yet its acoustic trace persists in the soundtrack, causing obvious audio-visual incons

model-releasesarxiv-cs-cv

23 Sept 2026

Applications

Ultra Strong Machine Learning: LLM-Generated Explanations Do Not Yet Suffice for Teaching Humans Active Learning Strategy

arXiv:2509.00961v3 Announce Type: replace-cross Abstract: Active learning is a general learning mechanism shared by artificial and human learners. Whether AI can teach humans such a strategy that tran

applicationsarxiv-cs-lg

Understanding Reliability in LLM-based Human Behavior Simulation

arXiv:2609.25066v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to simulate human survey responses and behavioral reactions, yet unreliable simulations can mislead s

safetyarxiv-cs-cl

Local Ai

Variable-Resolution Virtual Maps for Autonomous Exploration with Unmanned Surface Vehicles (USVs)

arXiv:2603.22667v2 Announce Type: replace Abstract: Autonomous exploration by unmanned surface vehicles (USVs) in near-shore waters requires reliable localisation and consistent mapping over extended

local-aiarxiv-cs-ro

VeriSoftBench: Repository-Scale Formal Verification Benchmarks for Lean

arXiv:2602.18307v2 Announce Type: replace-cross Abstract: Large language models have achieved striking results in interactive theorem proving, particularly in Lean. However, most benchmarks for LLM-ba

What Drives Hierarchy-Aware Image Retrieval? Taxonomy Alignment, Objective Choice, and Geometry

arXiv:2609.25638v1 Announce Type: new Abstract: Foundation vision models provide strong generic representations, yet high class-level retrieval accuracy does not necessarily imply that an embedding re

When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning

model-releasesarxiv-cs-ai

arXiv:2603.02266v2 Announce Type: replace-cross Abstract: Test-Time Scaling has shown notable efficacy in addressing complex problems through scaling inference compute. However, within Large Audio-Lan

Agents

When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems

arXiv:2609.23700v1 Announce Type: cross Abstract: Large language model agents are now privileged principals that take consequential actions: editing code repositories, operating inboxes, completing pu

agentsarxiv-cs-ai

A discrete generative model of neuronal spiking activity on microelectrode arrays

arXiv:2609.23907v1 Announce Type: new Abstract: Generative models of neural activity could help characterize tissue dynamics, compare experimental conditions, and simulate population activity for appl

A paired synthetic construction-site image dataset for robust computer vision under adverse conditions

arXiv:2609.24075v1 Announce Type: new Abstract: Computer-vision systems used for construction monitoring can degrade under adverse environmental and visual conditions, yet such conditions remain under

Tutorials

Adapting Boltz-2 with limited experimental activity data improves early enrichment in virtual screening

arXiv:2609.24302v1 Announce Type: cross Abstract: Virtual screening aims to prioritize active compounds from large chemical libraries within a limited experimental budget. When applying Boltz-2 to vir

tutorialsarxiv-cs-lg

An Empirical Survey and Benchmark of Learned Distance Indexes for Road Networks

model-releasesarxiv-cs-lg

arXiv:2602.04068v2 Announce Type: replace Abstract: The calculation of shortest-path distances in road networks is a core operation in navigation systems, location-based services, and spatial analytic

An Evolutionary Agentic Approach for Open-ended Image Quality Perception

arXiv:2609.22942v1 Announce Type: new Abstract: Generative models are rapidly expanding image quality assessment (IQA) beyond traditional fidelity factors to emerging dimensions such as physical plaus

Analyzing Public Discourse on Urbanism: Topic Clustering, Sentiment Analysis and Retrieval-Augmented Generation using YouTube Comments

arXiv:2609.22705v1 Announce Type: new Abstract: Online discourse about urban issues - walkability, cycling infrastructure, public transit, housing density, and street safety - is voluminous but unstru

safetyarxiv-cs-cl

Anatomically Faithful Artifact Suppression in SENSE Accelerated Brain MRI

arXiv:2609.22390v1 Announce Type: cross Abstract: Background: Four-fold accelerated sensitivity encoding (SENSE4) can shorten brain MRI acquisition time but may amplify noise and result in residual al

researcharxiv-cs-cv

Apollo Restore: A Foundation LLM for Historical Greek Optimized for Fill-in-the-Middle Restoration of Ancient Greek Texts

arXiv:2609.22455v1 Announce Type: new Abstract: We present Apollo Restore, a 24-billion-parameter large language model for restoring lacunae---physical gaps---in fragmentary Ancient Greek texts. Fine-

Assessing Adversarial Robustness of Latent Reasoning Models

arXiv:2609.22228v1 Announce Type: new Abstract: Large language models increasingly rely on long chain-of-thought (CoT) trajectories for complex reasoning, but autoregressive generation brings substant

researcharxiv-cs-cl

BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents

arXiv:2609.23490v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly execute multi-step workflows through tool use and interaction with users and environments. However, curre

BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models

arXiv:2511.18921v2 Announce Type: replace Abstract: Backdoor attacks undermine the reliability and trustworthiness of machine learning systems by injecting hidden behaviors that can be maliciously act

BadWAM: When World-Action Models Dream Right but Act Wrong

arXiv:2607.15207v2 Announce Type: replace Abstract: World-action models (WAMs) are emerging as a promising foundation for embodied control: rather than predicting actions alone, they learn representat

safetyarxiv-cs-lg

Local Ai

BarrierFormer: Transformer-Guided Predictive Barrier Enforcement for Safe Robot Control

arXiv:2609.23896v1 Announce Type: new Abstract: Control barrier functions (CBFs) have become one of the most popular tools for encoding and enforcing state constraints in safety-critical robotics. Sta

local-aiarxiv-cs-ro

Applications

BayesianGS-SLAM: Uncertainty-Aware Neural Rendering SLAM via Probabilistic Formulation

arXiv:2609.24140v1 Announce Type: new Abstract: Neural-rendering-based SLAM relies on rendered RGB-D residuals for camera tracking and map optimization, but the reliability of these predictions can va

applicationsarxiv-cs-ro

Benchmarking Off-the-Shelf Multimodal AI Models Against Dermatologists on Patient-Captured Skin Images

arXiv:2609.24190v1 Announce Type: new Abstract: Artificial intelligence (AI) has advanced at a rapid pace in recent years. Initially, breakthroughs in large language models caught widespread attention

Beyond Average Error through Oracle-Informed Stress Tests for Time-Series Forecasting

model-releasesarxiv-cs-lg

arXiv:2609.22820v1 Announce Type: new Abstract: Average squared error cannot reveal whether forecasting performance degrades because the future becomes less predictable or because forecasts move farth

Tutorials

Beyond Visual Quality: A Study of Test-Time Planning with World Action Models

arXiv:2609.24745v1 Announce Type: new Abstract: World action models generate actions together with visual predictions of their consequences. These paired outputs create the potential for planning by s

tutorialsarxiv-cs-ro

BizSage: A Self-Evolving Multi-Agent Framework for Business Research with Efficient Knowledge Retrieval

arXiv:2609.22235v1 Announce Type: new Abstract: While multi-agent systems based on large language models (LLMs) have shown promise in automating the progressive workflow of academic research, extendin

BoundInk: Boundary-Aware Online Handwriting Generation

arXiv:2604.02103v3 Announce Type: replace Abstract: Realistic online handwriting depends not only on individual character shapes, but also on how a writer connects, spaces, and aligns adjacent charact

CALM: A Calibrated LLM Choice Network Framework for Activity-Based Traveler Simulation

arXiv:2609.22252v1 Announce Type: new Abstract: We present CALM, a reproducible hybrid framework that integrates an optional large language model (LLM) activity planner with calibrated stochastic choi

ChemCLIR-Bench: Benchmarking Cross-Lingual Information Retrieval in Multilingual Chemical Patents

arXiv:2609.23231v1 Announce Type: new Abstract: Cross-lingual information retrieval (CLIR) is increasingly important in multi-national industries, where critical technical evidence may exist in a diff

Clinical Domain Classification from Medical Transcriptions

arXiv:2609.22734v1 Announce Type: new Abstract: Clinical domain classification plays an important role in organizing and analyzing large volumes of unstructured medical text. However, medical transcri

researcharxiv-cs-cl

Comparative Analysis of State-of-the-Art Foundation Models for Sleep Analysis Under Channel Reduction

arXiv:2609.22105v1 Announce Type: cross Abstract: Automatic sleep staging from polysomnography (PSG) is a well-studied task, but PSG itself is expensive, clinic-based, and burdensome to manually score

Comparative Performance and Parameter-Efficient Adaptation of DINOv2 for Active Trachoma Classification

arXiv:2609.23832v1 Announce Type: new Abstract: Automated grading of conjunctival photographs could reduce the cost and variability of trachoma prevalence surveys, but the relative value of modern pre

Correct Diagnosis, Better Feedback: A Symbolic-Verifier for Faithful LLM Tutoring Feedback in Logic Proofs

arXiv:2609.22553v1 Announce Type: new Abstract: Effective LLM tutoring depends on correctly identifying the specific error in a student's reasoning before generating feedback. We study this problem in

researcharxiv-cs-cl

Cross-Dialect NER for Bangla Regional Dialects Using Leave-One-Dialect-Out Cross-Validation and Explainable AI

arXiv:2609.22536v1 Announce Type: new Abstract: Bangla, the seventh most spoken language in the world, exhibits significant regional dialectal diversity, with dialects such as Barishal, Chattogram, Sy

CytoCrowd: A Multi-Annotator Benchmark Dataset for Cytology Image Analysis

arXiv:2602.06674v2 Announce Type: replace Abstract: High-quality annotated datasets are crucial for advancing machine learning in medical image analysis. However, a critical gap exists: most datasets

D3DWA: Adaptive Weight and Prediction-Horizon for Dynamic Window Approach via Dueling Double Deep Q-Network

arXiv:2609.22276v1 Announce Type: new Abstract: The Dynamic Window Approach (DWA) is widely used for local navigation, but its performance depends strongly on parameters that are typically fixed befor

researcharxiv-cs-ro

DeViGrasp: Robust Visual Mobile Grasping for Quadruped Manipulators under Degraded Perception

model-releasesarxiv-cs-ro

arXiv:2609.22278v1 Announce Type: new Abstract: Quadruped manipulators enable mobile grasping in complex environments, yet their whole-body control policies remain vulnerable to unreliable onboard vis

DOA-SORT: Directional Occlusion-Aware Multi-Object Tracking with Distributional Observations

arXiv:2609.22706v1 Announce Type: new Abstract: Identity association in multi-object tracking (MOT) is vulnerable to partial occlusion, truncated detections, and fluctuating confidence scores. Existin

Agents

EditWM: Event-Decomposed World Modeling with Incremental Correction for End-to-End Autonomous Driving

arXiv:2609.22317v1 Announce Type: new Abstract: World models support autonomous driving by predicting the scene evolution associated with candidate trajectories. Driving dynamics differ in predictabil

agentsarxiv-cs-ro

Efficient LLM Distillation for Bangladesh Legal Context: A Smartphone-Compatible Retrieval-Augmented Generation Model

arXiv:2609.24177v1 Announce Type: new Abstract: Legal information in Bangladesh is inaccessible to most citizens. Statutory text is English-only, trained lawyers are concentrated in urban centres, and

Agents

EvalMem: An Operation-Level Diagnostic Framework for Long-Term Memory Systems

arXiv:2609.22231v1 Announce Type: new Abstract: Long-horizon interactions with LLM-based assistants require memory systems that preserve and update user states, preferences, and interaction histories.

agentsarxiv-cs-cl

FlockDiffusion: Assignment-Conditioned Diffusion for Multi-Drone Task Allocation and Completion

model-releasesarxiv-cs-ro

arXiv:2609.23745v1 Announce Type: new Abstract: Autonomous multi-drone navigation requires fleets to service distributed objectives in cluttered environments under tight computational budgets. Efficie

Tutorials

From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learning

arXiv:2609.24083v1 Announce Type: new Abstract: Generative AI enables scalable production of educational videos, but current systems largely focus on producing visually coherent content rather than su

tutorialsarxiv-cs-cl

From Latent Biomarkers to Clinical Rules: Embedding-Guided Rule Mining and Attribution-Based Translation for Interpretable Tabular Learning

arXiv:2609.22155v1 Announce Type: new Abstract: Clinical decision support tools are most useful when accurate predictions are accompanied by understandable explanations. Rule-based models provide tran

Graph-to-Grid (G2G): Continuous-Coordinate Feature Painting for Soccer Pass Surfaces

arXiv:2609.24040v1 Announce Type: cross Abstract: Dense pass surfaces give, for every pitch cell, whether a pass played there would arrive, whether the carrier would choose it, and what the possession

researcharxiv-cs-cv

GraphToolbox: A Configurable Python Framework for Graph Neural Network Forecasting

arXiv:2609.24609v1 Announce Type: new Abstract: Electricity forecasting often involves spatially related signals observed over regions, substations, and feeders, and Graph Neural Networks (GNNs) provi

H2LooP Telecom Model v1: From Telecom Comprehension to Autonomous Issue and PR Resolution

arXiv:2609.22241v1 Announce Type: new Abstract: We present H2LooP Telecom Model v1, a domain-specialized large language models fine-tuned for the telecommunications industry. We release two domain-ada