Search: “evaluation”

What Drives Hierarchy-Aware Image Retrieval? Taxonomy Alignment, Objective Choice, and Geometry

arXiv:2609.25638v1 Announce Type: new Abstract: Foundation vision models provide strong generic representations, yet high class-level retrieval accuracy does not necessarily imply that an embedding re

23 Sept 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning

DGX agent

arXiv:2603.02266v2 Announce Type: replace-cross Abstract: Test-Time Scaling has shown notable efficacy in addressing complex problems through scaling inference compute. However, within Large Audio-Lan

model-releasesarxiv-cs-ai

23 Sept 2026

Agents

When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems

arXiv:2609.23700v1 Announce Type: cross Abstract: Large language model agents are now privileged principals that take consequential actions: editing code repositories, operating inboxes, completing pu

agentsarxiv-cs-ai

23 Sept 2026

A discrete generative model of neuronal spiking activity on microelectrode arrays

arXiv:2609.23907v1 Announce Type: new Abstract: Generative models of neural activity could help characterize tissue dynamics, compare experimental conditions, and simulate population activity for appl

A paired synthetic construction-site image dataset for robust computer vision under adverse conditions

arXiv:2609.24075v1 Announce Type: new Abstract: Computer-vision systems used for construction monitoring can degrade under adverse environmental and visual conditions, yet such conditions remain under

Tutorials

Adapting Boltz-2 with limited experimental activity data improves early enrichment in virtual screening

arXiv:2609.24302v1 Announce Type: cross Abstract: Virtual screening aims to prioritize active compounds from large chemical libraries within a limited experimental budget. When applying Boltz-2 to vir

tutorialsarxiv-cs-lg

An Empirical Survey and Benchmark of Learned Distance Indexes for Road Networks

model-releasesarxiv-cs-lg

arXiv:2602.04068v2 Announce Type: replace Abstract: The calculation of shortest-path distances in road networks is a core operation in navigation systems, location-based services, and spatial analytic

An Evolutionary Agentic Approach for Open-ended Image Quality Perception

arXiv:2609.22942v1 Announce Type: new Abstract: Generative models are rapidly expanding image quality assessment (IQA) beyond traditional fidelity factors to emerging dimensions such as physical plaus

Analyzing Public Discourse on Urbanism: Topic Clustering, Sentiment Analysis and Retrieval-Augmented Generation using YouTube Comments

arXiv:2609.22705v1 Announce Type: new Abstract: Online discourse about urban issues - walkability, cycling infrastructure, public transit, housing density, and street safety - is voluminous but unstru

safetyarxiv-cs-cl

Anatomically Faithful Artifact Suppression in SENSE Accelerated Brain MRI

arXiv:2609.22390v1 Announce Type: cross Abstract: Background: Four-fold accelerated sensitivity encoding (SENSE4) can shorten brain MRI acquisition time but may amplify noise and result in residual al

researcharxiv-cs-cv

Apollo Restore: A Foundation LLM for Historical Greek Optimized for Fill-in-the-Middle Restoration of Ancient Greek Texts

arXiv:2609.22455v1 Announce Type: new Abstract: We present Apollo Restore, a 24-billion-parameter large language model for restoring lacunae---physical gaps---in fragmentary Ancient Greek texts. Fine-

Assessing Adversarial Robustness of Latent Reasoning Models

arXiv:2609.22228v1 Announce Type: new Abstract: Large language models increasingly rely on long chain-of-thought (CoT) trajectories for complex reasoning, but autoregressive generation brings substant

researcharxiv-cs-cl

BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents

arXiv:2609.23490v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly execute multi-step workflows through tool use and interaction with users and environments. However, curre

BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models

arXiv:2511.18921v2 Announce Type: replace Abstract: Backdoor attacks undermine the reliability and trustworthiness of machine learning systems by injecting hidden behaviors that can be maliciously act

BadWAM: When World-Action Models Dream Right but Act Wrong

arXiv:2607.15207v2 Announce Type: replace Abstract: World-action models (WAMs) are emerging as a promising foundation for embodied control: rather than predicting actions alone, they learn representat

safetyarxiv-cs-lg

Local Ai

BarrierFormer: Transformer-Guided Predictive Barrier Enforcement for Safe Robot Control

arXiv:2609.23896v1 Announce Type: new Abstract: Control barrier functions (CBFs) have become one of the most popular tools for encoding and enforcing state constraints in safety-critical robotics. Sta

local-aiarxiv-cs-ro

Applications

BayesianGS-SLAM: Uncertainty-Aware Neural Rendering SLAM via Probabilistic Formulation

arXiv:2609.24140v1 Announce Type: new Abstract: Neural-rendering-based SLAM relies on rendered RGB-D residuals for camera tracking and map optimization, but the reliability of these predictions can va

applicationsarxiv-cs-ro

Benchmarking Off-the-Shelf Multimodal AI Models Against Dermatologists on Patient-Captured Skin Images

arXiv:2609.24190v1 Announce Type: new Abstract: Artificial intelligence (AI) has advanced at a rapid pace in recent years. Initially, breakthroughs in large language models caught widespread attention

Beyond Average Error through Oracle-Informed Stress Tests for Time-Series Forecasting

model-releasesarxiv-cs-lg

arXiv:2609.22820v1 Announce Type: new Abstract: Average squared error cannot reveal whether forecasting performance degrades because the future becomes less predictable or because forecasts move farth

Tutorials

Beyond Visual Quality: A Study of Test-Time Planning with World Action Models

arXiv:2609.24745v1 Announce Type: new Abstract: World action models generate actions together with visual predictions of their consequences. These paired outputs create the potential for planning by s

tutorialsarxiv-cs-ro

BizSage: A Self-Evolving Multi-Agent Framework for Business Research with Efficient Knowledge Retrieval

arXiv:2609.22235v1 Announce Type: new Abstract: While multi-agent systems based on large language models (LLMs) have shown promise in automating the progressive workflow of academic research, extendin

BoundInk: Boundary-Aware Online Handwriting Generation

arXiv:2604.02103v3 Announce Type: replace Abstract: Realistic online handwriting depends not only on individual character shapes, but also on how a writer connects, spaces, and aligns adjacent charact

CALM: A Calibrated LLM Choice Network Framework for Activity-Based Traveler Simulation

arXiv:2609.22252v1 Announce Type: new Abstract: We present CALM, a reproducible hybrid framework that integrates an optional large language model (LLM) activity planner with calibrated stochastic choi

ChemCLIR-Bench: Benchmarking Cross-Lingual Information Retrieval in Multilingual Chemical Patents

arXiv:2609.23231v1 Announce Type: new Abstract: Cross-lingual information retrieval (CLIR) is increasingly important in multi-national industries, where critical technical evidence may exist in a diff

Clinical Domain Classification from Medical Transcriptions

arXiv:2609.22734v1 Announce Type: new Abstract: Clinical domain classification plays an important role in organizing and analyzing large volumes of unstructured medical text. However, medical transcri

researcharxiv-cs-cl

Comparative Analysis of State-of-the-Art Foundation Models for Sleep Analysis Under Channel Reduction

arXiv:2609.22105v1 Announce Type: cross Abstract: Automatic sleep staging from polysomnography (PSG) is a well-studied task, but PSG itself is expensive, clinic-based, and burdensome to manually score

Comparative Performance and Parameter-Efficient Adaptation of DINOv2 for Active Trachoma Classification

arXiv:2609.23832v1 Announce Type: new Abstract: Automated grading of conjunctival photographs could reduce the cost and variability of trachoma prevalence surveys, but the relative value of modern pre

Correct Diagnosis, Better Feedback: A Symbolic-Verifier for Faithful LLM Tutoring Feedback in Logic Proofs

arXiv:2609.22553v1 Announce Type: new Abstract: Effective LLM tutoring depends on correctly identifying the specific error in a student's reasoning before generating feedback. We study this problem in

researcharxiv-cs-cl

Cross-Dialect NER for Bangla Regional Dialects Using Leave-One-Dialect-Out Cross-Validation and Explainable AI

arXiv:2609.22536v1 Announce Type: new Abstract: Bangla, the seventh most spoken language in the world, exhibits significant regional dialectal diversity, with dialects such as Barishal, Chattogram, Sy

CytoCrowd: A Multi-Annotator Benchmark Dataset for Cytology Image Analysis

arXiv:2602.06674v2 Announce Type: replace Abstract: High-quality annotated datasets are crucial for advancing machine learning in medical image analysis. However, a critical gap exists: most datasets

D3DWA: Adaptive Weight and Prediction-Horizon for Dynamic Window Approach via Dueling Double Deep Q-Network

arXiv:2609.22276v1 Announce Type: new Abstract: The Dynamic Window Approach (DWA) is widely used for local navigation, but its performance depends strongly on parameters that are typically fixed befor

researcharxiv-cs-ro

DeViGrasp: Robust Visual Mobile Grasping for Quadruped Manipulators under Degraded Perception

model-releasesarxiv-cs-ro

arXiv:2609.22278v1 Announce Type: new Abstract: Quadruped manipulators enable mobile grasping in complex environments, yet their whole-body control policies remain vulnerable to unreliable onboard vis

DOA-SORT: Directional Occlusion-Aware Multi-Object Tracking with Distributional Observations

arXiv:2609.22706v1 Announce Type: new Abstract: Identity association in multi-object tracking (MOT) is vulnerable to partial occlusion, truncated detections, and fluctuating confidence scores. Existin

Agents

EditWM: Event-Decomposed World Modeling with Incremental Correction for End-to-End Autonomous Driving

arXiv:2609.22317v1 Announce Type: new Abstract: World models support autonomous driving by predicting the scene evolution associated with candidate trajectories. Driving dynamics differ in predictabil

agentsarxiv-cs-ro

Efficient LLM Distillation for Bangladesh Legal Context: A Smartphone-Compatible Retrieval-Augmented Generation Model

arXiv:2609.24177v1 Announce Type: new Abstract: Legal information in Bangladesh is inaccessible to most citizens. Statutory text is English-only, trained lawyers are concentrated in urban centres, and

Agents

EvalMem: An Operation-Level Diagnostic Framework for Long-Term Memory Systems

arXiv:2609.22231v1 Announce Type: new Abstract: Long-horizon interactions with LLM-based assistants require memory systems that preserve and update user states, preferences, and interaction histories.

agentsarxiv-cs-cl

FlockDiffusion: Assignment-Conditioned Diffusion for Multi-Drone Task Allocation and Completion

model-releasesarxiv-cs-ro

arXiv:2609.23745v1 Announce Type: new Abstract: Autonomous multi-drone navigation requires fleets to service distributed objectives in cluttered environments under tight computational budgets. Efficie

Tutorials

From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learning

arXiv:2609.24083v1 Announce Type: new Abstract: Generative AI enables scalable production of educational videos, but current systems largely focus on producing visually coherent content rather than su

tutorialsarxiv-cs-cl

From Latent Biomarkers to Clinical Rules: Embedding-Guided Rule Mining and Attribution-Based Translation for Interpretable Tabular Learning

arXiv:2609.22155v1 Announce Type: new Abstract: Clinical decision support tools are most useful when accurate predictions are accompanied by understandable explanations. Rule-based models provide tran

Graph-to-Grid (G2G): Continuous-Coordinate Feature Painting for Soccer Pass Surfaces

arXiv:2609.24040v1 Announce Type: cross Abstract: Dense pass surfaces give, for every pitch cell, whether a pass played there would arrive, whether the carrier would choose it, and what the possession

researcharxiv-cs-cv

GraphToolbox: A Configurable Python Framework for Graph Neural Network Forecasting

arXiv:2609.24609v1 Announce Type: new Abstract: Electricity forecasting often involves spatially related signals observed over regions, substations, and feeders, and Graph Neural Networks (GNNs) provi

H2LooP Telecom Model v1: From Telecom Comprehension to Autonomous Issue and PR Resolution

arXiv:2609.22241v1 Announce Type: new Abstract: We present H2LooP Telecom Model v1, a domain-specialized large language models fine-tuned for the telecommunications industry. We release two domain-ada

Hardware

HiLo-Token: Input-Adaptive High-Low Frequency Token Compression for Efficient Image Editing

arXiv:2606.13898v2 Announce Type: replace Abstract: Creative image editing tools, such as Photoshop's Remove or Generative Fill buttons, are central to everyday customer use and account for a major sh

hardwarearxiv-cs-cv

Human-Level Accuracy, Non-Human Strategies: Revealing Model-Human Divergence in Video Physical Reasoning

arXiv:2609.22788v1 Announce Type: new Abstract: Video foundation models now reach human-level accuracy on physical-reasoning benchmarks, yet such tasks require predicting unobserved physical outcomes.

Introducing DigitalOcean Managed Agents: One AI-native stack to power your intelligence

model-releasesdigitalocean

Following a successful private preview, we’re thrilled to open DigitalOcean Managed Agents to everyone. Teams can now deploy their preferred agent harness (like OpenCode, Codex CLI) or bring their own

Local Ai

Knowledge Graph-Augmented Ambient AI for Clinical Note Generation

arXiv:2609.22239v1 Announce Type: new Abstract: Ambient AI is increasingly adopted in healthcare to automatically generate clinical notes from patient-clinician conversations, with the potential to su

local-aiarxiv-cs-cl

LD-RSVIS: A Large-Scale and Diverse Benchmark for Referring Surgical Video Instrument Segmentation

arXiv:2609.23067v1 Announce Type: new Abstract: Referring surgical video instrument segmentation (RSVIS) aims at segmenting the instrument in a surgical video, given a textual description. Despite rec

Leakage-Safe Empirical Benchmarking of EEG-Based Machine Learning Pipelines for Dementia Classification

model-releasesarxiv-cs-lg

arXiv:2609.22092v1 Announce Type: cross Abstract: Electroencephalography (EEG) is a low-cost and non-invasive signal source for dementia screening, yet existing EEG-based studies remain difficult to c