Model-Agnostic Open-Set Air-to-Air Visual Object Detection for Reliable UAV Perception

arXiv:2509.09297v2 Announce Type: replace Abstract: Open-set detection is crucial for robust UAV autonomy in air-to-air object detection under real-world conditions. Traditional closed-set detectors degrade significantly under domain shifts and flight data corruption, posing risks to safety-critical applications. We propose a novel, model-agnostic open-set detection framework designed specifically for embedding-based detectors. The method explicitly handles unknown object rejection while maintaining robustness against corrupted flight data. It estimates semantic uncertainty via entropy modeling in the embedding space and incorporates spectral normalization and temperature scaling to enhance open-set discrimination. We validate our approach on the challenging AOT aerial benchmark and through extensive real-world flight tests. Comprehensive ablation studies demonstrate consistent improvements over baseline methods, achieving up to a 10% relative AUROC gain compared to standard YOLO-based detectors. Additionally, we show that background rejection further strengthens robustness without compromising detection accuracy, making our solution particularly well-suited for reliable UAV perception in dynamic air-to-air environments.

Related

• ODOV: Benchmark the Open-Domain Open-Vocabulary Object Detection
• Beyond Clear Skies: Synthetic Seasonal and Weather Variations for Real-World Drone Detection
• COVD: Continual Open-Vocabulary Object Detection with Novel Concept Injection

Source: arXiv cs.CV | 2026-08-27