Modality-Agnostic Prompt Learning for Multi-Modal Camouflaged Object Detection

arXiv:2604.12380v1 Announce Type: new Abstract: Camouflaged Object Detection (COD) aims to segment objects that blend seamlessly into complex backgrounds, with growing interest in exploiting additional visual modalities to enhance robustness through complementary information. However, most existing approaches generally rely on modality-specific architectures or customized fusion strategies, which limit scalability and cross-modal generalization. To address this, we propose a novel framework that generates modality-agnostic multi-modal prompts for the Segment Anything Model (SAM), enabling parameter-efficient adaptation to arbitrary auxiliary modalities and significantly improving overall performance on COD tasks. Specifically, we model multi-modal learning through interactions between a data-driven content domain and a knowledge-driven prompt domain, distilling task-relevant cues into unified prompts for SAM decoding. We further introduce a lightweight Mask Refine Module to calibrate coarse predictions by incorporating fine-grained prompt cues, leading to more accurate camouflaged object boundaries. Extensive experiments on RGB-Depth, RGB-Thermal, and RGB-Polarization benchmarks validate the effectiveness and generalization of our modality-agnostic framework.

Related

• CATP: Confidence-Aware Token Pruning for Camouflaged Object Detection
• When W4A4 Breaks Camouflaged Object Detection: Token-Group Dual-Constraint Activation Quantization
• Exploring Boundary-Aware Spatial-Frequency Fusion for Camouflaged Object Detection
• CAMotion: A High-Quality Benchmark for Camouflaged Moving Object Detection in the Wild
• YUV20K: A Complexity-Driven Benchmark and Trajectory-Aware Alignment Model for Video Camouflaged Object Detection

Source: arXiv cs.CV | 2026-04-15