WSPolypNet: Weakly Supervised Polyp Localization in Colonoscopy Videos

arXiv:2609.08182v1 Announce Type: new Abstract: Because dense frame-level annotation of colonoscopy videos is costly, we propose WSPolypNet, a weakly supervised framework for polyp localization using only video-level labels. WSPolypNet employs a 3D convolutional neural network trained with video-level supervision to generate class activation maps (CAMs), which identify candidate polyp regions without requiring frame-level spatial annotations. The CAM-derived localization cues are further enhanced using a multi-view strategy and provided to MedSAM2 as point prompts. MedSAM2 then propagates segmentation masks across the video, refining the coarse localization cues according to polyp boundaries. WSPolypNet achieved CorLoc scores of 47.80%, 43.68%, and 35.01% at IoU thresholds of 0.3, 0.5, and 0.7, respectively, compared with 36.87%, 33.72%, and 27.94% in the single-view setting. For small polyps, the multi-view strategy improved CorLoc@0.5 from 16.01% to 30.97%. The framework also achieved a recall of 94.51%. These results demonstrate the potential of weakly supervised spatiotemporal learning to substantially reduce spatial annotation requirements for polyp localization in colonoscopy videos.

Related

• Do Instance Priors Help Weakly Supervised Semantic Segmentation?
• A Unified Variational Framework for Deep Weakly Supervised Image Segmentation
• Weakly Supervised Instance-Level Gleason Pattern Estimation Using Primary and Secondary Labels
• Event Detection in Videos: A Framework for the Development of New Methods
• Dual-Thresholded Heatmap-Guided Proposal Clustering and Negative Certainty Supervision with Enhanced Base Network for Weakly Supervised Object Detection

Source: arXiv cs.CV | 2026-09-09