Region Aware Squeeze-and-Excitation Networks for Image Segmentation

arXiv:2610.15079v1 Announce Type: new Abstract: Squeeze-and-Excitation (SE) modules improve convolutional networks by modeling channel-wise dependencies, but global average pooling collapses spatial structure into a single per-channel descriptor, limiting their effectiveness for dense prediction tasks such as image segmentation. We generalize SE by replacing global pooling with spatially guided pooling, enabling region-aware channel recalibration through four modules with complementary cost profiles. BASE formalizes Tiled Squeeze-and-Excite using a regular grid; SPASE pools over SLIC superpixels for image-adaptive regions; MAPSE obtains regions from semantic maps produced by a frozen, general-purpose network; and PLEASE learns soft region assignments end-to-end through a lightweight assignment network. Each channel receives one gate per region, so attention at each pixel reflects its region membership, bridging channel and spatial attention. PLEASE also produces its soft assignments as a byproduct of the forward pass, providing structured spatial interpretability without post-hoc analysis. The modules offer complementary computational tradeoffs: some add essentially no parameters, while others add no measurable latency. Across binary segmentation on CUB, DUTS, and ECSSD, semantic segmentation on PASCAL VOC 2012 and ADE20K, and classification on mini-ImageNet, our modules outperform SE and related spatial-channel attention variants on most benchmarks, achieving the majority of best results.

Related

• CARE: Anti-entanglement Ultrasound Image Segmentation via Channel-Aware Region Extrication
• CONSIGN: Conformal Segmentation Informed by Spatial Groupings via Decomposition
• RADA: Region-Aware Dual-encoder Auxiliary learning for Barely-supervised Medical Image Segmentation
• Efficient Search of Implantable Adaptive Cells for Medical Image Segmentation

Source: arXiv cs.CV | 2026-10-14