SelfDRSC++: Self-Supervised Dual Reversed Rolling Shutter Correction via Video Interpolation

arXiv:2408.11411v2 Announce Type: replace Abstract: Modern consumer cameras often use rolling shutter, capturing scenes row-by-row and causing distortion in dynamic scenes. Existing correction methods rely on supervised learning with high-frame-rate global shutter images as ground truth. We propose SelfDRSC++, a self-supervised framework for RS distortion correction {from simultaneously captured top-to-bottom and bottom-to-top RS images}. A lightweight network with a bidirectional correlation matching block jointly optimizes optical flows and corrected RS features, improving performance with fewer parameters. A self-supervised strategy enforces {a physically constrained RS--GS--RS cycle} between input and reconstructed dual reversed RS images. RS reconstruction is formulated as a specialized video frame interpolation task, enabling feasible one-stage training. Extensive experiments on synthetic and real-world data show that SelfDRSC++ achieves competitive quantitative performance, improves perceptual quality, and produces high-frame-rate GS sequences with better temporal consistency.

Related

• Enhanced Self-Supervised Multi-Image Super-Resolution for Camera Array Images
• SciFlow: Semantic Cross Interference for Self-Supervised Optical Flow Domain Generalization
• SelfHVD: Self-Supervised Handheld Video Deblurring

Source: arXiv cs.CV | 2026-08-14