Structuring Quantitative Image Analysis with Object Prominence

arXiv:2409.00216v2 Announce Type: replace Abstract: When photographers or media professionals compose an image, they make deliberate choices about what to foreground and what to background, shaping how viewers interpret visual content. Yet most quantitative approaches to image analysis overlook this structure and treat detected objects as equally important. We introduce a framework for measuring object prominence-- the relative salience of objects in an image-- as a means to make computational image analysis attentive to the compositional emphasis a curator has built into an image. Drawing on research in cognitive psychology and computer vision, we outline three approaches for estimating object prominence: size and centeredness, inferred depth, and saliency maps. Validating that curator-composed prominence measurably shifts human visual attention in a pre-registered eye-tracking study, we illustrate this framework's benefits in two further applications. First, we demonstrate how weighting features in line with their prominence can enhance the unsupervised ideological scaling of U.S. newspaper images. Second, we examine gendered visual prominence in U.S. presidential campaign ads from 2016 and 2020, showing that Republican candidates depict women less prominently than their Democratic counterparts. Our framework lets researchers analyze image data at scale while remaining attentive to its communicative structure and intent.

Related

• Enhancing Few-Shot Out-of-Distribution Detection via the Refinement of Foreground and Background
• What Happens to Accuracy When Photo Lineups Contain Non-Mated Rank-One Images From Large Galleries?
• A Smooth Phase-Separation Model for Weak-Boundary Segmentation of Homogeneous Structures

Source: arXiv cs.CV | 2026-07-31