Institutional Books - Visual Elements: An open-source pipeline for extracting, classifying, deduplicating, and captioning visual elements from digital book collections

arXiv:2608.18957v1 Announce Type: new Abstract: Historical book collections contain rich visual elements - such as illustrations, photographs, engravings, and decorative art - that are frequently under-explored in large-scale digitization projects. While Optical Character Recognition (OCR) has standardized the extraction of textual content, these visual components offer a layer of nuance and context that remains largely untapped by automated text extraction workflows. This technical report introduces Institutional Books - Visual Elements, an open-source end-to-end pipeline for detecting, classifying, deduplicating, and captioning visual elements from historical book collections. Alongside this pipeline, we release an initial dataset of 22.6 million visual elements extracted from the 983,004 scanned volumes that comprise the Institutional Books: Harvard Library dataset. This work contributes to ongoing, community-wide efforts to enable new use cases for digitized library collections through computational access, from artificial intelligence model training to digital humanities research.

Related

• The Dual Mechanisms of Spatial Variable Binding in Vision-Language Models
• Cost-Efficient Multi-Scale Fovea for Semantic-Based Visual Search Attention
• WikiCLIP: An Efficient Contrastive Baseline for Open-domain Visual Entity Recognition

Source: arXiv cs.CV | 2026-08-20