What Does Animal Re-Identification Learn? Linear Biological Concepts and Their Origins in Visual Representations

arXiv:2609.06020v1 Announce Type: new Abstract: Conservation increasingly relies on camera traps that collect more wildlife imagery than experts can manually analyze, making animal re-identification (Re-ID) essential for monitoring individuals and populations. Yet understanding which cues drive model decisions is challenging for ViT-based Re-ID models, whose metric-learning objectives provide no explicit supervision for biological concepts. We ask whether such models nonetheless organize their representations along biologically meaningful axes. Using a DINOv3 backbone fine-tuned for Western lowland gorilla Re-ID with triplet-margin loss, we find that sex and age emerge as linear directions that generalize to held-out individuals, reaching up to 0.91 AUROC and being recoverable from a single image per individual. Activation steering further shows that the sex direction is causally used by the model, flipping a significant fraction of predictions to the opposite sex. Comparing off-the-shelf and fine-tuned backbones shows that Re-ID training does not create these concepts, but relocates them across the network. Finally, data attribution reveals that the representation we find reflects a graded biological axis, is redundantly encoded across the population and shaped by visually ambiguous individuals. Together, these findings show how interpretability can uncover both the biological structure and failure modes of Re-ID representations, providing a step toward auditable computer vision for wildlife monitoring.

Related

• What, Where, and How: Probing Spatiotemporal Representations in Video Foundation Models
• Causal Clothes-Invariant Feature Learning for Cloth-Changing Person Re-ID
• Show Me Examples: Inferring Visual Concepts from Image Sets
• Oh Deer, How Should I Handle This? Seasonal Priors for Selective Wildlife Annotation and Classification

Source: arXiv cs.CV | 2026-09-09