VectorHarness: Recovering Editable, Relation-Preserving Structure from Scientific Graphics

arXiv:2609.13294v1 Announce Type: new Abstract: Converting scientific graphics into editable representations remains a challenging problem for image-to-code generation because of their heterogeneous elements and complex layouts. Recent multi-agent reconstruction systems have advanced this line of work, but often follow a copy-paste paradigm: the reconstructed image closely resembles the original, while complex regions remain effectively uneditable. We instead formulate a different objective, raster-to-authoring reconstruction, which aims to recover an authoring representation that supports native, customized editing rather than mere visual replication. To this end, we present VectorHarness, a multi-agent framework for raster-to-authoring reconstruction that recovers heterogeneous components using type-appropriate native representations. Text, formulas, shapes, connectors, icons, charts, and tables are reconstructed as natively editable objects, while intrinsically image-based regions remain raster content. To systematically evaluate reconstruction quality, we introduce VectorHarness-Bench, which jointly assesses rendering fidelity, raster fallback coverage, executable object edits, and relation-preserving edits. Experiments show that VectorHarness improves executable edit success and relation preservation, reduces avoidable raster fallback, and maintains high visual fidelity across heterogeneous graphics.

Related

• Thinking in Blender: Staged Executable Inverse Graphics with Vision-Language Models
• Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generation
• REChart: Reasoning-Efficient Chart Editing with Large Reasoning Models
• 3D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesis

Source: arXiv cs.CV | 2026-09-15