Model Releases

MolSight: Molecular Property Prediction with Images

arXiv:2605.10157v1 Announce Type: cross Abstract: Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has

DGX agentpaper
model-releasesarxiv-cs-cl

arXiv:2605.10157v1 Announce Type: cross Abstract: Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has received less focus in favour of molecular graphs, 3D conformers, or billion-parameter language models, each imposing its own computational and data-engineering overhead. We present extbf{MolSight}, the first systematic large-scale study of vision-based Molecular Property Prediction (MPP). Using 10 vision architectures, 7 pre-training strategies, and 2,M molecule images, we evaluate performance across 10 downstream tasks spanning physical-property regression, drug-discovery classification, and quantum-chemistry prediction. To account for the wide variation in structural complexity across pre-training molecules, we further propose a extbf{chemistry-informed curriculum}: five structural complexity descriptors partition the corpus into five tiers of increasing chemical difficulty, consistently outperforming non-curriculum baselines. We show that a single rendered bond-line image, processed by a vision encoder, is sufficient for competitive molecular property prediction, i.e. extit{chemical insight from sight alone}. The best curriculum-trained configuration achieves the top result on extbf{5 of 10} benchmarks and top two on extbf{all 10}, at extbf{extit{80imes lower}} FLOPs than the nearest multi-modal competitor.

Source: arXiv cs.CL | 2026-05-12

Loading related sources…