We built state-of-the-art models for reading forms 📋 Form documents have the following properties that trip up VLMs: ✅ They carry much more…

We built state-of-the-art models for reading forms 📋 Form documents have the following properties that trip up VLMs: ✅ They carry much more structure than can be represented in standard markdown. You need consistent types for checkboxes, textboxes, labels, signature fields. ✅ They can be extremely complicated (forms can be scanned, there can handwriting scribbles, some forms are dense with ~100+ fields) but accuracy requirements need to be close to 100% ✅ Any form parser requires accurate grounding and attribution. Not only should you extract the values, but you should also be able to precisely locate where each value came from in the source doc ✅ Any form needs to be not only accurate, but cheap/fast We've done a deep-dive into what it takes to build a form parser in this blog post: https://www.llamaindex.ai/blog/why-vlms-can-t-read-forms If you want to try out our form models, check out LlamaParse: https://cloud.llamaindex.ai/ Media Parsing forms still trips up the latest frontier VLMs. A form isn't text on a page. It's a set of fields, grouped into sections, each tied to a specific box. That's why forms need purpose-built parsing, not a bigger general model: ✅️ Detect every field, not just the obvious ones …

Related

• Parsing forms still trips up the latest frontier VLMs. A form isn't text on a page. It's a set of fields, grouped into sections, each tied t…
• We've built a new feature in LlamaParse that lets you automatically extract any complex form into a structured JSON output 📋🤖 The best par…
• Most document OCR solutions have parse (doc->markdown) and extract (doc + schema -> structured output) endpoints. Sometimes you want to extr…

Source: Jerry Liu (X) | 2026-09-28