Agents
The OSS models on OpenDocRouter are slowly powering up! 🚀 We trained additional speculative decoders to help with latency. You should see c…
The OSS models on OpenDocRouter are slowly powering up! 🚀 We trained additional speculative decoders to help with latency. You should see considerably faster inference times using models like @LightOn
The OSS models on OpenDocRouter are slowly powering up! 🚀 We trained additional speculative decoders to help with latency. You should see considerably faster inference times using models like @LightOnIO LightOnOCR-3-1B! We measured tokens per second across single requests (best case) and 64 requests (saturated throughput). TeleOCR sees less speedup at scale since it makes a lot of tiny calls, where decoding latency matters a bit less. Try these models out today! https://opendocrouter.ai
Related
- There are more document parsing models than ever, and they’re getting harder to tell apart. That’s why we built OpenDocRouter. Every model w…
- OpenDocRouter is basically OpenRouter for document OCR You can compare and use all your favorite OCR models under a single API / billing int…
- The difference with using VLMs for OCR vs. other tasks is that the ratio of output/input tokens is quite high - meaning the model can spend …
- Speculative Macro Commit for Faster Tool-Using Agents
Source: Jerry Liu (X) | 2026-10-19