“Just-in-Time” OCR
The latest agent harnesses (e.g. Cowork, Codex, Grok) do 2 passes of ad-hoc document processing when executing over a user-uploaded ‘data room’ of documents:
1️⃣ A fast and light pass using a free/OSS doc parsing tool, can be cheaply run over 100+ docs
2️⃣ A “just-in-time” pass using a dedicated OCR tool (like LlamaParse) that does more accurate transcription over a subset of pages.
This pattern is common enough that I wanted to give it a name: “Just-in-Time OCR”. It works surprisingly well over a small to medium batch of docs (e.g. 10-100 docs); it is accurate at the expense of cost and latency. It’s not a substitute for large-scale offline indexing and retrieval.
The ‘default’ approach for any frontier agent harness is to use an OSS tool like pypdf for the first pass and its native VLM (e.g. Fable 5.1) as the second pass. This is both expensive and lacks accuracy and grounding.
If you’re a builder looking to implement this type of harness of a document data room, you can try out our suite of tools:
- Liteparse as the first pass (the best/fastest OSS text parser)
- LlamaParse as the second pass (most Pareto-efficient, includes grounding)
Check out the blog post below!