Baidu's MarathonDocBench evaluates the parsing of 100โ300-page Chinese and English documents, including cross-page text, tables, and document structure. ๐ค
๐ Hundred-page scale: 100 documents, approximately 18,000 pages, and 205,000 annotated layout elements.
๐ Structure across pages: Human-refined annotations cover bounding boxes, heading hierarchy, reading order, and cross-page text and table continuations.
๐งช Document-level evaluation: Reuses MPDocBench-Parse's eight metrics to assess text, tables, formulas, reading order, figures, and heading structure. Overall is their mean.
๐ A demanding test: Listed general-purpose VLMs score below 34 Overall under the published whole-document protocol, which counts failed requests as empty predictions. Input and output limits also affect results.
๐ Apache-2.0 License.