注册并分享邀请链接,可获得视频播放与邀请奖励。

ModelScope
@ModelScope2022
Driving innovations with open communities. 💬 Join our Discord:
加入 April 2024
198 正在关注    16.8K 粉丝
Baidu's MarathonDocBench evaluates the parsing of 100–300-page Chinese and English documents, including cross-page text, tables, and document structure. 🤖 📚 Hundred-page scale: 100 documents, approximately 18,000 pages, and 205,000 annotated layout elements. 🔗 Structure across pages: Human-refined annotations cover bounding boxes, heading hierarchy, reading order, and cross-page text and table continuations. 🧪 Document-level evaluation: Reuses MPDocBench-Parse's eight metrics to assess text, tables, formulas, reading order, figures, and heading structure. Overall is their mean. 📊 A demanding test: Listed general-purpose VLMs score below 34 Overall under the published whole-document protocol, which counts failed requests as empty predictions. Input and output limits also affect results. 📜 Apache-2.0 License.
显示更多