adel 🌟(@adelwu_):what does "good" document processing even mean? benchmarking in this space can mean a lot of things: > accuracy on complex docs > latency > throughput for scale we're not here to tell you what set of documents is a "definitive benchmark", because your own docs are the ones that matter. the more important part is actually deciding how you measure performance. @archanaahlawat and @jannalulu_ have been working a lot on building and tuning our in-house judge framework, and turns out there's a couple of reoccurring patterns we see that might help you with your eval process:

adel 🌟

@adelwu_

growing @reductoai 👩‍💻 sf events curator & foodie 👩‍🎨 prev @meta @penn

加入 December 2021

2.1K 正在關注 5.3K 粉絲

adel 🌟@adelwu_

2026.10.05 20:32

what does "good" document processing even mean? benchmarking in this space can mean a lot of things: > accuracy on complex docs > latency > throughput for scale we're not here to tell you what set of documents is a "definitive benchmark", because your own docs are the ones that matter. the more important part is actually deciding how you measure performance. @archanaahlawat and @jannalulu_ have been working a lot on building and tuning our in-house judge framework, and turns out there's a couple of reoccurring patterns we see that might help you with your eval process: