Today we're sharing the Notion Knowledge Board.
We get to observe a wide range of real-world AI tasks at @NotionHQ: meeting follow-ups, support tickets, sales pipeline updates, market research, all the good stuff. Knowledge board is a live, ongoing eval of how models handle real knowledge work measured on live anonymized traffic and scored by an ensemble judge we built in collaboration with researchers at Anthropic and OpenAI.
The takeaway is the tradeoffs: cost per task variance is high, and some of the fastest models are also very capable. The right model genuinely depends on your work.
We will update as new models ship:
顯示更多
