Datapoint AI
@datapointai
#1# API For Human Preference Data // Evaluating Multimodal Models
0 Following 354 Followers
today, we're releasing the largest open-source human audio preferences dataset, focused on the customer support use-case
- 300K+ annotations by real people
- 15 SOTA TTS models ranked (Sonic 3.6, Grok TTS, Simba 3.2, Eleven Labs v3)
- 8 categories (IVR menus, empathy, escalations, refunds etc)
dataset + benchmark + frontier plot below:
Show more
today, we’re releasing the largest open-source human image preferences dataset, along with a $1 million data grant
- 2M+ annotations by real people
- 30 SOTA image models ranked
- 10 categories (marketing, product design, anime etc)
dataset + benchmark + grant details below:
Show more
Introducing HumanEvals: open source library for adding real human judgment to your multimodal model evals.
Send image, video, or audio outputs.
Get pairwise preferences, ratings, or rankings from real people in seconds.
Show more
