Datapoint AI
@datapointai
#1# API for training & evaluating multimodal models.
Get 5K+ human preferences/min to enable online RL, refine model behaviour, and evaluate outputs.
0 Following 434 Followers
the full dataset is free and open:
overall and category-wise rankings of 9 robot policies are available on our robot bench:
Introducing Streams: online RL with live human feedback for multimodal models.
- images, audio & video
- 1B+ raters on tap
- real-time, continuous human preferences
Show more
today, we’re releasing the largest open-source human video preferences dataset, along with doubling our data grant to $2M
- 300K+ annotations by real people
- 15 SOTA video models ranked (Seedance 2.5, Omni 1.1, Wan 3, Flux Video 3 etc.)
- 8 categories (ads, camera movement, physics etc)
dataset + benchmark + frontier plot below:
Show more
today, we're releasing the largest open-source human audio preferences dataset, focused on the customer support use-case
- 300K+ annotations by real people
- 15 SOTA TTS models ranked (Sonic 3.6, Grok TTS, Simba 3.2, Eleven Labs v3)
- 8 categories (IVR menus, empathy, escalations, refunds etc)
dataset + benchmark + frontier plot below:
Show more
today, we’re releasing the largest open-source human image preferences dataset, along with a $1 million data grant
- 2M+ annotations by real people
- 30 SOTA image models ranked
- 10 categories (marketing, product design, anime etc)
dataset + benchmark + grant details below:
Show more
Introducing HumanEvals: open source library for adding real human judgment to your multimodal model evals.
Send image, video, or audio outputs.
Get pairwise preferences, ratings, or rankings from real people in seconds.
Show more
