d1-omni-600M, now running on Apple silicon with Core ML โก
We pointed it at a firehose of 5,000 real comments from Civil Comments with GPU + ANE. moderating 224 comments/s on an M5 Pro.
95.4% agreement with human raters, same as the base PyTorch too.
๐ค Model:
๐ ๏ธ SDK: