Register and share your invite link to earn from video plays and referrals.

prinz
@deredleritt3r
ad astra
Joined January 2024
4.9K Following    23.9K Followers
Here's the dollar cost per task and performance on BenchCAD for Astra and OpenAI's internal model: Astra (low): $0.44 per task; score = 14% Astra (medium): $2.73 per task; score = 31% Astra (high): $5.11 per task; score = 41% Astra (xhigh): $6.67 per task; score = 45% Astra (max): $11.05 per task; score = 59% Internal model (low?): ~$11 per task; score = ~76% Internal model (medium?): ~$23 per task; score = ~83% Internal model (high?): ~$34 per task; score = ~86% Internal model (xhigh?): ~$37 per task; score = ~88% Internal model (max): not pictured *Astra data taken from BenchCAD's website; internal model data extrapolated from same by Astra. **It's possible that the four internal model reasoning levels are instead medium through max (not low through xhigh).
Show more