JevBench v1.8 is out and it contains some news!
New winner on open weights headline leaderboard: mammoth-1. 🥇
Congrats
@baseten! 🤝
We now have an improved, more real-world-aligned way of computing estimated cost for running these open weights models: models are priced by GPU time (monthly-rented GPU, efficient engine), not chat list prices.