๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Florian S
@airesearch12
ai lead at msg ag, indie hacker, coding since age of 6, ex countless projects, current: SN92 @reaxlabs, and JevBench
๊ฐ€์ž… October 2022
2.2K ํŒ”๋กœ์ž‰ ์ค‘    7.6K ํŒฌ
JevBench v1.8 is out and it contains some news! New winner on open weights headline leaderboard: mammoth-1. ๐Ÿฅ‡ Congrats @baseten! ๐Ÿค We now have an improved, more real-world-aligned way of computing estimated cost for running these open weights models: models are priced by GPU time (monthly-rented GPU, efficient engine), not chat list prices.
๋” ๋ณด๊ธฐ
JevBench v1.8: self-hosted open-weight decision models are now priced by GPU time (monthly-rented GPU, efficient engine), not chat list prices. API providers use cheap GPUs and optimized engines too. 46 more open models ranked. Method:
๋” ๋ณด๊ธฐ