Hassan
@nutlope
Director of Developer Experience @togethercompute. Building open source AI apps like &
가입 May 2015
1K 팔로잉 중 104.5K 팬
is now live!
Introducing GeoGuess Bench!
A benchmark to measure how good AI models are at playing GeoGuessr.
We gave each model 210 photos from around the world, asked it to predict where each photo was taken, and scored it based on how close it got.
Some surprising results:
• Muse Glimmer 30B beat GPT 6 Astra while being ~45x cheaper
• GLM 5.3 Flash matched GPT 6.1 Sol while being ~5x cheaper
• Claude Opus 5.5 took the #1# spot, scoring even higher than Fable 5.1
Open models did surprisingly well overall.
Check out the full leaderboard, Pareto frontier curve, and every model's guesses!
- Site →
- Code →
더 보기
