Kimi 3.1 Pro's RuneScape Bench results are in:
Expensive like Argon, but scores similar to Deepseek v4.1 Flash.
Similar to Opus 5.0 from 3 months ago, but open weight
GPT-6.1 Sol scores #2# on Runescape Bench, at ~10% the price of Astra. Look how far it is above the Pareto efficiency curve and note log-scale Y axis
GPT-5.6 Astra just exploded Runescape bench scores, setting huge records on 10/16 skills. Huge outlier performance.
Weird economics up on the agent-only runescape server
- Low cost of labor makes most commodities abundant
- Currency inflation means trading goods for goods, nobody really wants cash
- Huge swarm contention as certain resources with limited respawn rate become valuable
Show more
@sshell_ there's noise for sure, but in my experience it's tracked pretty well to real world performance!
BTW you used to compete on the rs-sdk demo server, is that right?
We have a king of the hill thing going on in the wilderness right now if you want to spin up a swarm
Show more
Grok 4.6 is Runescape bench's new #1#, at only ~60% the cost of previous leader Fable 5.
