Exploring the AI frontier: models, agents, benchmarks & applied experiments. I test, compare and build. (kinda got DMCA'd by two companies we don't talk about)
GPT Astra vs. GPT-6.1 Sol and every previous Sol generation on the Mario test.
Same prompt, same test.
Astra still wins, finishing in just 15m 37s for $2.96.
GPT-6.1 Sol took 34m 38s, more than twice as long, but cost just $0.64 and delivered the best result of any Sol model.
Astra is still ahead, but 6.1 Sol is getting surprisingly close for a fraction of the price.