3.5k followers.
wasn't going to post about this but i was stuck at 3k for what felt like forever.
so i'm really happy and grateful.
thank you for engaging with my posts and putting up with the voices 🙏
from what I'm seeing gemini 4 pro results are either frontier level or weirdly far behind it.
both probably aren't same at the same time.
my current theory is the arena testing.
gemini 4 pro is showing up under "gemini-3.7-flash" label, but it's not routing to 4 pro all the time. so some are just getting actual 3.7 flash results and assuming it's 4 pro.
that would explain why the results being posted are wildly inconsistent.
What if gemini 4 isn't even real… just see for yourself
i'm super suspicious of arena ai right now. ran the exact same prompt in battle mode 3 more times and caught it slipping:
it gave me the EXACT same output twice, but labeled one as muse spark 1.3 and the other as kimi k3 lmao
what if they literally just ran a random goodl model and slapped a 'gemini' label on it?
okay, this tibo is actually real.
since openai didn't ship anything this week, tibo says he'll give us a banked reset.
and also something big is coming tuesday.
gpt-5.6 sol is being offered at $1/$5 per million tokens on openrouter through openai flex.
for comparison:
> claude opus 5: $5/$25
> claude fable 5: $10/$50
so at these rates, sol is:
> 5x cheaper than opus 5
> 10x cheaper than fable 5
while still sitting in basically the saame frontier capability class.
the price performance gap here is kinda insane.