We've been quiet for a bit. Grok Build has been heads down on a lot of exciting behind the scenes work, more soon!
Since 4.7 launched, the biggest feedback has been quick usage limit burn, overthinking, and some early compactions. I wanted to walk through what we've been changing and some honest explanations:
On usage, the team cut the system prompt by about a third and rewrote many of the tool descriptions, so every request carries a lot less token overhead.
On overthinking, we're working deeper down the stack, but the most effective fix is lowering effort with `/effort medium` or `/effort low`. On CursorBench, medium scores 41.6% vs 43.9% on high, at $3.49 vs $4.69 per task!
For compactions happening earlier than expected, we lowered default context window to 256k. Most sessions don't compact, and in testing, it cut cost per user by about a fourth with minimal impact on perf. Still, our bad on not making the UX more seamless here.
If your sessions run long, you can switch back with `/context-window 500k`! But do note that requests over 200k cost more.
If something still feels off, reply with what you were working on and we (and
@bot) will take a look 🙂