Same prompt, four modes/models:
- GPT-6 Sol
- Opus 5.5
- High (GPT-6 Astra)
- Ultra (Fable 5.1)
Here's the prompt:
"Look at the last two news posts we published on runner functionality: one runner is now enough, and one runner many worktrees.
I now want you to write a news post that's similar but for the functionality behind the `shared-runners` feature flag.
It should probably also contain a screenshot of the picker that shows two normal runners and two shared runners, like `gpu-runner` or `macos-builder` or something and some nic elooking avatars and good data.
And it should succinctly explain how it works and how people can use it."
Costs:
- Opus 5.5: $9.54
- GPT-6 Sol: $3.10 (estimated list price, using sub)
- High: $7.58 (estimated list price, using sub)
- Ultra: $15
Notes:
- Ultra took by far the longest, Ultra is the only one that didn't create docs (I didn't say they should create docs but I think the other models looked at previous commits and figured out they should do that?)
- Ultra was the only model that didn't prominently display the "give me the grant to upload assets at the end"
- I think Opus 5.5 is the best result. It really feels like more creative (headline) and it nailed the screenshots.
- High is my second favorite.