Took the LLM-as-a-Verifier paper and turned it into a simple /ultra command for coding agents 🚀
Run your task N times in parallel, each in its own git worktree. The same model then verifies the diffs (a Probabilistic Pivot Tournament) and applies the winner.
Terminal-Bench,
@deepseek_ai V4 Flash 0731 as both agent and verifier:
24% → 33% overall
40% → 75% on recoverable tasks
Model-agnostic: it pushes whatever model you run to its best.
An
@opencode plugin + a CLI for any agent (Claude Code,
@grok,
@cline,
@pidotdev). Spread attempts across one or several models in a single pass.
MIT. npm: agent-ultramode
Repo + how it works below.