Shower thought: the harness around an LLM probably shouldn’t be rigid code. It should itself be an AI model. Today, most agent systems have an intelligent model trapped inside a fairly dumb shell: fixed routing, fixed workflows, fixed retry logic, fixed context selection. A better architecture would use another model as the executive layer.
It could decide how to approach the task, which tools or models to use, what context matters, when to verify, when to retry, and when to change strategy entirely.
Some boundaries should still remain hard-coded, especially permissions, safety, and validation. But the actual orchestration should be adaptive.