Real cost matters!
Per token is meaningless.
Real cost goes beyond caching. API verbosity and accuracy matter too. An API 2x more verbose is 2x more tokens and cost. An API less accurate, compounding over hundreds of turns, is costly for end users to keep asking agents to tweak and redo work.
显示更多
