The Agents API team is starting off November strong 💪 with some more ships:
🕛 12 hour prompt cache - now you can keep prompts in cache for 12 hours! We’ve seen customers of long running agents, especially personal agents, finding a lot of use and cost savings with this
💨 Async functions - Let your agent continue working after it calls a tool, without waiting for that tool’s result. Use it to start slow lookup requests early, answer independent parts of a request, and provide results when your application has them.
💸 Budget control (beta) - Limit, monitor, and control your agent budgets on a per-session level with Agents API. Now you don’t have to worry about a single customer consuming all your tokens! Interested? DM or email me and I can get you in.
Got any other feature requests? Let me know (mluo
@openai) and we’ll try to prioritize for next week!