Day 16/
You can now cache for 12h in the API and for logged in users across Codex & Work we keep cache forever and you don’t have any penalty for coming back to an old conversation or resuming after a few hours and are now guaranteed to hit the cache.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗
1/4
Two important changes to timeline recommendations:
- New AI/SI ranking model that predicts probable time spent much better
- Retrieval model trained to surface posts people read all the way through
User active seconds is growing exponentially and hitting all-time highs almost every day: