Register and share your invite link to earn from video plays and referrals.

DigitalOcean
@digitalocean
The AI-Native Cloud. ☁️ Status: @DOstatus Support:
Joined January 2012
287 Following    226.8K Followers
A typical agentic session runs 43 turns with 142K tokens in and 444 tokens out. Serving that well comes down to the cache. @yifandotqiao of @Inferact (the team behind vLLM) on taking one card from 84K to 480K tokens a minute on @Kimi_Moonshot K3.
Show more