注册并分享邀请链接,可获得视频播放与邀请奖励。

Augusto Marietti | API father
@sonicaghi
CEO @kong. Move AI. Immigrant 🇮🇹+🇺🇸.
加入 December 2009
1.1K 正在关注    5.9K 粉丝
Shared some data @MTSlive. Enterprises are entering a multi-model world, largest AI orgs up to 100s models. At the same time cost x token is going down via open-weight. We are entering the age of hypervolumes into quadrillions and quintillions token consumption.
显示更多
Kong CEO @sonicaghi reveals token traffic through its gateways is growing 140x year over year, approaching 1 quadrillion tokens: "The number of tokens is growing exponentially. For the subset that we see, we are running about 500 trillion tokens, going to a quadrillion soon, because it’s growing 140x year over year." "The cost per token is going down, and inference will still be exploding. We’re gonna live in this enterprise world that is more multi-model, cheaper tokens, cheaper levels of intelligence." "The next pieces are, how do we secure it? How do we govern it? How do we cost control it?" @kong
显示更多