註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Augusto Marietti | API father
@sonicaghi
CEO @kong. Move AI. Immigrant 🇮🇹+🇺🇸.
加入 December 2009
1.1K 正在關注    5.9K 粉絲
Shared some data @MTSlive. Enterprises are entering a multi-model world, largest AI orgs up to 100s models. At the same time cost x token is going down via open-weight. We are entering the age of hypervolumes into quadrillions and quintillions token consumption.
顯示更多
Kong CEO @sonicaghi reveals token traffic through its gateways is growing 140x year over year, approaching 1 quadrillion tokens: "The number of tokens is growing exponentially. For the subset that we see, we are running about 500 trillion tokens, going to a quadrillion soon, because it’s growing 140x year over year." "The cost per token is going down, and inference will still be exploding. We’re gonna live in this enterprise world that is more multi-model, cheaper tokens, cheaper levels of intelligence." "The next pieces are, how do we secure it? How do we govern it? How do we cost control it?" @kong
顯示更多