Kong CEO
@sonicaghi reveals token traffic through its gateways is growing 140x year over year, approaching 1 quadrillion tokens:
"The number of tokens is growing exponentially. For the subset that we see, we are running about 500 trillion tokens, going to a quadrillion soon, because it’s growing 140x year over year."
"The cost per token is going down, and inference will still be exploding. We’re gonna live in this enterprise world that is more multi-model, cheaper tokens, cheaper levels of intelligence."
"The next pieces are, how do we secure it? How do we govern it? How do we cost control it?"
@kong