216 tok/s. 167ms to first token. 262,144 token context
Ornith 1.5 35B is now live on RunInfra
$0.10/1M input. $0.40/1M output. $0.01/1M cached. 90% of input hits the cache, so effective input is ~$0.02/1M
1M in + 1M out with a warm cache costs $0.42
显示更多