RunInfra (YC F26)
@runinfrai
The inference platform that auto-optimizes your model
by @rightnowai_co
11 Following 8.3K Followers
216 tok/s. 167ms to first token. 262,144 token context
Ornith 1.5 35B is now live on RunInfra
$0.10/1M input. $0.40/1M output. $0.01/1M cached. 90% of input hits the cache, so effective input is ~$0.02/1M
1M in + 1M out with a warm cache costs $0.42
Show more
