RunInfra (YC F26)
@runinfrai
fastest open models for agents
by @rightnowai_co
12 Following 9.5K Followers
we spent september rewriting the kernels behind GLM 5.3 Flash. major release is live on RunInfra today
670 tok/s on Vercel AI Gateway
$0.11 per 1M input, $0.45 per 1M output, $0.03 per 1M cached. 1M token context. FP8, vendor-native release
it now runs on AMD. same model, same API, more capacity behind it
99.7% cache hit rate over the last 24 hours. every hit and miss shows up in your dashboard, so you can track the cache logs yourself
OpenAI-compatible chat completions and Anthropic-compatible /v1/messages. text and image input, tool calling, JSON mode, streaming
zero data retention. never used for training
Show more
216 tok/s. 167ms to first token. 262,144 token context
Ornith 1.5 35B is now live on RunInfra
$0.10/1M input. $0.40/1M output. $0.01/1M cached. 90% of input hits the cache, so effective input is ~$0.02/1M
1M in + 1M out with a warm cache costs $0.42
Show more
