Register and share your invite link to earn from video plays and referrals.

RightNow (YC F26)
@rightnow_co
The kernel lab behind instant AI
12 Following    10K Followers
Ornith 1.5 122B is live on runinfra. launch partner with @ornith_ , live from hour 0 302 tok/s output. 72ms to first reasoning token $0.20 / 1M input. $0.02 cached. $0.80 output 99.1% cache hit rate on agentic workloads one of the best models we've served for its size. 10B active and it holds up on real agent work OpenAI-compatible chat completions and Anthropic-compatible /v1/messages -- drop it into claude code as is zero data retention by default
Show more
we spent september rewriting the kernels behind GLM 5.3 Flash. major release is live on RunInfra today 670 tok/s on Vercel AI Gateway $0.11 per 1M input, $0.45 per 1M output, $0.03 per 1M cached. 1M token context. FP8, vendor-native release it now runs on AMD. same model, same API, more capacity behind it 99.7% cache hit rate over the last 24 hours. every hit and miss shows up in your dashboard, so you can track the cache logs yourself OpenAI-compatible chat completions and Anthropic-compatible /v1/messages. text and image input, tool calling, JSON mode, streaming zero data retention. never used for training
Show more
216 tok/s. 167ms to first token. 262,144 token context Ornith 1.5 35B is now live on RunInfra $0.10/1M input. $0.40/1M output. $0.01/1M cached. 90% of input hits the cache, so effective input is ~$0.02/1M 1M in + 1M out with a warm cache costs $0.42
Show more