Toven
@pingToven
leading inference provider ops (i'm hiring!) @openrouter. opinions my own. aka tomas. ๐ฆ๐ท๐ฆ๐ท๐ฆ๐ท
3.8K Following 7.4K Followers
main reason why we donโt onboard 99% of people who ask
we vet every provider including thorough security and compliance review, which slows us down but helps secure your inference
the provider operations team at openrouter is absolutely cooking on automations. 727 new endpoints added in august alone, 23 endpoints a day!
our systems allow 75+ providers to self serve onboard their endpoints onto our platform (gated on quality and functionality tests)
Show more
very normal month of token growth nothing to see here
hope youโre enjoying ox alpha :)
if you made it out to the @togethercompute x @OpenRouter event tonight despite the rain, thank you so much! was a blast :)
btw openrouter now has a batch api in beta. go try it and lmk if you run into issues! if you have a real workload you can test with dm me and i can sponsor credits.
want to give a huge shoutout to my team for an incredible july. our velocity continues to increase and i'm excited about our expansion into multimodality.
my team is always working through a phat backlog of inference providers that want to onboard onto openrouter
right now iโm prioritizing media gen (image gen, audio, video)
what else do people want to see?
Show more
