Baseten
@baseten
Inference is everything.
340 Following 10.2K Followers
We serve Qwen3-TTS on vLLM-Omni at $3 per 1M characters. That's 90% lower in cost than comparable closed-source TTS APIs.
Our engineers optimized a single-replica serving stack to get there. Details on the optimized stack and cost per concurrent stream here.
Show more
Kimi K2.6 has landed, and it is live on Baseten!
We have baked in multiple inference optimizations so that you can leverage Kimi K2.6 in production right away. To run Kimi K2.6, Baseten uses:
-> The Baseten Inference Stack with advanced optimizations, including KV-aware routing
-> NVFP4 weights to unlock maximum performance on NVIDIA Blackwell GPUs
-> Multimodal hierarchical caching for low-latency vision input
-> Prefill-decode disaggregation for LLM inference optimization.
Try it now at:
Show more
