註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Baseten
@baseten
Inference is everything.
加入 March 2021
340 正在關注    10.2K 粉絲
Kimi K2.6 has landed, and it is live on Baseten! We have baked in multiple inference optimizations so that you can leverage Kimi K2.6 in production right away. To run Kimi K2.6, Baseten uses: -> The Baseten Inference Stack with advanced optimizations, including KV-aware routing -> NVFP4 weights to unlock maximum performance on NVIDIA Blackwell GPUs -> Multimodal hierarchical caching for low-latency vision input -> Prefill-decode disaggregation for LLM inference optimization. Try it now at:
顯示更多
0
12
143
7
轉發到社區