LightSeek Foundation(@lightseekorg):Kimi K3 is now supported in TokenSpeed. We worked closely with the @Kimi_Moonshot team to bring Day 0 support to both NVIDIA Blackwell ((G)B200/(G)B300) and AMD Instinct (MI350X/MI355X) in just one week. ✅ Prefix caching ✅ Speculative decoding ✅ Disaggregated serving ✅ CUDA Graph decode We also share how we optimized KDA, Gated MLA, Stable LatentMoE, AttnRes, and our unified Flat KV architecture. Blog ↓

LightSeek Foundation

@lightseekorg

LightSeek is the creator of TokenSpeed, TorchSpec, and SMG — building next-generation AI infra systems

加入 October 2025

0 正在關注 2.8K 粉絲

LightSeek Foundation@lightseekorg

2026.07.27 15:16

Kimi K3 is now supported in TokenSpeed. We worked closely with the @Kimi_Moonshot team to bring Day 0 support to both NVIDIA Blackwell ((G)B200/(G)B300) and AMD Instinct (MI350X/MI355X) in just one week. ✅ Prefix caching ✅ Speculative decoding ✅ Disaggregated serving ✅ CUDA Graph decode We also share how we optimized KDA, Gated MLA, Stable LatentMoE, AttnRes, and our unified Flat KV architecture. Blog ↓