注册并分享邀请链接,可获得视频播放与邀请奖励。

LightSeek Foundation
@lightseekorg
LightSeek is the creator of TokenSpeed, TorchSpec, and SMG — building next-generation AI infra systems
加入 October 2025
2 正在关注    3.3K 粉丝
331 output tokens/s per GPU on @Kimi_Moonshot K3 NVFP4, powered by TokenSpeed ⚡️ Running the full @SemiAnalysis_ AgentX trace on 32 @NVIDIAAI GB300 GPUs, TokenSpeed achieves 1.92× the output throughput per GPU of the standard eight-GPU DCP8 baseline. Cache hit rate and workload balance are the foundations of high-throughput agentic inference. Our latest blog explains how independent DWDP prefill, efficient DEP decode, and shared caching work together to keep long-running agent sessions moving. 👇 📖 ⭐️
显示更多