Zbigniew Majewski
@majewskizby
加入 May 2014
48 正在关注 119 粉丝
More DS4.1 TP4 improvements on 4x DGX Spark 🚀
- Prose decode: 85 tok/s at c1 (was 69)
- Boot: ~3 min
- Prefill: ~4.8k tok/s at 32k–128k, 4.3k at 262k
- KV cache: ~6.5M tokens, 1M context
- Same weights, same quality (qeval unchanged)
显示更多
