keys 🧪
@u1tra_instinct
#Bitcoin# 💎🙌 . 🧪🧪🧪 (always testing and get into trouble).
加入 January 2018
735 正在关注 4.4K 粉丝
85toks/sec on Prose that is sick… LFG
More DS4.1 TP4 improvements on 4x DGX Spark 🚀
- Prose decode: 85 tok/s at c1 (was 69)
- Boot: ~3 min
- Prefill: ~4.8k tok/s at 32k–128k, 4.3k at 262k
- KV cache: ~6.5M tokens, 1M context
- Same weights, same quality (qeval unchanged)
显示更多
