Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone | building | | Thoughts are my own.
参加 October 2014
480 フォロー中 13.5K ファン
TTFT is non-existent for fresh sessions in TensorFold.
Mixing precomputed KV Cache with TensorFold delivers @Alibaba_Qwen 3.8 Flash Next... on a SINGLE DGX Spark - 0.08s TTFT and over 50tps - all thanks to @ashxhart ♥️
