Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone | building | | Thoughts are my own.
가입 October 2014
480 팔로잉 중 13.5K 팬
TTFT is non-existent for fresh sessions in TensorFold.
Mixing precomputed KV Cache with TensorFold delivers @Alibaba_Qwen 3.8 Flash Next... on a SINGLE DGX Spark - 0.08s TTFT and over 50tps - all thanks to @ashxhart ♥️
