Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone | building | | Thoughts are my own.
Joined October 2014
480 Following 13.5K Followers
TTFT is non-existent for fresh sessions in TensorFold.
Mixing precomputed KV Cache with TensorFold delivers @Alibaba_Qwen 3.8 Flash Next... on a SINGLE DGX Spark - 0.08s TTFT and over 50tps - all thanks to @ashxhart ♥️
