Sufyan
@sfxnz
Building and experimenting with AI and local AI | Tech + privacy
2x DGX Spark
430 Following 422 Followers
Default is now DFlash2-7 at two sequences.
Just measured 67 tok/s at c=1 structured. Was 51 tok/s on DFlash2-5 at four sequences.
Staying at 327k context.
Enjoy.
