This is the first time I actually use this RTX 3060 for AI work.
So far nothing seems to burn, temp at 81C
Great GPU!
It's nearly 4.5yo and I had no idea I would be quantizing LLMs with it when I bought it!
顯示更多
Statistically lossless quantization for LFM3 1.7B in ~48 hours!
GGUF versions
I'm using my very old RTX 3060 for this task!