注册并分享邀请链接,可获得视频播放与邀请奖励。

Benjamin Marie
@bnjmn_marie
Independent AI researcher (AI, LLM). Support my work:
加入 June 2019
227 正在关注    7.7K 粉丝
This is the first time I actually use this RTX 3060 for AI work. So far nothing seems to burn, temp at 81C Great GPU! It's nearly 4.5yo and I had no idea I would be quantizing LLMs with it when I bought it!
显示更多
Statistically lossless quantization for LFM3 1.7B in ~48 hours! GGUF versions I'm using my very old RTX 3060 for this task!