Register and share your invite link to earn from video plays and referrals.

Benjamin Marie
@bnjmn_marie
Independent AI researcher (AI, LLM). Support my work:
Joined June 2019
227 Following    7.7K Followers
Excellent LFM3 GGUFs from AtomicChat, as usual. These results also show how tricky it is to quantize small models while preserving BF16 fidelity. I usually aim for 98 or 99 EAR, but that looks tough for this model. 96 EAR might be a more realistic target. I’ll double-check the accuracy on a few task benchmarks. (Also interesting: the difference in next-token probability distributions between FP16 and BF16.)
Show more