Excellent LFM3 GGUFs from AtomicChat, as usual.
These results also show how tricky it is to quantize small models while preserving BF16 fidelity. I usually aim for 98 or 99 EAR, but that looks tough for this model. 96 EAR might be a more realistic target.
I’ll double-check the accuracy on a few task benchmarks.
(Also interesting: the difference in next-token probability distributions between FP16 and BF16.)