LFM2.5-2.6B now runs locally on your Mac đ
Great release by
@LiquidAI â and Nativ supports it Day 0.
Full BF16, no quantization:
âĄī¸ 11,000+ tok/s prefill
âĄī¸ 82 tok/s decode
đ§ Under 8.5GB peak memory â even at full 128K context
đ Scales to 476 tok/s aggregate across 16 concurrent requests
Try it on Nativ đ
Github repo đˇ