0xSero
@0xSero
it's all for you
参加 December 2020
1.9K フォロー中 79.4K ファン
I’m running a fully coherent model fully on my IPhone 15 pro max!
LiquidAI LFM-2.6B in Q8
It did a web search and tool call and dropped facts.
22 tok/s prefill
2-3 tok/s decode
But I could have used q4 for more speed
もっと見る
