Joshua Warren
@JoshuaSWarren
Omarchy M team. Making Apple Silicon fast under Linux: MLX, Mesa GPU, Neural Engine. Shipped an iPhone app with no Mac. Building Remnic.
参加 May 2011
6.4K フォロー中 9K ファン
Running AI on a Mac's GPU under Linux was painfully slow.
So I went into Mesa, the open source GPU driver, and made it 18x faster.
Decode: 1.5 to 27.4 tokens/sec.
Prompts: 55 to 237 tokens/sec.
On an M1 Max with Omarchy Linux.
It's all open source:
もっと見る
