注册并分享邀请链接,可获得视频播放与邀请奖励。

Ivan Fioravanti
@ivanfioravanti
LLM addicted, Apple MLX, NVIDIA DGX, Cloud, Kubernetes, Technology Advisor, Investor and Co-Founder / Board Member of CoreView. Local AI Ambassador.
加入 June 2009
1.5K 正在关注    45.4K 粉丝
Please stop using MLX 4bit affine quants, focused on something else. They are fast but not good enough, especially in larger contexts. I learned the lesson the hard way using them and even thanks to @ggerganov pointing me in the right direction a long time ago.
显示更多
0
42
177
5
转发到社区