注册并分享邀请链接,可获得视频播放与邀请奖励。

Sudo su
@sudoingX
GPU/local LLM. more RAM and OSS... everywhere
加入 August 2022
976 正在关注    29.5K 粉丝
nemotron 3 nano omni-30B reasoning at Q8 running autonomously on my dgx spark right now. 58 tok/s. 1 million context. multimodal. hermes agent is using it to research xAI's new grok algorithm that dropped yesterday. pulling repos. scanning code. breaking it down. all while i post this. 30B model. 58 tokens per second. 1M context. reads images and video. locally. for free. nobody is talking about this model and that's insane.
显示更多
0
20
171
10
转发到社区