注册并分享邀请链接,可获得视频播放与邀请奖励。

Agustin
@Eleqtrizit
ai agents & resiliency @NVIDIA | openclaw maintainer | local inference aficionado
加入 December 2010
210 正在关注    81 粉丝
Small models have their purpose. I've been playing with TensorFold and Nemotron Lightning on my 5090. I've been using the little Nemo to gather context in new threads. Wrote a Pi extension just for this purpose. It swaps the model for just one turn and reverts back to the original when done. Up to 960 tok/s! CC @ashxhart
显示更多