註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Agustin
@Eleqtrizit
ai agents & resiliency @NVIDIA | openclaw maintainer | local inference aficionado
加入 December 2010
210 正在關注    81 粉絲
Small models have their purpose. I've been playing with TensorFold and Nemotron Lightning on my 5090. I've been using the little Nemo to gather context in new threads. Wrote a Pi extension just for this purpose. It swaps the model for just one turn and reverts back to the original when done. Up to 960 tok/s! CC @ashxhart
顯示更多