Small models have their purpose. I've been playing with TensorFold and Nemotron Lightning on my 5090. I've been using the little Nemo to gather context in new threads. Wrote a Pi extension just for this purpose. It swaps the model for just one turn and reverts back to the original when done.
Up to 960 tok/s! CC
@ashxhart