I've been a heavy Qwen user. Now 100% on @Recursive_SI 's Flint. I built this side by side test, running both models at 8bit on the same hardware (RTX A6000 48Gb) try it: (This is running locally on two identical cards) BTW 4 bit is even faster.
Show more
