AJ
@ItsmeAjayKV
Bullish on local AI
OSS FTW
Independent AI R&D.
quants, repe, kernel.
1x 3060, 1x 3090: 64GB RAM
N4 (日本語勉強中) 🎌
参加 September 2016
862 フォロー中 9.1K ファン
Calling out all 8 - 16GB vram users running local LLMs.
If you have 64gb ram then whatever llm you're running can be replaced by Qwen3.8-flash-next.
Thanks to Strata.
If you don't know what Strata is, it's a specialized inference engine, tuned to work for 8 - 24GB vram.
To know more checkout @coldniko posts, or my old posts on the same.
もっと見る
No complaints there !
I'm soo impressed with Qwen3.8-flash-next when it even worked on my 3060.
Strata is straight up magic, reminder that there is more work needed to be done in inference side before saying hardware is the limiting factor.
もっと見る
