AJ
@ItsmeAjayKV
Bullish on local AI
OSS FTW
Independent AI R&D.
quants, repe, kernel.
1x 3060, 1x 3090: 64GB RAM
N4 (日本語勉強中) 🎌
가입 September 2016
862 팔로잉 중 9.1K 팬
Strataを知る人がもっと増えたら、GPUの価格もまた上がりそうですね。
Calling out all 8 - 16GB vram users running local LLMs.
If you have 64gb ram then whatever llm you're running can be replaced by Qwen3.8-flash-next.
Thanks to Strata.
If you don't know what Strata is, it's a specialized inference engine, tuned to work for 8 - 24GB vram.
To know more checkout @coldniko posts, or my old posts on the same.
더 보기
