AJ(@ItsmeAjayKV):Calling out all 8 - 16GB vram users running local LLMs. If you have 64gb ram then whatever llm you're running can be replaced by Qwen3.8-flash-next. Thanks to Strata. If you don't know what Strata is, it's a specialized inference engine, tuned to work for 8 - 24GB vram. To know more checkout @coldniko posts, or my old posts on the same.

2026.10.09 11:53

Calling out all 8 - 16GB vram users running local LLMs. If you have 64gb ram then whatever llm you're running can be replaced by Qwen3.8-flash-next. Thanks to Strata. If you don't know what Strata is, it's a specialized inference engine, tuned to work for 8 - 24GB vram. To know more checkout @coldniko posts, or my old posts on the same.

显示更多

AJ@ItsmeAjayKV

2026.10.08 08:56

No complaints there ! I'm soo impressed with Qwen3.8-flash-next when it even worked on my 3060. Strata is straight up magic, reminder that there is more work needed to be done in inference side before saying hardware is the limiting factor.

显示更多

592

转发到社区

热门用户