登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

seekinganythingbutalpha
@ivanalog_com
Focus on 1) Technology and Dividend Blended 2) Drawdown protection. Check highlights and articles. No investment advice. Now building ModelDock
参加 October 2011
772 フォロー中    17.2K ファン
Fast, cheap, good, cannot get all three of them, right? Strata now runs Qwen 3.8 Flash on a gaming PC fast enough that people ask the obvious follow-up: is it actually good? The honest answer is that we run 3-bit packs (IQ3_S, IQ3_XXS), so there is a gap to the official API. We measured it. The official Qwen 3.8 Flash (Alibaba's API) answered 31 prompts, about 15K tokens, and Strata read the same answers token by token: Ask the official API the same thing twice at temperature 0, and it disagrees with itself on 2.5% of tokens. That's the ceiling. Local adds 1.5 points on top of that with IQ3_S, 2.3 with IQ3_XXS, and 2.6 with our fastest setting. Where the official model is sure (about 70% of tokens), local picks the same token 99.9% of the time. The rest is mostly synonym-level choices, where the API wavers too. And the pelican riding a bicycle? No sweat. The real perk of local: you know exactly which model and which weights you're running. No asking for Astra and getting quietly routed to Luna. No model shrinkflation. Fast, cheap, and good, we take at least 2.5 of them.
もっと見る