kerman kohli
@kermankohli
founder @routemesh | researching & investing in ai/semis @siliconfrontr | a few rtx 6000 max-qs, too many dgx sparks and some b300s (soon)
参加 May 2010
1.1K フォロー中 10.6K ファン
its amazing how many people have bad opinions on things they don’t know much about.
come back when you run these things on your own bare metal.
If you’ve noticed, Chinese models have been released less frequent lately. And when a new model does come out, it turns to be bad as always.
There are several possible reasons for this:
They’ve been training their models by distilling OpenAI’s models, but OpenAI itself is falling behind because of Opus.
Meanwhile, they can no longer distill Anthropic’s models as easily as they used to.
All US labs may have achieved RSI , it will be extremely difficult for China to catch up.
Distilling models has become nearly impossible. Distillation attacks now get detected within just a few hours of starting
もっと見る
