Register and share your invite link to earn from video plays and referrals.

Hang Gao
@hangg70
making multimodal useful
Joined July 2022
258 Following    3K Followers
I’ve been deeply inspired by Kimi K3, but found it hard to put into words. After letting it sit for a day, I think it comes down to two things. It raises a question I don’t have a clear answer to: how much compute does reaching the frontier actually take? K3 makes me think the number is lower, maybe much lower, than I’d have assumed. I have some rough estimate on their compute and am looking forward to their report for more calibration. The other thing is that the technical depth has a wider range of leverage than I expected. K3 got near parity with the world’s frontier on materially less compute, carried by very strong research and engineering. They’re sharing their weights and learnings openly, in an otherwise increasingly closed world. None of this makes resources less important. What K3 challenges is a narrower belief I quietly held: that frontier performance is out of reach for anyone outside the two or three labs with the most chips. I want to live in a world where there’s more opportunity, and K3 gives me more hope.
Show more