註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

JJ
@JosephJacks_
Co-founder @QLTINC -
加入 August 2013
645 正在關注    46.7K 粉絲
At 75%~ utilization, running K3 self-hosted on 8x B300s can securely serve > 30 billion tokens a month.. that’s $500K~ of compute + monthly opex of < $10K !! At current API prices of $3/in and $15/out per 1M tokens, self-hosting payback takes < 100 days. 👉🏼👉🏼 Self Host Your Open Weights 👈🏼👈🏼
顯示更多
0
71
1.2K
62
轉發到社區