Mikko Ohtamaa
@moo9000
Cofounder @tradingprotocol - Tweeting about human and digital rights, economics, blockchain, cybersecurity, open source
参加 June 2009
16.2K フォロー中 21.9K ファン
Let me tell you about my autoresearch loop
At 75%~ utilization, running K3 self-hosted on 8x B300s can securely serve > 30 billion tokens a month.. that’s $500K~ of compute + monthly opex of < $10K !!
At current API prices of $3/in and $15/out per 1M tokens, self-hosting payback takes < 100 days.
👉🏼👉🏼 Self Host Your Open Weights 👈🏼👈🏼
もっと見る
