JJ
@JosephJacks_
๊ฐ์
August 2013
465 ํ๋ก์ ์ค 45.4K ํฌ
At 75%~ utilization, running K3 self-hosted on 8x B300s can securely serve > 30 billion tokens a month.. thatโs $500K~ of compute + monthly opex of < $10K !!
At current API prices of $3/in and $15/out per 1M tokens, self-hosting payback takes < 100 days.
๐๐ผ๐๐ผ Self Host Your Open Weights ๐๐ผ๐๐ผ
๋ ๋ณด๊ธฐ
