๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Fraser Price
@fraserpricee
me like magic thinky rocks
๊ฐ€์ž… December 2021
677 ํŒ”๋กœ์ž‰ ์ค‘    2.7K ํŒฌ
DeepSeek 4.1 Flash full precision + DSpark @ 200TPS on 4 Max-Qs- with just 64GB system RAM! Offloading the 200GB Engram (i.e. a hash table) to NVMe seems fine rather than keeping it all in RAM, my wallet is thankful ๐Ÿ™ More juice to squeeze though, vLLM recipe to come... ๐Ÿ‘€
๋” ๋ณด๊ธฐ