๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Md Ismail ล ojal๎จ€ ๐Ÿ•ท๏ธ
@0x0SojalSec
Cyber_Security_Re-searcher || Ai Re-searcher || AI-Sec|| Malware Analysis II iOS || Pwn || 0SINT || Project AI-StrikeSec || 0ldAccounts Suspended @0xSojalSec ||
๊ฐ€์ž… October 2021
6.2K ํŒ”๋กœ์ž‰ ์ค‘    64K ํŒฌ
You can Run locally bigger MoE model on a 12 GB phone, CPU only. Treating flash storage as part of the memory hierarchy. Only the experts actually needed for each token are loaded. - Byte-identical to full residency - No merge step for multi-shard GGUFs. -
๋” ๋ณด๊ธฐ