๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Alex Ziskind
@digitalix
Software engineer making videos about dev gear, local AI, and weird tech experiments
๊ฐ€์ž… March 2009
1.5K ํŒ”๋กœ์ž‰ ์ค‘    28.7K ํŒฌ
What's this? New model gonna need these bad boys. Meta's 816B param Muse Spark is open wieghts ๐Ÿคฏ 1M-token context window. And MoE, so likely relatively fast. Now I'm really curious what my cluster can do!
๋” ๋ณด๊ธฐ