๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

mrciffa
@davideciffa
AI models and computer co-design @luceboxai. Engineer & founder.
๊ฐ€์ž… March 2021
502 ํŒ”๋กœ์ž‰ ์ค‘    1.6K ํŒฌ
Qwen 27B and Deepseek v4 Flash models working together on a single Lucebox machine, thats the beauty of having a discrete GPU paired with an unified access memory. A lot of space + good FLOPS & bandwidth. Working hard to increase concurrency performance on heterogeneous setups ๐ŸŽ๏ธ
๋” ๋ณด๊ธฐ