๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Lilac
@LilacML
(YC S25) Lilac serves fast model inference on idle GPUs.
๊ฐ€์ž… August 2025
18 ํŒ”๋กœ์ž‰ ์ค‘    123 ํŒฌ
Our GLM 5.1 endpoint is averaging 70 TPS under full-load right now ๐Ÿ˜‹ Thanks to everyone using it!