llama.cpp now supports decision models ๐ฆ
Route tickets, moderate content, or pick an agent's next step: ask typed questions, get a probability for every option.
already 5 open models supported, from 144M to 27B:
๋ ๋ณด๊ธฐ
๊ฐ์ ํ ์ด๋ ๋งํฌ๋ฅผ ๊ณต์ ํ๋ฉด ๋์์ ์ฌ์ ๋ฐ ์ด๋ ๋ณด์์ ๋ฐ์ ์ ์์ต๋๋ค.
