Shingi - an experimental local decision model for request-defined choices, probabilities, and ordinal scores. Implemented as a LoRA adapter on top of Bonsai 2 27B.
Runs in only 8GB VRAM, answers in 100ms on Nvidia RTX 4090, scores 83% on JevBench.
顯示更多