Shingi - an experimental local decision model for request-defined choices, probabilities, and ordinal scores. Implemented as a LoRA adapter on top of Bonsai 2 27B.
Runs in only 8GB VRAM, answers in 100ms on Nvidia RTX 4090, scores 83% on JevBench.
Show more
Imagine this, but hooked to @Flock cameras. Umh, did I built every authoritarian police department wet dream?
