Infinite intelligence. Local. Any Hardware. Peer-to-Peer Hyper Swarm. No cloud. No compromise.
QVAC is the decentralized AI platform for humans and machines.
Our third llama.cpp PR in a week has been merged. This one, by @gianniCor, fixes llama.cpp's Vulkan backend, where choosing the next token could freeze an NVIDIA GPU.
Thanks to @ggml_org for the review.