llama.cpp now has a Windows app đĻ
Llama Windows makes it easy to run models locally, with optimizations for NVIDIA RTX Spark.
đĨ Browse and download models from Hugging Face
đŦ Chat with local models right from your system tray
đ Keep your prompts on your PC