llama.cpp now has a Windows app 🦙
Llama Windows makes it easy to run models locally, with optimizations for NVIDIA RTX Spark.
📥 Browse and download models from Hugging Face
💬 Chat with local models right from your system tray
🔒 Keep your prompts on your PC