llama.cpp now has a Windows app ๐ฆ
Llama Windows makes it easy to run models locally, with optimizations for NVIDIA RTX Spark.
๐ฅ Browse and download models from Hugging Face
๐ฌ Chat with local models right from your system tray
๐ Keep your prompts on your PC