Register and share your invite link to earn from video plays and referrals.

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone |
Joined October 2014
315 Following    2.8K Followers
I got sick of managing my DGX Sparks from the terminal, so I started building a native app for iPhone, iPad and Mac. You will be able to set up a fresh Spark with a tap of a few buttons, adding vLLM, anti-OOM, and your favourite models that fit. Additionally, you will be able to set up clusters easily by connecting the CX7 cable and clicking Pair. I’m also building a custom Apple Foundation Models provider backed by Spark, with Siri and Shortcuts exposed through App Intents. Very early, but the first setup flow is working. This can be connected via USBC MCDMA, Wi-Fi, or remotely via Tailscale/ZeroTrust.
Show more