Alex Ziskind
@digitalix
Software engineer making videos about dev gear, local AI, and weird tech experiments
1.5K Following 28.7K Followers
two versions, including nvfp4 out the gate, but with seemingly less params.
What's this? New model gonna need these bad boys. Meta's 816B param Muse Spark is open wieghts 🤯
1M-token context window. And MoE, so likely relatively fast.
Now I'm really curious what my cluster can do!
Show more
What's this? New model gonna need these bad boys. Meta's 816B param Muse Spark is open wieghts 🤯
1M-token context window. And MoE, so likely relatively fast.
Now I'm really curious what my cluster can do!
Show more
guess who (or what): "You’re right, and that’s on me."
Dedicated GPU memory, IN WINDOWS!
192GB RAM in a box. Ryzen AI Max+ Pro 495. This one by GMKtec. let’s plug it in
me spending much of the day filling up agents with jobs, so i can have some time to work. this is getting ridiculous.
192GB RAM in a box. Ryzen AI Max+ Pro 495. This one by GMKtec. let’s plug it in
TensorFold now has a "Beta" macOS app to launch the engine, so you don't need to jump into the CLI.
It's also under /app in the git repo if you want to drop any PR's against it.
Show more
this video will only get better with time:
when was the last time you wrote a for loop
Was looking to do the same thing a few days ago, but with a TV. this is way better - adds touch
I have discovered $50 amazon photo frames to be the PERFECT home display screen
They can be rooted, updated to run a modern browser, have WiFi and can be powered from USB
1280×800 resolution with a nice touch screen
I detailed how to hack these yourself in my latest video
Show more
Omarchy running on X2 Elite. Bluetooth/audio/video/WiFi work!
Trying to bring up Omarchy on the Snapdragon X2 Elite mini PC. building device trees and all that mess.
how would you reply? am i overthinking this?
Trying to bring up Omarchy on the Snapdragon X2 Elite mini PC. building device trees and all that mess.
this guy had some serious tokens per second back in the day
The dev box is pretty expensive. Dev kit 2023 was $600 with 32GB Ram! But considering DGX Sparks are now around $7-$9K, it fits in there.
RTX Spark dev box and surface laptop pricing!
$2599 for surface laptop ultra, Spark dev box $5999
We’re getting to the point where telling laptops apart from a distance will be just as hard as telling phones apart.
My favorite RTX Spark machines being shown off in no particular order:
Dell XPS 16 Creator Edition
Asus ProArt P14
Surface Laptop Ultra
crazy numbers for GLM on dual-M5 Ultras
🤯 GLM-5.3-Flash 4bit on two M5 Ultras (tp=2) with TensorFold and 4x TB5 cables bonded. 🚀
114 tks decode on Prose single stream, and ~1600tks prefil. C=8 decode up to 200tps.
There is headroom here as well, but this is where we landed today.
A new-session TTFT with our prefix-cache lean mode is 0.06s.
@digitalix Thanks for letting me use the M5Us!
Show more
RTX Spark Surface laptop Ultra pricing varies wildly depending on the base chip.
I really have to clean up this rack. it’s a mess
let’s see if this speeds things up. @ashxhart doing some magic
