Ivan Fioravanti ᯅ
@ivanfioravanti
GenAI/LLM addicted, Apple MLX, Cloud computing, Kubernetes, Technology Advisor, Investor and Co-Founder & Board Member of CoreView.
1.4K Following 40K Followers
Planning (at least) three weeks in China in September with my wife and young daughter that speaks Chinese! ✈️
I hope to be able to visit at least @MiniMax_AI and @Zai_org labs while there 🙏
Show more
Installing and configuring ComfyUI on DGX Spark?
Just ask Hermes Agent to do it for you: it will connect to ssh and do everything!
DGX Spark is good in Image generation! 🔥
11 seconds for Qwen-Image 2512 Lightning 4steps
7.2 seconds for Z-Image-Turbo
Show more
Hermes Agent as Master in a GDR (Blades in the Dark here) running locally on M3 Ultra using DeepSeek V4 Flash q4-imatrix with ds4 by @antirez
Testing side by side with online version and apart from the speed, quality is nearly identical so far.
I'll keep testing to see how far I can push with context!
1M goal 🚀 Video below to show the decoding speed is still good at ~120K context. Pre fill is slow, but ok. I started with --kv-disk-space-mb 32756 to try with very large context.
Image generation currently is with Grok Imagine, but I'm planning to update the skill to use mflux and a local model 💪
Thanks @teomurgi for sharing this amazing idea! This is benchmarking while having fun!
Show more
Local AI in action! MiniMax M3 unning locally on a single M3 Ultra 512GB in Unsloth Studio! 🔥
Here UD-Q5_K_XL decoding at 32.5 toks/s!
My Hermes Agent is now powered by Grok 4.3!
Let's give it a chance!
