My mind is blown ๐คฏ! Loading AI weights on the M5 Ultra is FAST!
It's over 20 times faster than my Spark cluster.
When trying new recipes, the hard part is making the change then needing 12 minutes to reload.
Or even in every day usage, you pick the best overall model and are kind of "stuck" with it because it takes so long to load. If you want to do something different like image generation, you have to spend 12 minutes waiting to trade out the models.
The M5 Ultra loads 177GB of GLM5.3 in 25 seconds. WOW.