Based on what I'm saying with GLM 5.2 implementation inside DwarfStar, there is 90% of probability I'll merge the branch I'm developing. Right now it is probably the best model available to run on a 512GB Mac Studio system, and with distributed inference, if the 2 bit quants work well, we can use it with 3 128GB MacBooks I guess.