Running
@ViC305's GLM-5.3 753b recipe on 4 Sparks took four fixes on our cluster:
build the CUDA kernels before loading (warm-up OOM)
one NFS copy of the 319GB pack
hand-written hosts (cloned machine-ids)
swap off
Result: 84.4. All scripts are open:
Credits:
@ViC305 (quant + recipe), TensorFold, the DFlash2 drafter
@Zai_org