Cheng
@zcbenz
maintainer of MLX @apple. creator of @electronjs. check for the open source things I built.
Joined June 2007
108 Following 7.8K Followers
Is this the first time Meta and Apple work together on CEO level? MLX is the preferred local inference platform for Meta, and we get 0-day support for Muse Spark Open in mlx-lm with vision support.
A lot of people use third party inference engines other than mlx-lm, and they will all benefit from the optimization works for Muse Spark Open in MLX. Which is an important meaning of the mlx-lm project: to provide a good foundation for supporting new models, not to compete with open source community.
For the technical details, our new blog is a great read: Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
Show more
To help make advanced models more accessible, Muse Spark Open is optimized to run on two Apple M5 Ultra Mac Studios with the latest MLX framework.
It also runs on leading inference engines like SGLang, vLLM, TensorRT-LLM, Hugging Face Transformers, llama.cpp, and Unsloth with optimizations for AMD, Apple, Intel, and NVIDIA silicon.
Developers can further customize the model with PyTorch, including TorchTitan for fine-tuning.
Show more
