Mia
@MiaAI_lab
Building with AI & LLMs | Insights, recipes, tools & honest experiments.
Joined July 2022
413 Following 36.1K Followers
TensorFold is going to change everything đ
Exciting times ahead! âŗ
TensorFold Inference Engine is here đ
I spent six months making one weight read count for more than one token on Apple Silicon.
Draft tokens run through parallel lanes; the model verifies them together and keeps only what passes.
Qwen 3.8 27B MLX 4Bit - 120-124tks
Nemotron Lightning MLX 4Bit - 188-206tks
Qwen3.8 Flash Next MLX 4Bit - 88-92tks
CUDA Implementation is in Alpha showing strong gains.
The Repo is in the comments đđŧ
Show more
