Google open-sourced the GPU engine running Local AI across millions of devices.
Itโs called ML Drift.
It gives developers one GPU layer across:
๐ Metal + ๐ WebGPU + ๐ค OpenCL / OpenGL ES + ๐ฅ๏ธ Windows + Linux via Dawn
And itโs built for LLMs.
ML Drift changes its kernels depending on what the model is doing such as
๐ฅ prefill โ compute-optimized
โ๏ธ decode โ bandwidth-optimized
๐ง custom KV-cache layout
๐พ memory reuse
Google reports up to 12% lower memory overhead in its Gemma tests.
Google says ML Drift runs today across millions of devices in Chrome, YouTube Shorts, Photos and Meet.
Chrome uses it to accelerate Gemini Nano locally.
itโs Apache 2.0 so developers now have one open GPU foundation for running AI across phones, browsers, Macs and PCs.
This is something to test!
Link in ALT.