Register and share your invite link to earn from video plays and referrals.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
Joined July 2023
552 Following    12.5K Followers
Google open-sourced the GPU engine running Local AI across millions of devices. Itโ€™s called ML Drift. It gives developers one GPU layer across: ๐ŸŽ Metal + ๐ŸŒ WebGPU + ๐Ÿค– OpenCL / OpenGL ES + ๐Ÿ–ฅ๏ธ Windows + Linux via Dawn And itโ€™s built for LLMs. ML Drift changes its kernels depending on what the model is doing such as ๐Ÿ“ฅ prefill โ†’ compute-optimized โœ๏ธ decode โ†’ bandwidth-optimized ๐Ÿง  custom KV-cache layout ๐Ÿ’พ memory reuse Google reports up to 12% lower memory overhead in its Gemma tests. Google says ML Drift runs today across millions of devices in Chrome, YouTube Shorts, Photos and Meet. Chrome uses it to accelerate Gemini Nano locally. itโ€™s Apache 2.0 so developers now have one open GPU foundation for running AI across phones, browsers, Macs and PCs. This is something to test! Link in ALT.
Show more