Sonya Huang 🐥(@sonyatweetybird):Instead of predicting text tokens, @si_pbc learns to use a computer from raw screen data, predicting the next mouse movement, click, and keystroke from the pixels in front of it. This is the @Tesla FSD approach applied to knowledge work on computer screens. Excited to have not one but two @Tesla_AI goats @_milankovac

2026.04.30 18:01

Instead of predicting text tokens, @si_pbc learns to use a computer from raw screen data, predicting the next mouse movement, click, and keystroke from the pixels in front of it. This is the @Tesla FSD approach applied to knowledge work on computer screens. Excited to have not one but two @Tesla_AI goats @_milankovac_ and @karpathy join us on the cap table!

Sonya Huang 🐥@sonyatweetybird

2026.04.30 15:36