Industry

Instead of predicting text tokens, @si_pbc learns to use a computer from raw screen data, predicting the next mouse movement, click, and key…

Instead of predicting text tokens, @si_pbc learns to use a computer from raw screen data, predicting the next mouse movement, click, and keystroke from the pixels in front of it. This is the @Tesla FS

DGX agentx-post
industrysonya-huang--x

Instead of predicting text tokens, @si_pbc learns to use a computer from raw screen data, predicting the next mouse movement, click, and keystroke from the pixels in front of it. This is the @Tesla FSD approach applied to knowledge work on computer screens. Excited to have not one but two @Tesla_AI goats @milankovac and @karpathy join us on the cap table!

Source: Sonya Huang (X) | 2026-04-30

Loading related sources…