Oriol Vinyals
@OriolVinyalsML
VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead.
Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.
92 Following 221K Followers
Founder Mode activated from my new office ♾
Fun fact: @woj_zaremba wanted to completely remove that paper from existence a year or so after. I forgot why though -- Woj?
I started doing language modeling research in Jan 2016, using the LSTM from the "RNN Regularization" model by @woj_zaremba @OriolVinyalsML and @ilyasut, trying to improve its perplexity on Penn Treebank (1M toks). This led to the weight tying method, sometimes still used today.
Show more
This is my third Google I/O in a row. Some things have changed, some (like the amazing colleagues that were there since day 0) haven't. @JeffDean @borgeaud_s
3.1 Flash-Lite 🔦 > 2.5 Flash ⚡️
It happened again. Our newest Flash-Lite model outperforms the previous generation's Flash tier.
Smarter. Faster. Cheaper.
Show more
Personal update: After an amazing 10 years in London, it's time for a major change. One-way ticket back to California 🌞! I'm incredibly excited to return to the Bay Area to continue building Gemini and pushing us toward the age of AGI 🚀
Show more
New paper out today, proving a novel theorem in algebraic geometry with an internal math-specialized version of Gemini. This was a collaboration between @GoogleDeepMind (Professor Freddie Manners and @GSalafatinos, hosted by the Blueshift team) and Professors Jim Bryan, Balazs Elek, and Ravi Vakil.
Show more
We may be delaying AGI if we keep playing this game, but OK! I used Copy Canvas and here is my addition to the Cartographer. Coding this in two sentences... drastic & wild times! @NoamShazeer I nominate you : )
Show more
