Genie explained ๐Ÿงž Generative Interactive Environments paper explained

AI Coffee Break with Letitia
4,786 views โ€ข

Genie just watches YouTube videos and inferred actions and learned to render environments! ๐Ÿ—บ๏ธ In this video, we explain the Genie paper from Google DeepMind. "Genie: Generative Interactive Environments" paper explained. AI Coffee Break Merch! ๐Ÿ›๏ธ https://ai-coffee-break-with-letitia.myspreadshop.de/ Thanks to our Patrons who support us in Tier 2, 3, 4: ๐Ÿ™ Dres. Trost GbR, Siltax, Vignesh Valliappan, Michael Outline: 00:00 DeepMind released GENIE 00:35 2d games from prompts 01:46 How Genie works 02:20 Genie architecture 02:50 Video Tokenizer 03:37 ST-transformer explained 04:25 Latent Action Model (LAM) 06:02 Dynamics Model 06:48 Genie training 07:04 Inference 08:03 Results 08:21 Robotics application 08:36 Copyright ๐Ÿ“บ MaskGIT explanation: https://youtu.be/RYLomvaPWa4?si=Fmc11u4CXoujzgbu&t=573 ๐Ÿ“„ Bruce, Jake et al. โ€œGenie: Generative Interactive Environments.โ€ (2024). https://arxiv.org/abs/2402.15391 ๐Ÿ“š https://sites.google.com/view/genie-2024/home โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€ ๐Ÿ”ฅ Optionally, pay us a coffee to help with our Coffee Bean production! โ˜• Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak Join this channel to get access to perks: https://www.youtube.com/channel/UCobqgqE4i5Kf7wrxRxhToQA/join โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€ ๐Ÿ”— Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #researchโ€‹ Video editing: Nils Trost Music ๐ŸŽต : Cru - Yung Logos

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close