Different Tokens, Different Compute in LLMs

Sebastian Raschka
2,611 views •

In Mixture-of-Recursions, a learned router decides which tokens continue through additional passes of the same transformer layers. Some tokens take one pass, others two or three. An excerpt from my longer video on looped transformers: https://www.youtube.com/watch?v=KT4n-z_4QJU

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close