Do Looped Transformers Hide Chain of Thought?

Sebastian Raschka
585 views •

Looped transformers reuse the same layers for additional computation. In this clip, I discuss why this might lead to a more compact chain of thought, using a math-exam analogy. An excerpt from my longer video on looped transformers: https://www.youtube.com/watch?v=KT4n-z_4QJU

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close