Let me explain Looped Transformers to you

A visual breakdown of Looped Transformers, a technique where internal layers of a Large Language Model can loop to simulate iterative reason. Study research papers at: paperbreakdown.com I am building this, please go check it out and give me feedback! Follow me on Twitter: https://x.com/neural_avb To join our Patreon, visit: https://www.patreon.com/NeuralBreakdownwithAVB Members get access to everything behind-the-scenes that goes into producing my videos - including code and additional material. Plus, it supports the channel in a big way and helps to pay my bills. Links: Universal Tranformers: https://arxiv.org/pdf/1807.03819 Reasoning Latent paper: https://arxiv.org/abs/2502.17416 Loopie Paper: https://arxiv.org/abs/2607.16051 Relaxed Recursive Transformers: https://arxiv.org/abs/2410.20672 Mixture of Recursion: https://arxiv.org/pdf/2507.10524 Latent Reasoning A Recurrent Depth Approach : https://arxiv.org/abs/2502.05171 0:00 - Intro 3:31 - Looped Transformers 101 13:35 - Training Looped Transformers 20:45 - Outro