Different Tokens, Different Compute in LLMs
In Mixture-of-Recursions, a learned router decides which tokens continue through additional passes of the same transformer layers. Some tokens take one pass, others two or three. An excerpt from my longer video on looped transformers: https://www.youtube.com/watch?v=KT4n-z_4QJU