Too Big to Think: Capacity, Memorization, and Generalization in Pre-Trained Transformers

In this Opik Virtual Learning Series session, a live paper reading of “Too Big to Think: Capacity, Memorization, and Generalization in Pre-Trained Transformers,” Claire Longo and Abby Morgan are joined by Joshua Barron to break down complex concepts and highlight key takeaways from the research.