The Big LLM Architecture Comparison

Article: https://magazine.sebastianraschka.com/p/the-big-llm-architecture-comparison Reasoning from scratch book: https://mng.bz/Nwr7 LLMs from Scratch repo: https://github.com/rasbt/LLMs-from-scratch This video covers the most important open-weight LLM architectures released in 2025, along with their architectural design decisions. 00:00:00 The Big Architecture Comparison 00:01:52 1. DeepSeek V3/R1 00:24:50 2. OLMo 2 00:35:07 3. Gemma 3 00:44:31 4. Mistral Small 3.1 00:48:04 5. Llama 4 00:50:03 6. Qwen3 00:58:07 7. SmolLM3 01:05:03 8. Kimi 2 01:08:19 9. GPT-OSS 01:14:57 10. Grok 2.5 01:19:04 11. GLM-4.5