I Trained an LLM from Scratch

Donate (charity fundraiser): https://gofund.me/31fe001f5 💚 Explainer videos (soon): https://www.youtube.com/@GreenCodeCodes Sponsor Donations: $15,000 - Modal (https://modal.com/) $6,500 - DeepML (https://deep-ml.com/) If your company is interested in sponsoring the series, please reach out to [email protected] (do not donate to the GoFundMe directly) Note on sponsorships: Because sponsor payments are treated as taxable business income in the UK, I have to keep 25% for taxes. The remaining 75% goes directly to the fundraiser (for example, $11,250 of Modal’s $15,000 has been donated). This only applies to corporate sponsors. 100% of anything you donate through the GoFundMe goes directly to VHIO. My friend James had the idea for the skiing analogy (go check him out): https://www.tiktok.com/@james.imnida 📌 Cool resources that inspired me to do this: CS336 Stanford course (the absolute goat of LLM courses): https://cs336.stanford.edu/ Build a Large Language Model (From Scratch) by Sebastian Raschka: https://sebastianraschka.com/llms-from-scratch/ Andrej Karpathy's awesome YouTube videos: https://www.youtube.com/@AndrejKarpathy ⭐ Amazing Patreons (Convolutional Neural Net Tier): kpunkt 🔊 Discord: https://discord.gg/JsFRUtfMzq 📸 Instagram: https://www.instagram.com/greencodecodes/ 🐦 X: https://x.com/GreenCodeCodes 🔊 Music in my videos: https://share.epidemicsound.com/7i1d0b Current Subs: 221,161 💚