Google's new VaultGemma model – Differential Privacy explained
LLMs often memorize what they see — even a single phone number or address can stick forever in their weights. Google’s new VaultGemma changes that: it’s the first open-weight LLM trained from scratch with differential privacy, meaning secrets seen seldomly during training leaves no trace. 👉 In this video, we explain Differential Privacy through the concrete example of VaultGemma — how it works, why it matters, and what it means for the future of trustworthy AI. AI Coffee Break Merch! 🛍️ https://ai-coffee-break-with-letitia.myspreadshop.de/ Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏 Vignesh Valliappan, Ivan Janov, Sunny Dhiana, Andy Ma 📃 VaultGemma Blog: https://research.google/blog/vaultgemma-the-worlds-most-capable-differentially-private-llm/ 📃VaultGemma Paper: https://services.google.com/fh/files/blogs/vaultgemma_tech_report.pdf Outline: 00:00 VaultGemma explained 00:58 Differential Privacy explained 02:33 Training with Differential Privacy 05:22 Training recap 06:09 Results 07:16 Real-world impact ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak Join this channel as a Bean Member to get access to perks: https://www.youtube.com/channel/UCobqgqE4i5Kf7wrxRxhToQA/join ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔗 Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community Twitter / X: https://twitter.com/AICoffeeBreak LinkedIn: https://www.linkedin.com/in/letitia-parcalabescu/ Threads: https://www.threads.net/@ai.coffee.break Bluesky: https://bsky.app/profile/aicoffeebreak.bsky.social Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak Substack: https://aicoffeebreakwl.substack.com/ Web: https://explanationmark.de/letitia https://aicoffeebreak.com #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research Video editing: Nils Trost