Supercharging RAG with Generative Feedback Loops from Weaviate
How to supercharge RAG applications? With Generative Feedback Loops: feed data from a database to your LLM, store the outputs back into the database with a vector embedding! Then, search through the generated data in near real-time for future applications. In this video, we explain RAG, Generative Feedback Loops, give examples of applications that require them, and show you how to implement them with @Weaviate . Weaviate (Sponsor) 👉 https://weaviate.io/ AI Coffee Break Merch! 🛍️ https://ai-coffee-break-with-letitia.myspreadshop.de/ Outline: 00:00 Generative Feedback Loops Motivation 01:32 RAG explained 03:21 Generative Feedback Loops 05:09 Concrete example with Weaviate code 08:30 DSPy: More Applications of Generative Feedback Loops 10:22 Conclusion, Weaviate Sponsor Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏 Dres. Trost GbR, Siltax, Vignesh Valliappan, Michael, Sunny Dhiana, Andy Ma Resources: 📺 Vector Search and Vector Databases explained: https://youtu.be/YkK5IKgxp-c 📑 Generative Feedback Loops with LLMs for Vector Databases: https://weaviate.io/blog/generative-feedback-loops-with-llms 💻 Code used in the video: https://github.com/weaviate/recipes/blob/main/weaviate-features/generative-feedback-loops/generative-feedback-loops-airbnb.ipynb 📑 Hurricane: Writing Blog Posts with Generative Feedback Loops https://weaviate.io/blog/hurricane-generative-feedback-loops 🕊️ What DSPy can do: https://twitter.com/lateinteraction/status/1788241002035388917 DSPy paper: Khattab, Omar, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang, Keshav Santhanam, Sri Vardhamanan, Saiful Haq et al. "Dspy: Compiling declarative language model calls into self-improving pipelines." arXiv preprint arXiv:2310.03714 (2023). https://arxiv.org/abs/2310.03714 📺 Weaviate Demo – Retrieval Augmented Generation • Vector Search • Generative Feedback Loops: https://www.youtube.com/watch?v=VAxrREiugxQ 📺 Generative Feedback Loops with Bob van Luijt - Weaviate Podcast #45! https://www.youtube.com/watch?v=1RALju6ZJz0 📺 Podcast summarization example (Connor): https://www.youtube.com/watch?v=I4Jle80AOaU 📚 Collection of papers and code snippets for running Generative Feedback Loops with Weaviate https://github.com/weaviate/Generative-Feedback-Loops ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak Join this channel to get access to perks: https://www.youtube.com/channel/UCobqgqE4i5Kf7wrxRxhToQA/join ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔗 Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research Video editing: Nils Trost Music 🎵 : Cru – Yung Logos