AI Evals For Engineers & PMs course homework 2 using Galileo - Recipe Bot Error Analysis
This video by @jimbobbennett has a walkthrough for the second homework from the AI Evals For Engineers & PMs course from Hamel Husain and Shreya Shankar. This walks you through: - Generating test queries - Running test queries against a prompt with an experiment - Using Galileo annotations to open and axial code your traces The Jupyter notebook for this is in the Galileo SDK examples repo - https://github.com/rungalileo/sdk-examples/tree/main/ai-evals-course/hw2 To get started with Galileo, and to integrate the Recipe Chatbot, check out our setup video - https://youtu.be/Lb_uxu8C5wc?si=FquikejiPHqKf6a_ You can find a full playlist with all the homework walkthroughs and Galileo setup here - https://youtube.com/playlist?list=PLS7keRo8770Ps8_gGRBzhkCEiiqCBH1P6&si=VXACui-rElE5HfMX Learn more about Galileo - https://galileo.ai/ Galileo docs - https://v2docs.galileo.ai/ Join the Galileo community - https://community.galileo.ai/