Shapley Values Explained | Interpretability for AI models, even LLMs!

AI Coffee Break with Letitia
6,949 views โ€ข

Ever wondered how to interpret your machine learning models? ๐Ÿค” We explain a powerful interpretability technique for machine learning models: Shapley Values. They can be used to explain any model. ๐Ÿ’ป We show a simple example code of how they work, and then ๐Ÿ“– explain the theory behind them. AssemblyAI (Sponsor) ๐Ÿ‘‰ https://www.assemblyai.com/research/universal-1/?utm_source=youtube&utm_medium=social&utm_campaign=universal1_letitia AI Coffee Break Merch! ๐Ÿ›๏ธ https://ai-coffee-break-with-letitia.myspreadshop.de/ Thanks to our Patrons who support us in Tier 2, 3, 4: ๐Ÿ™ Dres. Trost GbR, Siltax, Vignesh Valliappan, Michael, Sunny Dhiana, Andy Ma Outline: 00:00 Interpretability in AI 01:02 AssemblyAI (Sponsor) 02:23 Simple example 03:51 Code example: SHAP 05:17 Shapley Values explained 07:59 Shortcomings of Shapley Values ๐Ÿ’ป Demo for SHAP on LLaMA 2 LLM: https://drive.google.com/drive/folders/1EE2F5fbrBMO28DWzcKll9V_MImydsg3N?usp=sharing Keep in mind that you need to have the resources to run LLaMA 2. If not, try out the โ€œgpt2โ€ model in the code. You can find simple examples here: https://shap.readthedocs.io/en/latest/ (see e.g., โ€œText examplesโ€) ๐Ÿ“™โ€œInterpretable Machine Learningโ€ by C. Molnar: https://christophm.github.io/interpretable-ml-book/ โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€ ๐Ÿ”ฅ Optionally, pay us a coffee to help with our Coffee Bean production! โ˜• Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak Join this channel to get access to perks: https://www.youtube.com/channel/UCobqgqE4i5Kf7wrxRxhToQA/join โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€โ–€ ๐Ÿ”— Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community Twitter: https://twitter.com/AICoffeeBreak Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #researchโ€‹ Video editing: Nils Trost

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close