Graph Language Models EXPLAINED in 5 Minutes! [Author explanation 🔴 at ACL 2024]
How to make powerful LLMs understand graphs and their structure? 🕸️ With Graph Language Models! They take a pre-trained language model and fit it with the ability to process graphs. Watch if you're curious about how this works (hint: choose the right positional embeddings)! 📃 Moritz Plenz and Anette Frank. 2024. Graph Language Models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Bangkok, Thailand, ACL 2024 https://aclanthology.org/2024.acl-long.245/ 💻 Code for Graph Language Models: https://github.com/Heidelberg-NLP/GraphLanguageModels Follow Moritz Plenz (first author) on: ➡️ LinkedIn: https://www.linkedin.com/in/moritz-plenz-72478a2ba ➡️ Twitter / X: https://x.com/MoritzPlenz AI Coffee Break Merch! 🛍️ https://ai-coffee-break-with-letitia.myspreadshop.de/ Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏 Dres. Trost GbR, Siltax, Vignesh Valliappan, Michael, Sunny Dhiana, Andy Ma Outline: 00:00 LLM for graphs 01:08 Motivation 02:02 Key idea of Graph LLMs 02:25 Relative Positional Encodings 03:00 Method (Graph LLMs) 04:04 Experiments and Evaluation 04:49 Results 06:07 Outro ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕ Patreon: https://www.patreon.com/AICoffeeBreak Ko-fi: https://ko-fi.com/aicoffeebreak Join this channel as a Bean Member to get access to perks: https://www.youtube.com/channel/UCobqgqE4i5Kf7wrxRxhToQA/join ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀ 🔗 Links: AICoffeeBreakQuiz: https://www.youtube.com/c/AICoffeeBreak/community X / Twitter: https://twitter.com/AICoffeeBreak LinkedIn: https://www.linkedin.com/in/letitia-parcalabescu/ Threads: https://www.threads.net/@ai.coffee.break Bluesky: https://bsky.app/profile/aicoffeebreak.bsky.social Reddit: https://www.reddit.com/r/AICoffeeBreak/ YouTube: https://www.youtube.com/AICoffeeBreak Substack: https://aicoffeebreakwl.substack.com/ #AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research Video editing: Nils Trost Music 🎵 : Space Navigator – Sarah, the Illstrumentalist