Session 4: Building Shared Conceptual Grounding for Interacting with GenAI

The promise of modern generative AI tools is that they will assist users in creating production-quality visual content from a simple text prompt describing what the user wants. But current black-box AI are difficult to work with; the AI often misinterprets the intent of the user and users lack a predictive conceptual model for what the AI will produce given an input prompt. This mutual lack of a theory of mind leads to a collaboration by trial-and-error, where the user repeatedly tries different prompts hoping to find one that will produce the desired output. In this talk, researchers discuss how they take major steps towards allowing both entities (humans and AI) to develop a shared conceptual grounding that allows each to simulate how the other might operate given an input task. Learn more about other research supported by the Hoffman-Yee Research Grant program here: https://hai.stanford.edu/research/grant-programs/hoffman-yee-research-grants?section=2024-grant-recipients 00:00:00 Introduction 00:00:30 Lecture 00:35:49 Q&A