Create an AI Player That Talks, Acts, and Uses Game State (Part 1) | Convai Unreal Engine Tutorial

Watch a Convai-powered AI player work with a human player to solve a two-player puzzle in Unreal Engine. In this tutorial, we build a game state-aware AI teammate inside Stack-O-Bot, a free @UnrealEngine project available on @Fab. The orange bot is the human player, and the pink bot is a Convai-powered AI teammate that can talk to the player, understand tagged objects in the scene, receive live game state, and take actions like following, moving to pressure plates, and helping with the puzzle. This is Part 1 of a two-part tutorial series. In this first part, we’ll bring the AI player into the scene, complete the character setup, enable Convai Actions, add player voice interaction, tag objects in the environment, track pressure plate states, add moving platform awareness, and test how the AI teammate coordinates with the player to solve the puzzle. The key idea is that the live game state flows into the AI character’s Dynamic Context. Tagged objects, tracked properties, and movement awareness help the character understand what is happening in the scene, such as whether a pressure plate is pressed, whether a platform is moving, and when an object state changes. This allows the AI player to reason through the puzzle logic and decide what action to take next. This is a step-by-step teaching tutorial, not just a feature highlight. We provide the project files, Delta files, setup guide, Stack-O-Bot scene link, Convai plugin setup resources, Dynamic Context documentation, and the Convai MCP tutorial used to set up the scene, so you can follow along and build the same workflow from scratch. In Part 2, we’ll extend this project with custom pickup and drop actions for the crate interaction. Timestamps: 00:00 - What we’re building: human player + AI teammate 00:38 - Full Stack-O-Bot AI teammate demo 02:05 - Part 1 overview and setup notes 02:41 - Create the AI player blueprint 04:03 - Add Convai Chatbot and character setup 05:44 - Add player voice interaction 06:46 - Enable Convai Actions and navigation 07:55 - Tag pressure plates and send game state to Dynamic Context 10:53 - Add moving platform awareness 12:43 - Test AI puzzle coordination 13:55 - Prepare the crate interaction for Part 2 14:41 - What’s coming next 14:49 - Outro Helpful links: Download the Stack-O-Bot tutorial project files, Delta files, and setup guide: https://docs.convai.com/staging/plugins-and-integrations/convai-unreal-engine-plugin/getting-started/stack-o-bot-tutorial-setup Install the Convai Unreal Engine plugin from Fab Marketplace: https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c Follow the Convai Unreal Engine setup tutorial: https://youtu.be/n-UG3nmMeZQ Read the Convai Unreal Engine installation and setup docs: https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin/getting-started Also read the detailed blog for this topic: https://convai.com/blog/ai-player-live-game-state-unreal-engine-convai-part-1 Watch the Convai MCP for Unreal workflow used to set up the scene: https://youtu.be/dQgOzt8BNIk Download the free Stack-O-Bot sample project on Fab Marketplace: https://www.fab.com/listings/b4dfff49-0e7d-4c4b-a6c5-8a0315831c9c Learn how Dynamic Context sends live game and environment updates to Convai characters in Unreal Engine: https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin/features/dynamic-context Sign up at https://convai.com to build AI characters for games, simulations, virtual worlds, XR experiences, training applications, and interactive 3D environments. Have questions or need assistance? Visit the Convai Developer Forum for setup questions, bug reports, and technical support: https://forum.convai.com Follow Convai: LinkedIn: https://www.linkedin.com/company/convaitech/ Reddit: https://www.reddit.com/r/convai/ Twitter: https://twitter.com/convaitech Instagram: https://www.instagram.com/conv.ai/ Facebook: https://www.facebook.com/ConvaiOfficial TikTok: https://www.tiktok.com/@conv.ai ArtStation: https://www.artstation.com/convai #convai #unrealengine #aicharacters #ainpc #aiplayer #gamedev #stackobot #fab #ue5 #dynamiccontext #conversationalai #virtualcharacters #gameai