Automatically Annotate, Tag & Describe 3D Worlds with Convai Scene Tagger | Unreal Engine Tutorial

Learn how to analyze, tag, review, and annotate an entire Unreal Engine environment using Convai Scene Tagger. Large 3D projects can contain hundreds or even thousands of objects that need meaningful names, descriptions, and context. Manually going through every important object and adding this information can take a significant amount of time. Convai Scene Tagger helps automate this process by analyzing your environment, identifying significant objects, capturing useful views, and generating relevant names and descriptions. You can then review the results, refine anything that needs attention, and apply that information directly across your project. In this Unreal Engine tutorial, we use a museum as the example environment and analyze the entire level with Scene Tagger. We configure the character used for analysis, optionally bring in Knowledge Bank content for additional context, scan the level, and review the generated annotations. We also cover how to correct inaccurate views, add notes to improve object identification, reanalyze individual or multiple objects, remove irrelevant captures, and apply the final results to the scene. Once applied, Scene Tagger adds Convai Object components to the selected actors along with their generated names and descriptions. The museum is only an example. The same workflow can be used across games, training environments, guided experiences, simulations, virtual worlds, and other 3D projects where AI systems need structured information about the objects in the environment. At the end of the tutorial, we test the tagged scene with a Convai character and use the debug view to verify object information and spatial relationships inside the environment. TIMESTAMPS: 00:00 Why Scene Tagging Matters in Large 3D Environments 00:26 Introducing Convai Scene Tagger 01:22 Setting Up Scene Tagger and Character Context 02:24 Describing the Environment and Analysis Options 04:31 Analyzing the Entire Level 05:13 Reviewing and Refining Generated Results 06:21 Reanalyzing Objects with Notes and Better Views 07:21 Removing Irrelevant Objects and Fixing Captures 09:25 Applying Scene Tagger Results to the Project 10:22 Testing the Tagged Environment with a Convai Character 11:26 Debugging Scene Information and Spatial Relationships 12:41 Recap and Outro RELEVANT LINKS: Convai Unreal Engine Installation and Setup Tutorial: https://youtu.be/n-UG3nmMeZQ Convai Unreal Engine Documentation: https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview Scene Auto Tagger Documentation: https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin/features/scene-metadata/scene-auto-tagger Read the detailed blog for Scene Auto-Tagger here: https://convai.com/blog/convai-scene-tagger-unreal-engine-automatic-3d-scene-annotation Sign up at https://convai.com to build AI characters for games, simulations, virtual worlds, XR experiences, training applications, and interactive 3D environments. Have questions or need assistance? Visit the Convai Developer Forum for setup questions, bug reports, and technical support: https://forum.convai.com Subscribe for more tutorials on building conversational, scene-aware, and interactive AI characters for Unity, Unreal Engine, XR, games, simulations, and 3D virtual worlds. #Convai #UnrealEngine #SceneTagger #AICharacters #EmbodiedAI Follow Convai: LinkedIn: https://www.linkedin.com/company/convaitech/ Reddit: https://www.reddit.com/r/convai/ Twitter: https://twitter.com/convaitech Instagram: https://www.instagram.com/conv.ai/ Facebook: https://www.facebook.com/ConvaiOfficial TikTok: https://www.tiktok.com/@conv.ai ArtStation: https://www.artstation.com/convai