Build Photorealistic Isaac Sim Environments with Gaussian Splatting
Learn how to create photorealistic training environments for Isaac Sim in minutes instead of weeks using three modern Gaussian Splatting workflows. In this livestream, we’ll demonstrate how to: - Generate synthetic environments from text and images using World Labs’ Marble - Capture real-world spaces with NVIDIA’s FVDB reality capture pipeline - Digitize room-scale environments using the XGRIDS SLAM scanner You’ll see how each approach produces simulation-ready assets that integrate directly into Isaac Sim, enabling faster iteration, greater environmental diversity, and more realistic scenarios for robot training, reinforcement learning, and sim-to-real workflows. Whether you’re building robotics simulations from scratch or scaling dataset diversity for training and evaluation, this session will show practical, end-to-end techniques for turning real and synthetic spaces into high-fidelity simulation environments. ---------------------------------------------------------------------------- Key Moments: 0:19 Introduction and session overview 2:20 Guest intro: Jonathan Stevens (Lightwheel) 3:50 Embodied AI data pipeline overview 8:28 Scaling environments for robot training 13:55 Gaussian splatting explained 16:59 World Labs Marble workflow 20:01 Digital cousin environments and rapid variation 23:52 Converting splats to USD with 3D GRUT 26:33 FBDB Reality Capture pipeline 31:36 Generating splats and meshes 36:17 Importing environments into Isaac Sim 39:53 XGRIDS LIDAR capture workflow 44:27 Comparing generation methods 48:48 Live Q&A 1:00:07 Hardware considerations (cloud vs local GPUs) 1:04:26 Study groups and learning resources 1:18:48 GTC and community updates ---------------------------------------------------------------------------- 📆 Check out the full calendar for all of our upcoming events → https://nvda.ws/3JqaWnA ---------------------------------------------------------------------------- ⬇️Get Started → https://nvda.ws/4cZAZO1 👀Explore OpenUSD → https://nvda.ws/3CeozBQ 👥Join the Community → https://nvda.ws/3ZMfc6e #IsaacSim #Robotics #GaussianSplatting #Sim2Real #EmbodiedAI #DigitalTwins #RobotLearning #VisionLanguageAction #PhysicsSimulation #WorldModels #OpenUSD #DeveloperCommunity #Lightwheel #NeuralReconstruction #GTC2026