Multi-Control with Cosmos Transfer | Robotics Office Hours
In this session, we explore multicontrol with Cosmos Transfer and walk step-by-step through practical workflows using the Cosmos Cookbook and Brev. If you're building robotics, AV, or physical AI systems and want to scale data augmentation, improve generalization, or integrate sim-to-real pipelines, this session is for you. What We Cover - Overview of Cosmos world foundation models - Cosmos Cookbook - Multicontrol with Cosmos Transfer 2.5 Resources: - Cosmos: https://github.com/nvidia-cosmos - Cosmos Cookbook: https://nvidia-cosmos.github.io/cosmos-cookbook/index.html ---------------------------------------------------------------------------- Key Moments: 0:14 Robotics Office Hours intro 2:56 Cosmos overview (Predict, Transfer, Reason) 6:06 Real-world policy augmentation example 8:56 Multicontrol fundamentals (guidance & weights) 10:23 Edge control explained 11:14 VIZ control explained 12:21 Segmentation control explained 13:03 Depth control explained 13:20 Mask & reverse mask workflows 14:05 Prompt engineering best practices 20:54 Cosmos Cookbook intro 23:30 Generating edge modality in notebook 26:33 SAM 2 segmentation walkthrough 33:36 Filtered edge generation 41:58 Color and texture recipe 42:55 Lighting change recipe 43:30 Background replacement recipe 54:53 Omniverse + Cosmos workflow 58:08 Q&A on domain randomization 1:05:40 Cookbook and Brev details 1:15:36 Closing remarks and next steps ---------------------------------------------------------------------------- 📆 Check out the full calendar for all of our upcoming events → https://nvda.ws/3JqaWnA ---------------------------------------------------------------------------- 👥Join the Community → https://nvda.ws/3ZMfc6e #CosmosAI #PhysicalAI #Robotics #Sim2Real #IsaacSim #Omniverse #WorldFoundationModels #DataAugmentation #RobotLearning #AVDevelopment #VisionLanguageAction #Brev #DeepLearning #AIForRobotics #NVIDIA