Agent Skills for Isaac Sim and Isaac Lab | Robotics Office Hours
Join us for this week's Robotics Office Hours as we explore Agent Skills for NVIDIA Isaac Sim and Isaac Lab. Learn how agentic workflows simplify robotics development by accelerating simulation setup and streamlining training and evaluation workflows. We'll demonstrate how Agent Skills can help developers build robotics applications faster, reduce repetitive work, and integrate more naturally into Isaac Sim and Isaac Lab development. As always, the session includes live demos, practical tips from NVIDIA experts, and live Q&A with the community. Whether you're building robot simulations, training policies, or developing embodied AI applications, you'll leave with actionable techniques you can apply to your own robotics workflows. ---------------------------------------------------------------------------- Chapters: 0:00 Welcome to Agent Skills for Isaac Sim and Isaac Lab 1:52 Isaac Quickstart Companion for New Robotics Developers 4:19 AGENTS.md, SKILL.md, and Source Authority 6:06 Runtime Tools and Explain Diff for Isaac Workflows 9:16 DGX Spark Live Demo Setup 12:09 Running Isaac Lab Training With Agents 18:34 Q&A: Repository, Docker Headless, and WebRTC 21:04 Agent Skills, MCP, and Model Choice 25:19 Isaac Lab Robot Training Step by Step 29:11 Hardware, Microcontrollers, RTX 4090, and DGX Spark 36:16 Isaac Sim Skills and Remote Python Server 42:19 Agent-Driven Scene Creation and Physics Validation 46:04 URDF Robot Import and Agent Debugging 51:59 Isaac Lab Skills, Newton Backend, and RL Training 57:46 Q&A: Physics Meshes, USD Layers, and Robot Guardrails 1:02:34 Multi-GPU Training, Isaac Lab 3.0, and Wrap-Up ---------------------------------------------------------------------------- List of Resources - Isaac Sim Skills (agent skills shown in the Isaac Sim demo) - https://github.com/isaac-sim/IsaacSim/tree/main/skills - Isaac Sim Skills Index (searchable inventory of Isaac Sim skills) - https://github.com/isaac-sim/IsaacSim/blob/main/skills/SKILLS.md - Isaac Lab Skills (agent skills discussed in the Isaac Lab demo) - https://github.com/isaac-sim/IsaacLab/tree/develop/skills - Isaac Sim Python Server (remote runtime control for agents) - https://docs.isaacsim.omniverse.nvidia.com/latest/development_tools/python_server.html - Getting Started With Isaac Sim (learning resource shared in chat) - https://docs.nvidia.com/learning/physical-ai/getting-started-with-isaac-sim/latest/index.html - Isaac Lab Multi-GPU and Multi-Node Training (distributed training docs shared in chat) - https://isaac-sim.github.io/IsaacLab/develop/source/features/multi_gpu.html - Getting Started With Isaac Lab (first robot training and RL workflow learning path) - https://docs.nvidia.com/learning/physical-ai/getting-started-with-isaac-lab/latest/index.html - Isaac Lab Docker and Cloud Workflows (Docker, headless, cloud, and large-scale training follow-up) - https://isaac-sim.github.io/IsaacLab/develop/source/features/docker_cloud.html - Isaac Sim Requirements (hardware guidance for DGX Spark and workstation questions) - https://docs.isaacsim.omniverse.nvidia.com/latest/installation/requirements.html Continue the discussion and ask follow-up questions in the NVIDIA Omniverse Discord thread: https://discord.com/channels/827959428476174346/1534055327274766457 ---------------------------------------------------------------------------- 📆 Check out the full calendar for all of our upcoming events → https://nvda.ws/3JqaWnA ---------------------------------------------------------------------------- ⬇️Get Started → https://nvda.ws/4cZAZO1 👀Explore OpenUSD → https://nvda.ws/3CeozBQ 👥Join the Community → https://nvda.ws/3ZMfc6e #NVIDIA #NVIDIAOmniverse #IsaacSim #IsaacLab #Robotics #Simulation #PhysicalAI #AgenticAI #DeveloperTools #OpenUSD #ReinforcementLearning #DigitalTwins #DGXSpark