NVIDIA Cosmos 3 Super With vLLM-Omni on Nebius | Cosmos Labs

Serving world models for video generation requires a different balance of latency and throughput than serving large language models. In this livestream, Nebius Physical AI team members Stewart Tong and Timothy Le examine NVIDIA Cosmos 3 Super benchmarks through vLLM-Omni on NVIDIA HGX B200 and HGX H200 systems. Their work compares four serving topologies, ranging from one eight-GPU replica to eight single-GPU replicas. See how replica count, parallelism, and concurrency affect request latency and validated video-seconds per node-hour. Learn which settings to hold constant for video generation benchmarks and how to check generated clips for file integrity and basic motion. What You'll Learn: Why faster video requests can mean less output per node How to measure latency and throughput with video-validation checks When more replicas help, and extra concurrency adds delay What NVIDIA HGX B200 and HGX H200 benchmarks show about allocating GPUs Have questions about serving NVIDIA Cosmos 3 Super for world-model video generation? Drop them in live — the NVIDIA and Nebius teams will address them during the discussion. 🎙️ New to streaming or looking to level up? Check out StreamYard and get $10 discount! 😍 https://streamyard.com/pal/d/5758513556029440