How a Robot Tests an Action Before It Moves

Machine Learning Street Talk
1,330 views •

How can a robot test an action without moving? NVIDIA's Ming-Yu Liu explains how a world model predicts the outcome first. Cosmos 3 learns three abilities together: forward dynamics (what happens after an action), inverse dynamics (which action caused a change) and policy (what the robot should do next). The results in the paper show that each one helps the others. The payoff is a closed-loop simulator. Instead of setting up a thousand kitchens, developers can check a robot policy in simulation before trying it for real. Full interview: https://youtu.be/L6tLBApQN-g Learn more about Cosmos: https://nvda.ws/4cJoY1S Explore Cosmos Lab: https://research.nvidia.com/labs/cosmos-lab/cosmos3/ This video is a paid partnership with NVIDIA.

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close