Run Python Scripts in the Cloud with Coiled

Coiled
1,302 views July 27, 2023

Sometimes you don’t need a huge cluster for your workflows, and you just want to run your Python function on a VM in the cloud. You might want to do this for a few reasons: You want a big machine You want a GPU You want to run close to your data You want to run the script many times while scaling out With Coiled, you can run any Python function, script, or executable in your AWS or GCP account, with features like: • Automatic Python environment synchronization • Run on any region, close to your data, on any hardware • Robust logging, cost controls, and metrics • Autoscaling to a cluster based on computational needs • No additional cloud infrastructure required (like Kubernetes) Read more about Coiled run and Coiled functions: Blog Post: How to Train a Neural Network on a GPU in the Cloud with Coiled Functions https://medium.com/coiled-hq/how-to-train-a-neural-network-on-a-gpu-in-the-cloud-with-coiled-functions-40fa9aca723b Coiled Docs: https://docs.coiled.io/user_guide/usage/functions/index.html https://docs.coiled.io/user_guide/usage/run/index.html Get started with Coiled for free: https://coiled.io/start Key Moments 00:00 Intro 01:19 How Coiled Run works 02:39 Run a Script Close to Your Data 03:36 Use VM with GPUs 04:20 AWS Lambda Example 07:20 Run in Parallel 10:15 Easy to Use 10:31 Flexible 10:52 Scalable 11:05 Cheap 11:50 Hopefully this is Useful for You 12:28 Outro

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close