Dask Futures Tutorial: Parallelize Python Code with Dask

Coiled
2,505 views June 27, 2023

In this lesson, we'll parallelize a custom Python workflow that scrapes, parses, and cleans data from Stack Overflow. We'll get to: - Learn how to do arbitrary task scheduling using the Dask Futures API - Utilize blocking and non-blocking distributed calculations Notebook here: https://github.com/coiled/dask-tutorial/blob/main/1-Parallelize-your-python-code_Futures_API.ipynb Tutorial repo: https://github.com/coiled/dask-tutorial/ ---- What is Dask? Dask is a free and open-source library for parallel computing in Python. Dask is a community project maintained by developers and organizations. Use Coiled for data transformation at scale with Python. Coiled is a Dask company. With Coiled's rock-solid infrastructure, you can quickly and securely create Dask clusters in your cloud account. Learn more about Coiled and get started for free https://coiled.io/start More content on our blog: https://coiled.io/blog

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close