Dask + Pandas for Parallel ETL

Dask and Pandas work together to provide intuitive data processing at very large scale. This video loads a few hundred gigabytes of Parquet data loaded from Amazon S3, and then does some basic analysis. It gives a sense for how Dask and Pandas are used together. If you want to play with this by yourself, the notebook lives here: https://github.com/coiled/examples Key Moments 00:00 Intro 00:40 Load Parquet Data 02:32 Explore Data 08:13 Dataframe Documentation 09:10 Get Machines 11:45 Next Steps --- Scale Your Python Workloads with Dask and Coiled. Coiled is a Dask company. With Coiled's rock-solid infrastructure, you can quickly and securely create Dask clusters in your cloud account. Learn more about Coiled and get started for free https://coiled.io/start More content on our blog: https://coiled.io/blog