Dask DataFrames Tutorial: Best practices for larger-than-memory dataframes

Coiled
3,674 views June 27, 2023

Learn best practices for larger-than-memory dataframes. Investigate Uber/Lyft data and learn to do the following: - Manipulate Parquet files and optimize queries - Navigate inconvenient file sizes and data types - Tune Parquet storage, build features, and explore a challenging dataset with Pandas and Dask. Notebook here: https://github.com/coiled/dask-tutorial/blob/main/2-Get_better-at-dask-dataframes.ipynb Tutorial repo: https://github.com/coiled/dask-tutorial/ --- Scale Your Python Workloads with Dask and Coiled. Coiled is a Dask company. With Coiled's rock-solid infrastructure, you can quickly and securely create Dask clusters in your cloud account. Learn more about Coiled and get started for free https://coiled.io/start More content on our blog: https://coiled.io/blog

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close