What is a Parquet file anyway? Why is Parquet good? | Nic Crane | Data Science Lab

Parquet files preserve data types, are fast to read and write, are small to store, and are column-oriented - meaning you can read just one column without reading in the entire file! So many cool things. This video will get you inspired, informed, and ready to dig in yourself to learn more. The Data Science Lab is a live weekly call. Register at pos.it/dslab! Discord invites go out each week on lives calls. We'd love to have you! It's is an open, messy space for learning and asking questions. Think of it like pair coding with a friend or two. Learn something new, and share what you know to help others grow. On this call, Nic Crane walks through what a Parquet file is, how it’s helpful, and shows on-screen what it looks like to view one in the Positron IDE. Hosting crew from Posit: Libby Heeren, Isabella Velasquez Nic Crane's socials and urls: website: https://niccrane.com/ GitHub: https://github.com/thisisnic Bluesky: https://bsky.app/profile/niccrane.bsky.social LinkedIn: https://www.linkedin.com/in/niccrane/ Resources: Nic's notes to accompany this episode: https://niccrane.com/posts/intro-to-parquet/ Scaling Up With R and Arrow, chapter on file formats: https://arrowrbook.com/files_and_formats.html Nic's GitHub repo for this episode: https://github.com/thisisnic/arrowdslab About partitioning: https://r4ds.hadley.nz/arrow.html#partitioning Nanoparquet: Nanoparquet: https://nanoparquet.r-lib.org/ Image of the inside of a Parquet file: https://arrowrbook.com/images/excalidraw/files_formats_parquet.png Positron Data Explorer feature (which reads Parquet!): https://positron.posit.co/data-explorer.html