Writing the Definitive Guide to DuckLake with Matt Martin
In this episode, we sit down with Matt Martin, Staff Engineer at State Farm Insurance, to discuss the upcoming O'Reilly book "DuckLake: The Definitive Guide" that he's co-authoring with Alex Monahan from MotherDuck. Discover why DuckLake is transforming modern data architecture and what the book covers. Topics Covered: - What is DuckLake and how it differs from Apache Iceberg and Delta Lake - Metadata management: Why storing metadata in a SQL database is a game-changer - The small file problem and how inlining solves it - DuckLake's elegant simplicity vs. Spark complexity - Real-world performance: querying terabytes in seconds - Building lakehouse architectures with less than 5 lines of code - The role of staff engineers in making architectural decisions - AI's impact on data engineering (and why it won't replace you) - Inside the book: chapters, timeline, and how to access early releases - Upcoming GitHub repository with all code examples from the book Resources: - Performance DE Substack: https://performancede.substack.com/ - Matt on LinkedIn: https://www.linkedin.com/in/mattmartin14/ - O'Reilly Book Early Access: https://motherduck.com/lp/ducklake-lakehouse-table-format-book/ My Links: - My Substack: https://thefulldatastack.substack.com/ - My LinkedIn: https://www.linkedin.com/in/hoytemerson/ - My content company: https://www.earlysignal.tech/