Writing the Definitive Guide to DuckLake with Matt Martin

Hoyt Emerson | The Full Data Stack
562 views •

In this episode, we sit down with Matt Martin, Staff Engineer at State Farm Insurance, to discuss the upcoming O'Reilly book "DuckLake: The Definitive Guide" that he's co-authoring with Alex Monahan from MotherDuck. Discover why DuckLake is transforming modern data architecture and what the book covers. Topics Covered: - What is DuckLake and how it differs from Apache Iceberg and Delta Lake - Metadata management: Why storing metadata in a SQL database is a game-changer - The small file problem and how inlining solves it - DuckLake's elegant simplicity vs. Spark complexity - Real-world performance: querying terabytes in seconds - Building lakehouse architectures with less than 5 lines of code - The role of staff engineers in making architectural decisions - AI's impact on data engineering (and why it won't replace you) - Inside the book: chapters, timeline, and how to access early releases - Upcoming GitHub repository with all code examples from the book Resources: - Performance DE Substack: https://performancede.substack.com/ - Matt on LinkedIn: https://www.linkedin.com/in/mattmartin14/ - O'Reilly Book Early Access: https://motherduck.com/lp/ducklake-lakehouse-table-format-book/ My Links: - My Substack: https://thefulldatastack.substack.com/ - My LinkedIn: https://www.linkedin.com/in/hoytemerson/ - My content company: https://www.earlysignal.tech/

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close