Data engineering
Pipelines, lakehouses, warehouses, streaming and the platforms that move data
Latest stories See all →
- Top 30 Databricks RAG Interview Questions and Answers for 2026
- Are AI Agents Going to Shrink the Data Engineering Job Market?
- Apache Spark: Managing Spark Sessions, Partitions, AQE, and Broadcast Variables
- Your Dashboard Was Right Yesterday. Why Is It Wrong Today?
- AWS + Snowflake: What’s New and How to Build More Productive Data and AI Workflows
- Databricks and SAP unleash end-to-end data & AI capabilities to level up enterprise AI transformation
- Part XIX — Spark on Kubernetes: Executor Sizing and Dynamic Allocation
- 3 Data Ingestion Patterns Every Data Engineer Should Know
- How to Modernize Commercial P&C Submission Ingestion Supported by Context Generation Without Losing Underwriter Control
- Data 360 × Snowflake: Powering the Agentic Enterprise with Zero Copy
- Sampling Rows with SQL Queries
- Data Storage Architectures with Databricks: From Raw Data to Business-Ready Insights
- The Missing AI Layer in Your Iceberg Lakehouse
- The Shape of the Math: How PyGAM Exposed the Hidden Curve Inside 802,000 Medicare Claims
- Polars 2.0 vs DuckDB 2.0
- How Much Does a Customer Data Platform Cost? A Total Cost Breakdown
- Share Delta Lake Tables Between Databricks and Snowflake
- When Tools Aren’t Enough: What Our AI Agent Project Taught Us About CDC (and Why Experience Still…
- Tiny world model generates games and stream ac plays them all on Pico 2W #PiDay
- A Martech Perspective on Databricks’ New CDP Capability
- Should Developers Switch From SQLite to DuckDB?
- Windsor.ai vs Supermetrics: the Plan Limits That Decide Your Bill
- dbt Charts: The Markdown of dashboards
- ODNI seeks economic data platform
Videos
- Preparing a CFO performance review with Genie One on Databricks | Genie Demo
- Build a Data Warehouse From Scratch! dlt, dbt and MotherDuck Project
- AI, ML, and Data Engineering InfoQ Trends Report 2026
- Openreach drives towards a greener, more connected future with Gemini and BigQuery
- The AI-First Seller: How Databricks Rebuilt Its Sales DNA at $190B with CRO Ron Gabrisko
- Databricks vs Snowflake vs Fabric: Which One to Learn?
- Governing AI Agents with Unity Catalog and Unity Gateway on Databricks | Unity Catalog Demo
- Databricks Pipelines: Write to One Unity Catalog Table from Multiple Sources with FLOWs
- How Repsol Democratizes AI With Databricks Genie | Data + AI Executive Series: Fast 5
- I Tested Google’s TimesFM 3 in BigQuery Against a Traditional Model (leans into the head-to-head)
- Building Reliable Data Pipelines with Lakeflow on Databricks | Lakeflow Demo
- dbt for Beginners | What the SQL code actually looks like
Podcasts
- Talk Python To Me
- The Data Engineering Podcast
- MLOps Community
- Software Engineering Daily
- Data Engineering Weekly
- Data Mesh Radio
- AI Engineering Podcast
- The Python Podcast.__init__
- Data Engineering Central Podcast
- The Data Flowcast
- The Engineering Side of Data
- Data Brew by Databricks
Recent episodes
- AI, ML, and Data Engineering InfoQ Trends Report 2026
- dbt Charts: The Markdown of dashboards
- Why AI Alone Can’t Fix Your Sh*tty Data Models w/ Kyle Nesbit (Credible Data)
- Orchestrating cloud data migrations at HCL Tech
- The future is Postgres (Interview)
- The future is Postgres (Interview)
- SaaStr 884: The AI-First Seller: How Databricks Rebuilt Its Sales DNA at $190B with CRO Ron Gabrisko
- Managing AI Coding Costs at Scale
- Managing AI Coding Costs at Scale
- Managing AI Coding Costs at Scale
- Managing AI Coding Costs at Scale
- Building self-service Dags with GitHub Actions at Lyft