Databricks Lakeflow Designer: Build a No-Code Data Prep Pipeline with Genie (AI Prompt-to-Flow)
Databricks Lakeflow Designer is a no-code, AI-first data preparation tool built directly into your workspace, and in this video I show you how to go from a single Genie prompt to a full, running transformation flow. No SQL, no Python, just plain English describing what you want the data to do. 🔥 WHAT YOU WILL LEARN ───────────────────────────────────── ✅ What Lakeflow Designer is and where to find it in your workspace ✅ The drag-and-drop canvas, operators, and how data flows left to right ✅ How to add sources from Unity Catalog or upload CSVs ✅ How Genie turns one prompt into a full multi-step transformation flow ✅ Filtering, joining, and aggregating data with zero code ✅ Building churn risk categories from ticket counts using AI transformations ✅ Previewing every step before committing to the full run ✅ Viewing the generated code behind each operator ✅ Unity Catalog-governed outputs and how lineage and permissions carry through ✅ Scheduling your flow on serverless or cluster compute Lakeflow Designer is now Generally Available and included in your existing Databricks workspace. It requires Unity Catalog and AI Assistive features enabled, there's no separate per-seat license, you only pay for compute. ───────────────────────────────────── ⏱ CHAPTERS ───────────────────────────────────── 00:00 Welcome and Overview 01:10 Docs and Key Benefits 03:00 Finding the Designer UI 04:07 UI Tour and Operators 05:58 Genie Prompting Basics 06:28 Data Sources and Uploads 08:05 Walkthrough Example Flow 09:42 Prompt Breakdown and Steps 12:14 Previewing Each Step 13:06 Generated Code and Governance 14:07 Scheduling and Compute Options 16:02 Final Output and Wrap Up ───────────────────────────────────── 🔗 RESOURCES ───────────────────────────────────── ↗ What is Lakeflow Designer → https://docs.databricks.com/aws/en/designer/what-is-lakeflow-designer ↗ How to build a Visual data prep → https://docs.databricks.com/aws/en/designer/build-transformation ↗ Built-in operators reference → https://docs.databricks.com/aws/en/designer/built-in-operators ↗ Lakeflow GA announcement (Data + AI Summit) → https://www.databricks.com/blog/lakeflow-new-era-agentic-data-engineering ↗ Product page → https://www.databricks.com/product/data-engineering/lakeflow-designer ☕ Ko-fi: https://ko-fi.com/datasciencebasics ✌️ Patreon: https://www.patreon.com/datasciencebasics ──────────────────────────────────────────────────────────────── 🤝 Connect with me: 📺 Youtube: https://www.youtube.com/@datasciencebasics?sub_confirmation=1 👔 LinkedIn: https://www.linkedin.com/in/sudarshan-koirala/ 🐦 Twitter: https://twitter.com/mesudarshan 🔉 Medium: https://medium.com/@sudarshan-koirala 💼 Consulting: https://topmate.io/sudarshan_koirala #datasciencebasics #lakeflowdesigner #databricks #nocodeai