Design a Data Architecture Like I Do at Work (Part 2) | LIVE

Part 2 of our data architecture live, and this time we build one. I take a requirement, ask the questions I ask at companies, and then design the architecture live in front of you. Boxes and arrows, from an empty page to a plan I would defend in a real meeting. Bring your questions, I'm going to answer them live. 👉 Support my Channel by Sub/Like/Comment for More Content Like this https://www.youtube.com/@DataWithBaraa ━━━━━ *MY COURSES* To get certified, better clean structure & progress, support me: 🏅SQL https://www.datawithbaraa.com/course/sql-full-course-for-beginners 🏅Tableau https://www.datawithbaraa.com/course/tableau-ultimate-full-course-for-beginners *MY UDEMY COURSES* SQL: https://bit.ly/4hH947P Tableau: https://bit.ly/3xFiDDk ━━━━━ *CONNECT WITH ME* 📬 Newsletter https://www.blog.datawithbaraa.com/subscribe 👨‍💻 LinkedIn https://www.linkedin.com/in/baraa-khatib-salkini/ 📸 Instagram https://www.instagram.com/datawithbaraa/ 🎥 TikTok https://www.tiktok.com/@datawithbaraa 🌍 Website https://www.datawithbaraa.com/ 💬 Discord https://discord.gg/gsVJbMxKcA 🧭 Notion Roadmaps https://www.notion.com/@datawithbaraa ⭐ Favorite Books/Gear https://candle-gosling-511.notion.site/My-Favorite-Books-Gear-Apps-28334b251f1281e58a52cf7aa594e0e9?source=copy_link 📩 Sponsorships [email protected] ━━━━━ 📖 *Table of Content* 0:00 Intro 12:18 OLTP and OLAP: why we copy the data 22:03 LTAP: one copy, two engines 42:19 How I draw a data architecture 51:45 Separation of concerns 1:00:30 The two layers every architecture has 1:02:59 Adding a warehouse: stage, core and mart 1:15:56 Left to right or bottom to top 1:19:23 Break 1:26:29 Your questions: AI, DSA and degrees 1:39:27 Back to the drawing: the source layer 1:43:12 The data contract with the source system 1:47:05 Push, pull and the landing zone 1:55:45 CDC, APIs and the ingest layer 2:02:55 Streaming sources and Kafka 2:13:48 Bronze and silver: the rules per layer 2:26:37 Gold and the consumer contract 2:33:24 Break 2:40:41 Why drawing is a habit worth having 2:49:32 Shaping the gold for your consumers 3:08:08 One mart per customer: the trap 3:19:44 Who gets access to which layer 3:23:41 The layers you can add on top 3:25:49 What this one picture is for 3:33:25 Wrap-up and what's next *MY FREE COURSES* *SQL* https://youtu.be/SSKVgrwhzus *Python* https://www.youtube.com/playlist?list=PLNcg_FV9n7qZGfFl2ANI_zISzNp257Lwn *Tableau* https://youtu.be/UcGF09Awm4Y *Real World Data Projects* https://www.youtube.com/playlist?list=PLNcg_FV9n7qZ4Ym8ZriYT6WF8TaC2e_R7 *Data Career Roadmaps* https://www.youtube.com/playlist?list=PLNcg_FV9n7qah95jp-aPtysu7kFCbg7hd #dataarchitecture #dataarchitect #dataengineering #datawithbaraa