What is Workflow Orchestration? Data Engineering Zoomcamp - 2.1.1

Welcome to Module 2 of the Data Engineering Zoomcamp! During this module, we’ll dive into workflow orchestration using Kestra, why it's important, and how it can be used to build data engineering pipelines. In this video, you’ll learn the foundations of workflow orchestration, its importance, and how Kestra fits into the orchestration landscape. 🚀 Try Kestra for free: https://go.kestra.io/yt/try-kestra 👨‍💻 Check out the Data Engineering Zoomcamp GitHub Repository here: https://go.kestra.io/de-zoomcamp Kestra is an open-source, event-driven orchestration platform that simplifies building both scheduled and event-driven workflows. By adopting Infrastructure as Code practices for data and process orchestration, Kestra enables you to build reliable workflows with just a few lines of YAML. Timestamps 0:00 - Introduction 0:10 - What will be covered in Module 2? 1:40 - Ask Questions in the Slack Community 1:53 - Orchestration in Music Terms 2:43 - Orchestration in Tech Terms 3:43 - What is Workflow Orchestration? 4:23 - Use Case 4:43 - Summary ---------- 📖 Read the documentation: https://go.kestra.io/docs ⭐ Start your journey with Kestra: https://go.kestra.io/github 💬 Join the Kestra Community: https://go.kestra.io/slack