Data Governance in a Crisis: When Every Second Counts | Modern Data Engineering Pipelines

Confluent Developer
602 views •

https://confluent.io | What happens when payment systems fail at 2 PM and the team who broke it went home hours ago? It's Tuesday afternoon. Payment processing is failing across Australia. Customers are angry. The monitoring dashboards show nothing obvious. And the team who deployed the breaking change five hours ago? They're asleep in Europe. This is where data governance transforms from a theoretical checkbox into mission-critical infrastructure. Follow an on-call team as they race against time, using data catalogs, schema registries, and lineage tracking to trace encrypted PII data back through multiple services to find a single missing configuration line. See firsthand why real-time governance isn't just a nice-to-have - it's the difference between a 30-minute fix and a 24-hour disaster. This video demonstrates how modern data governance tools enable rapid incident response in production environments. Learn why traditional batch-updated governance systems would have left this team with yesterday's schemas and outdated lineage information - potentially turning a quick fix into an all-night debugging session. Discover how concepts like data stewardship, the principle of least privilege, and role-based access control aren't just compliance requirements, but practical tools that help teams solve real problems under pressure. Technologies covered: Data Catalogs, Schema Registry, Data Lineage, RBAC (Role-Based Access Control), PII Encryption, Real-time Data Governance, Apache Kafka LEARN MORE ► Confluent Developer: https://developer.confluent.io CONNECT Subscribe, if you dare: https://www.youtube.com/@ConfluentDeveloper?sub_confirmation=1 Community Slack: https://confluentcommunity.slack.com X: https://x.com/confluentinc Linkedin: https://www.linkedin.com/company/confluent GitHub: https://github.com/confluentinc Site: https://developer.confluent.io ABOUT CONFLUENT DEVELOPER Confluent Developer provides comprehensive resources for developers looking to learn about Apache Kafka®, Apache Flink®, Confluent Cloud, Confluent Platform, and any other technology related to the broader Data Streaming Platform. Content on Confluent Developer includes courses, getting started guides, topical deep-dives, patterns, tutorials, and listings of community events. Learn more at https://developer.confluent.io. #apachekafka #apacheflink #confluent

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close