Introducing WalShadow: Sub-second Postgres replication to ClickHouse

WalShadow replicates data from Postgres to ClickHouse by reading physical WAL and decoding changes outside the source database. In this demo, Mark Needham sets up WalShadow in ClickHouse Managed Postgres, generates events, and checks how quickly they arrive in ClickHouse. https://clickhouse.com/blog/introducing-walshadow 🔸 Configure an initial load and change data capture with WalShadow 🔸 Run an event generator targeting 50,000 events per second 🔸 Compare timestamps and see replication latency below 100 ms for the sampled rows 🔸 Check that no logical replication slots are needed 🔸 Replicate a new column and a newly created table WalShadow is open source and available in private preview for ClickHouse Managed Postgres. Find out more: https://clickhouse.com/cloud/postgres/walshadow