Data Mesh: Transforming Real-Time Analytics at Netflix | RTA Summit 2025

In this talk, Sujay Jain will delve into the transformative journey of building a state-of-the-art Data Mesh at Netflix, a platform that processes trillions of events daily to power various business-critical applications. Attendees will gain insights into how Netflix leverages this distributed, real-time data movement and processing infrastructure to deliver personalized user experiences, from real-time recommendations to game analytics, live events, and ad processing. The core of the discussion will be on how the Data Mesh at Netflix operates at scale with about 20,000 Apache Flink jobs and manages thousands of Kafka topics. Sujay will explore the challenges faced in developing such a robust system, particularly focusing on scaling, reliability, and the intricacies of managing high-throughput, low-latency data streams. Participants will learn about the innovative use of Streaming SQL, which Sujay led, to democratize stream processing, allowing platform users to perform complex data transformations with ease. Furthermore, Sujay will share the experiences of integrating next-generation streaming connectors, emphasizing the integration with Apache Iceberg and Kafka. This talk will also cover strategic leadership techniques employed in setting the development roadmap and driving planning and prioritization within technical teams. LEARN MORE ► Learn about StarTree and Apache Pinot™: https://docs.startree.ai/ CONNECT Subscribe on YouTube: https://stree.ai/sub Community Slack: https://stree.ai/join-slack Twitter: https://twitter.com/startreedata Linkedin: https://www.linkedin.com/company/startreedata GitHub: https://github.com/startreedata Site: https://startree.ai ABOUT STARTREE StarTree, powered by Apache Pinot™, is the platform for continuous insights at scale. StarTree turns raw data streams—like clickstreams, logs, vector embeddings, and sensor data—into real-time analytics. It powers customer-facing data products, agent-facing data products, and operational intelligence. Apache Pinot™ delivers real-time analytics by design, rather than extension—built from the ground up to ingest massive data streams with millisecond freshness, execute sub-second aggregations, and support tens of thousands of queries per second. Pinot achieves this while radically reducing infrastructure costs by scanning less data and extreme compression. StarTree was founded by the core software engineering team and inventors of Apache Pinot™, which currently powers hundreds of user-facing applications at companies across industries, including Uber, LinkedIn, Stripe, Target, 7Eleven, NuBank, Etsy, Walmart, Together AI, and more. #apachepinot #realtimeanalytics #startree