Spark Real-Time Observability | RTA Summit 2025

Development of an observability tool for Spark monitoring exporting real-time stage metrics into Pinot. LEARN MORE ► Learn about StarTree and Apache Pinot™: https://docs.startree.ai/ CONNECT Subscribe on YouTube: https://stree.ai/sub Community Slack: https://stree.ai/join-slack Twitter: https://twitter.com/startreedata Linkedin: https://www.linkedin.com/company/startreedata GitHub: https://github.com/startreedata Site: https://startree.ai ABOUT STARTREE StarTree, powered by Apache Pinot™, is the platform for continuous insights at scale. StarTree turns raw data streams—like clickstreams, logs, vector embeddings, and sensor data—into real-time analytics. It powers customer-facing data products, agent-facing data products, and operational intelligence. Apache Pinot™ delivers real-time analytics by design, rather than extension—built from the ground up to ingest massive data streams with millisecond freshness, execute sub-second aggregations, and support tens of thousands of queries per second. Pinot achieves this while radically reducing infrastructure costs by scanning less data and extreme compression. StarTree was founded by the core software engineering team and inventors of Apache Pinot™, which currently powers hundreds of user-facing applications at companies across industries, including Uber, LinkedIn, Stripe, Target, 7Eleven, NuBank, Etsy, Walmart, Together AI, and more. #apachepinot #realtimeanalytics #startree