High-Performance Full Text Search Directly on Iceberg via Lucene-Integrated Indexing

Data lakehouses like Apache Iceberg offer massive scalability and cost efficiency, but they are often scan-heavy and not optimized for sub-second, “needle-in-a-haystack” full-text search. In this technical webinar, we explore how Apache Pinot enables high-performance full-text search directly on Apache Iceberg by integrating Lucene indexes with Iceberg/Parquet data. You’ll learn how Pinot can reduce scan-heavy queries without heavy re-ingestion or data duplication, while keeping Apache Iceberg as the source of truth. The session covers how Lucene segments can be integrated into Pinot’s distributed serving layer to power fast selective lookups and full-text search across lakehouse data. Topics covered: Segment-to-Parquet virtualization over remote Iceberg/Parquet files Pinning Lucene inverted and text indexes to local NVMe storage Query planning techniques that minimize S3 time-to-first-byte How Apache Pinot complements Apache Iceberg for low-latency analytics Using Lucene-integrated indexing for fast full-text search on lakehouse data LEARN MORE ► Learn about StarTree and Apache Pinot™: https://docs.startree.ai/ CONNECT Subscribe on YouTube: https://stree.ai/sub Community Slack: https://stree.ai/join-slack Twitter: https://twitter.com/startreedata Linkedin: https://www.linkedin.com/company/startreedata GitHub: https://github.com/startreedata Site: https://startree.ai ABOUT STARTREE StarTree, powered by Apache Pinot™, is the platform for continuous insights at scale. StarTree turns raw data streams—like clickstreams, logs, vector embeddings, and sensor data—into real-time analytics. It powers customer-facing data products, agent-facing data products, and operational intelligence. Apache Pinot™ delivers real-time analytics by design, rather than extension—built from the ground up to ingest massive data streams with millisecond freshness, execute sub-second aggregations, and support tens of thousands of queries per second. Pinot achieves this while radically reducing infrastructure costs by scanning less data and extreme compression. StarTree was founded by the core software engineering team and inventors of Apache Pinot™, which currently powers hundreds of user-facing applications at companies across industries, including Uber, LinkedIn, Stripe, Target, 7Eleven, NuBank, Etsy, Walmart, Together AI, and more. #apachepinot #realtimeanalytics #startree