Boring by Design: Character.AI runs 5GBps on WarpSteam and saves 90% | Life Is But A Stream

What does it take to run real-time safety checks on every prompt sent to an AI companion platform serving 60 million monthly users? For Character.AI, the answer was rethinking the entire data pipeline—without rethinking the budget. By building on WarpStream's Kafka-compatible, bring-your-own-cloud architecture, the team found a way to process massive prompt and response payloads in near real time, at a fraction of the cost of traditional Kafka. In this episode, Maor Bril, Chaos Catalyst & Technical Staff Member at Character.AI, joins Joseph Morais to break down how WarpStream's agent-based, object-storage-backed design let a small team capture full prompts and responses for safety classification and model A/B testing, route client and server events without added infrastructure, and even build a custom feature store with Bento-powered Managed Pipelines—all while running on otherwise idle GPU-node CPUs. You'll Learn: How a Kafka-compliant, BYOC architecture cut Character.AI's streaming costs by 85–90% Why trading a few seconds of latency unlocked massive savings and simpler operations How to repurpose idle GPU-node compute to run data pipelines at zero marginal cost About the Guest: Maor Bril is Chaos Catalyst & Technical Staff Member at Character.AI, where he has spent over two years leading infrastructure and product efforts beyond core one-on-one chat, including data pipelines, labs initiatives, and new product lines. He originally built much of Character.AI's data infrastructure and continues to work across platform, safety, and experimentation systems supporting the company's AI entertainment platform. Guest Highlight: "WarpStream is the most boring product I've ever got to work with. In infra, that's the biggest compliment you can ever give someone. It just works." Chapters: [00:11] Character.AI Intro [02:04] Data Streaming Goodness [18:22] Beyond the Stream [26:14] Quick Bytes [30:06] Joseph’s Top Takeaways Get Connected: Connect with Joseph: @TheDataGiant Joseph’s LinkedIn: http://linkedin.com/in/thedatagiant Maor’s LinkedIn: https://www.linkedin.com/in/maorbril/ Our Sponsor: Your data shouldn’t be a problem to manage. It should be your superpower. The Confluent data streaming platform transforms organizations with trustworthy, real-time data that seamlessly spans your entire environment and powers innovation across every use case. Create smarter, deploy faster, and maximize efficiency with a true data streaming platform from the pioneers in data streaming. Learn more at confluent.io. ABOUT CONFLUENT Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit https://www.confluent.io/ #confluent #apachekafka #kafka