AI Broke the Yardstick. Now What? | Deep Geeks ep07
PUE can tell you how well a data center uses power, but not whether AI is creating value. Dr. Serena Huang sits down with Vernon Turner, IoT and Sustainability Advisor at Cognizant, and Val Bercovici, Chief AI Officer at WEKA, to break down how leaders should be measuring AI. They talk about what to measure beyond PUE, where companies should start, and how to tell whether AI is actually paying off. https://www.weka.io/podcast/ai-broke-the-yardstick-now-what *Timestamps* (0:18) Meet Vernon and Val (0:44) From watts to outcomes: why PUE falls short (5:51) Token efficiency and cost per task (8:20) Is every AI seat worth the same? (11:15) The SaaSpocalypse and the costs nobody's counting (13:36) Cloud inference and broken ROI promises (15:25) A new framework: tokens per watt to tokens per workload (19:21) Why neo clouds can't build for inference (21:51) Where to start measuring AI workloads (27:22) Getting finance, procurement, and ops to the table (29:38) Trillions of tokens and the AI payback question (31:54) Bubble wrap, not a bubble (32:44) What outcomes per token really means (37:34) Saturated benchmarks and the search for better evals (40:59) Where we'll be in six months *Links* Connect with Serena: https://www.linkedin.com/in/serenahhuangphd/ Connect with Vernon: https://www.linkedin.com/in/vernon-turner-beyond-iot/ Connect with Val: https://www.linkedin.com/in/valentinbercovici/ #WEKA #DeepGeeksPodcast #Cognizant #PUE #DataCenterEfficiency #Tokenomics #TokensPerWatt #OutcomesPerToken #AIInference #AIROI #AIWorkloads #NeoClouds #SaaSPricing #AIGovernance #AIBenchmarks