How Prosus Serves more than 200 Billion Tokens a Day on Nebius Token Factory

Prosus builds platforms that connect merchants and consumers in food delivery, grocery and pharmacy, and serves over 1 billion users. Its AI team trains large commerce models, which learn from what people do on Prosus platforms. In this story, Euro Beinat, Chief AI Officer at Prosus, explains how its large commerce models (LCMs), built together with Nebius, increase conversion and reduce the cost of acquiring customers. Dr. Zülküf Genç, Senior Director of AI, and Floris Fok, Staff AI Engineer, describe how Nebius Token Factory serves over 200 billion tokens a day, with auto-scaling that follows ordering peaks, and how the models learn continuously to improve the economics and prepare for what comes next. The Nebius Token Factory team doubled throughput, so Prosus now gets twice the tokens for the same price. Euro closes with his advice to every team: experiment continuously. Learn more about Nebius Token Factory: https://nebius.com/services/token-factory Learn more about Prosus: https://www.prosus.com