Python Extensibility & Marketplace Reusability Demo

For your most difficult data challenges and edge use cases, Prophecy goes beyond built-in Spark functions by letting you extend pipelines with custom Python dependencies from PyPI. In this technical demo, you’ll see an example of how to add and manage dependencies, create Python UDFs, and automatically install missing libraries on your Databricks cluster. We’ll highlight how Prophecy packages these dependencies for CI/CD and keeps development and production environments in sync. Finally, you’ll see the Package Hub in action. Learn more about Prophecy Enterprise here: https://www.prophecy.ai/enterprise