Using OpenWebUI and Ollama On CoCalc
This illustrates how to create a GPU-backed OpenWebUI (https://openwebui.com/) server on https://CoCalc.com in a few minutes. You just configure a compute server with a GPU, enter a domain name, and click start, wait a few minutes, and it just works. In the video I show how to get a terminal on the server and inspect various log files, and otherwise poke around. This is not at all necessary though! I then use the new Meta LLama3 model to write Python code that generates a beautiful colorful spiral, and copy that code into a Jupyter notebook and run it in CoCalc. https://github.com/sagemathinc/cocalc-howto/blob/main/ollama.md