Using OpenWebUI and Ollama On CoCalc

William Stein
546 views April 18, 2024

This illustrates how to create a GPU-backed OpenWebUI (https://openwebui.com/) server on https://CoCalc.com in a few minutes. You just configure a compute server with a GPU, enter a domain name, and click start, wait a few minutes, and it just works. In the video I show how to get a terminal on the server and inspect various log files, and otherwise poke around. This is not at all necessary though! I then use the new Meta LLama3 model to write Python code that generates a beautiful colorful spiral, and copy that code into a Jupyter notebook and run it in CoCalc. https://github.com/sagemathinc/cocalc-howto/blob/main/ollama.md

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close