Self-host Ollama + Open WebUI on a VPS

A local LLM runtime paired with a ChatGPT-style web interface, for running open models on your own hardware.

levelrail-cli templates deploy ollama-open-webui --name my-ollama-open-webui

Specification

Status
Listed
Category
AI
Services
ollama-api, open-webui
Ports
8080
Volumes
2
Memory
about 2 GiB
arm64
image published
amd64
image published
Settings to fill in
none
License
not yet recorded

About Ollama + Open WebUI

A local LLM runtime paired with a ChatGPT-style web interface, for running open models on your own hardware. Runs 2 containers (ollama-api, open-webui), with open-webui listening on port 8080; data is kept in named volumes.

What it deploys

Ollama + Open WebUI runs as 2 services in a single Compose app, listening on port 8080, with 2 named volume mounts.

ServiceImageTagPortsVolumes
ollama-api ollama/ollama latest none ollama_data -> /root/.ollama
open-webui ghcr.io/open-webui/open-webui main 8080 open_webui_data -> /app/backend/data

Before you install

  • CPU architecture. arm64 listed. Every image lists linux/arm64 in its registry manifest. That is a manifest fact, not proof the app runs on Arm.
  • Listed. It is in the catalog. Back up the data volume before changing an image tag.
  • Host ports. It publishes port 8080 directly on the host, so open them in the VPS firewall only if you want that.
  • Review. Image is not pinned to a version tag, so a redeploy can pull different code (ollama/ollama:latest).

Settings and environment

You do not have to fill in anything. Values are never shown here.

ServiceVariableValue
open-webuiOLLAMA_BASE_URLPreset by the template

Install Ollama + Open WebUI on a VPS

  1. Install Levelrail on a fresh VPS

    Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.

    curl -fsSL https://levelrail.com/install.sh | sudo sh
  2. Sign in

    Open the setup link, choose a password, then log the CLI in. The CLI install command is curl -fsSL https://levelrail.com/install-cli.sh | sh if the machine does not have it. See Getting started.

    levelrail-cli login --device
  3. Read the template

    Shows the entry, including its full compose.yaml.

    levelrail-cli templates get ollama-open-webui
  4. Deploy it

    This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.

    levelrail-cli templates deploy ollama-open-webui --name my-ollama-open-webui

Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Ollama + Open WebUI.

More in AI

All AI templates