Self-host Open WebUI on a VPS
A self-hosted chat interface for running local large language models through Ollama.
levelrail-cli templates deploy open-webui --name my-open-webuiSpecification
- Status
- Verified on arm64 with image tag 0.11.3
- Category
- AI
- Services
- ollama, open-webui
- Ports
- 8080
- Volumes
- 2
- Memory
- about 1 GiB
- arm64
- tested
- amd64
- image published
- Settings to fill in
- none
About Open WebUI
A self-hosted chat interface for running local large language models through Ollama. Runs 2 containers (ollama, open-webui), with open-webui listening on port 8080; data is kept in named volumes.
What it deploys
Open WebUI runs as 2 services in a single Compose app, listening on port 8080, with 2 named volume mounts.
| Service | Image | Tag | Ports | Volumes |
|---|---|---|---|---|
| ollama | ollama/ollama | 0.33.3 | none | ollama_data -> /root/.ollama |
| open-webui | ghcr.io/open-webui/open-webui | 0.11.3 | 8080 | openwebui_data -> /app/backend/data |
Before you install
- CPU architecture. arm64 listed. Every image lists linux/arm64 in its registry manifest. That is a manifest fact, not proof the app runs on Arm.
- Verified. Verified on arm64 with image tag 0.11.3. Verified means our CI ran this exact image version and it answered on its health path. Evidence
- Host ports. It publishes port 8080 directly on the host, so open them in the VPS firewall only if you want that.
Settings and environment
You do not have to fill in anything. 1 secret is generated at deploy and stored encrypted. Values are never shown here.
| Service | Variable | Value |
|---|---|---|
| open-webui | OLLAMA_BASE_URL | Preset by the template |
| open-webui | WEBUI_SECRET_KEY | Generated at deploy |
Install Open WebUI on a VPS
-
Install Levelrail on a fresh VPS
Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.
curl -fsSL https://levelrail.com/install.sh | sudo sh -
Sign in
Open the setup link, choose a password, then log the CLI in. The CLI install command is
curl -fsSL https://levelrail.com/install-cli.sh | shif the machine does not have it. See Getting started.levelrail-cli login --device -
Read the template
Shows the entry, including its full compose.yaml.
levelrail-cli templates get open-webui -
Deploy it
This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.
levelrail-cli templates deploy open-webui --name my-open-webui
Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Open WebUI.
Docs and upstream
More in AI
- Open NotebookAn open source, self-hosted alternative to NotebookLM for researching with your own sources, with podcasts and chat. Add model provider keys in the app after install.
- OpenClawA self-hosted personal AI agent gateway that connects chat apps and tools to the model provider you choose. Recommended container limit is 2 GiB. Measured use is 0.9 to 1.3 GiB, so a Levelrail VM needs at least 4096 MiB. The gateway trusts the ingress proxy through gateway.trustedProxies, written once to openclaw.json in the data volume.
- Ollama: Qwen 2.5 7BAlibaba's Qwen 2.5 7B model, served locally through Ollama's HTTP API.
- Ollama: Phi-3 MiniMicrosoft's Phi-3 Mini (3.8B), the smallest model in this catalog, good for constrained nodes.
- Ollama: Mistral 7BMistral's 7B instruct model, served locally through Ollama's HTTP API.
- Ollama: Llama 3 8BMeta's Llama 3 8B model, served locally through Ollama's HTTP API.