Self-host Ollama + Open WebUI on a VPS
A local LLM runtime paired with a ChatGPT-style web interface, for running open models on your own hardware.
levelrail-cli templates deploy ollama-open-webui --name my-ollama-open-webuiSpecification
- Status
- Listed
- Category
- AI
- Services
- ollama-api, open-webui
- Ports
- 8080
- Volumes
- 2
- Memory
- about 2 GiB
- arm64
- image published
- amd64
- image published
- Settings to fill in
- none
- License
- not yet recorded
About Ollama + Open WebUI
A local LLM runtime paired with a ChatGPT-style web interface, for running open models on your own hardware. Runs 2 containers (ollama-api, open-webui), with open-webui listening on port 8080; data is kept in named volumes.
What it deploys
Ollama + Open WebUI runs as 2 services in a single Compose app, listening on port 8080, with 2 named volume mounts.
| Service | Image | Tag | Ports | Volumes |
|---|---|---|---|---|
| ollama-api | ollama/ollama | latest | none | ollama_data -> /root/.ollama |
| open-webui | ghcr.io/open-webui/open-webui | main | 8080 | open_webui_data -> /app/backend/data |
Before you install
- CPU architecture. arm64 listed. Every image lists linux/arm64 in its registry manifest. That is a manifest fact, not proof the app runs on Arm.
- Listed. It is in the catalog. Back up the data volume before changing an image tag.
- Host ports. It publishes port 8080 directly on the host, so open them in the VPS firewall only if you want that.
- Review. Image is not pinned to a version tag, so a redeploy can pull different code (ollama/ollama:latest).
Settings and environment
You do not have to fill in anything. Values are never shown here.
| Service | Variable | Value |
|---|---|---|
| open-webui | OLLAMA_BASE_URL | Preset by the template |
Install Ollama + Open WebUI on a VPS
-
Install Levelrail on a fresh VPS
Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.
curl -fsSL https://levelrail.com/install.sh | sudo sh -
Sign in
Open the setup link, choose a password, then log the CLI in. The CLI install command is
curl -fsSL https://levelrail.com/install-cli.sh | shif the machine does not have it. See Getting started.levelrail-cli login --device -
Read the template
Shows the entry, including its full compose.yaml.
levelrail-cli templates get ollama-open-webui -
Deploy it
This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.
levelrail-cli templates deploy ollama-open-webui --name my-ollama-open-webui
Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Ollama + Open WebUI.
Docs and upstream
More in AI
- OllamaA local LLM runtime with an HTTP API. Pull any model yourself once it's running.
- Ollama: DeepSeek-R1 7BDeepSeek's R1 distilled 7B reasoning model, served locally through Ollama's HTTP API.
- Ollama: Llama 3 8BMeta's Llama 3 8B model, served locally through Ollama's HTTP API.
- Ollama: Mistral 7BMistral's 7B instruct model, served locally through Ollama's HTTP API.
- Ollama: Phi-3 MiniMicrosoft's Phi-3 Mini (3.8B), the smallest model in this catalog, good for constrained nodes.
- Ollama: Qwen 2.5 7BAlibaba's Qwen 2.5 7B model, served locally through Ollama's HTTP API.