Self-host Ollama: Llama 3 8B on a VPS
Meta's Llama 3 8B model, served locally through Ollama's HTTP API.
levelrail-cli templates deploy ollama-llama3 --name my-ollama-llama3Specification
- Status
- Listed
- Category
- AI
- Services
- ollama
- Ports
- 11434
- Volumes
- 1
- Memory
- about 7 GiB
- arm64
- image published
- amd64
- image published
- Settings to fill in
- none
- License
- Permissive license, MIT
About Ollama: Llama 3 8B
Meta's Llama 3 8B model, served locally through Ollama's HTTP API. Runs as a single container from the ollama image, listening on port 11434; data is kept in named volumes.
What it deploys
Ollama: Llama 3 8B runs as one service in a single Compose app, listening on port 11434, with 1 named volume mount.
| Service | Image | Tag | Ports | Volumes |
|---|---|---|---|---|
| ollama | ollama/ollama | 0.33.3 | 11434 | ollama_data -> /root/.ollama |
Before you install
- CPU architecture. arm64 listed. Every image lists linux/arm64 in its registry manifest. That is a manifest fact, not proof the app runs on Arm.
- Listed. It is in the catalog. Back up the data volume before changing an image tag.
- Host ports. It publishes port 11434 directly on the host, so open them in the VPS firewall only if you want that.
Settings and environment
The catalog lists no environment variables for this template.
Install Ollama: Llama 3 8B on a VPS
-
Install Levelrail on a fresh VPS
Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.
curl -fsSL https://levelrail.com/install.sh | sudo sh -
Sign in
Open the setup link, choose a password, then log the CLI in. The CLI install command is
curl -fsSL https://levelrail.com/install-cli.sh | shif the machine does not have it. See Getting started.levelrail-cli login --device -
Read the template
Shows the entry, including its full compose.yaml.
levelrail-cli templates get ollama-llama3 -
Deploy it
This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.
levelrail-cli templates deploy ollama-llama3 --name my-ollama-llama3
Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Ollama: Llama 3 8B.
Docs and upstream
More in AI
- Ollama: DeepSeek-R1 7BDeepSeek's R1 distilled 7B reasoning model, served locally through Ollama's HTTP API.
- Ollama: Mistral 7BMistral's 7B instruct model, served locally through Ollama's HTTP API.
- Ollama + Open WebUIA local LLM runtime paired with a ChatGPT-style web interface, for running open models on your own hardware.
- Ollama: Phi-3 MiniMicrosoft's Phi-3 Mini (3.8B), the smallest model in this catalog, good for constrained nodes.
- OllamaA local LLM runtime with an HTTP API. Pull any model yourself once it's running.
- Ollama: Qwen 2.5 7BAlibaba's Qwen 2.5 7B model, served locally through Ollama's HTTP API.