Self-host Chroma on a VPS

A developer-friendly embedding database for AI applications, served over a simple HTTP API. Open to anyone who can reach it, so reach it from other services in this project at chroma:8000, or attach a domain only behind Basic Auth. Not published on the host.

levelrail-cli templates deploy chroma --name my-chroma

Specification

Status
Listed
Category
Database Tools
Services
chroma
Ports
8000
Volumes
1
Memory
about 512 MiB
arm64
image published
amd64
image published
Settings to fill in
none

About Chroma

A developer-friendly embedding database for AI applications, served over a simple HTTP API. Open to anyone who can reach it, so reach it from other services in this project at chroma:8000, or attach a domain only behind Basic Auth. Not published on the host. Runs as a single container from the chroma image, listening on port 8000; data is kept in named volumes.

What it deploys

Chroma runs as one service in a single Compose app, listening on port 8000, with 1 named volume mount.

ServiceImageTagPortsVolumes
chroma ghcr.io/chroma-core/chroma 1.0.0 8000 chroma_data -> /data

Before you install

  • CPU architecture. arm64 listed. Every image lists linux/arm64 in its registry manifest. That is a manifest fact, not proof the app runs on Arm.
  • Listed. It is in the catalog. Back up the data volume before changing an image tag.

Settings and environment

You do not have to fill in anything. Values are never shown here.

ServiceVariableValue
chromaANONYMIZED_TELEMETRYPreset by the template
chromaIS_PERSISTENTPreset by the template
chromaPERSIST_DIRECTORYPreset by the template

Install Chroma on a VPS

  1. Install Levelrail on a fresh VPS

    Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.

    curl -fsSL https://levelrail.com/install.sh | sudo sh
  2. Sign in

    Open the setup link, choose a password, then log the CLI in. The CLI install command is curl -fsSL https://levelrail.com/install-cli.sh | sh if the machine does not have it. See Getting started.

    levelrail-cli login --device
  3. Read the template

    Shows the entry, including its full compose.yaml.

    levelrail-cli templates get chroma
  4. Deploy it

    This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.

    levelrail-cli templates deploy chroma --name my-chroma

Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Chroma.

More in Database Tools

All Database Tools templates