Self-host Chroma on a VPS
A developer-friendly embedding database for AI applications, served over a simple HTTP API. Open to anyone who can reach it, so reach it from other services in this project at chroma:8000, or attach a domain only behind Basic Auth. Not published on the host.
levelrail-cli templates deploy chroma --name my-chromaSpecification
- Status
- Listed
- Category
- Database Tools
- Services
- chroma
- Ports
- 8000
- Volumes
- 1
- Memory
- about 512 MiB
- arm64
- image published
- amd64
- image published
- Settings to fill in
- none
- License
- Permissive license, Apache-2.0
About Chroma
A developer-friendly embedding database for AI applications, served over a simple HTTP API. Open to anyone who can reach it, so reach it from other services in this project at chroma:8000, or attach a domain only behind Basic Auth. Not published on the host. Runs as a single container from the chroma image, listening on port 8000; data is kept in named volumes.
What it deploys
Chroma runs as one service in a single Compose app, listening on port 8000, with 1 named volume mount.
| Service | Image | Tag | Ports | Volumes |
|---|---|---|---|---|
| chroma | ghcr.io/chroma-core/chroma | 1.0.0 | 8000 | chroma_data -> /data |
Before you install
- CPU architecture. arm64 listed. Every image lists linux/arm64 in its registry manifest. That is a manifest fact, not proof the app runs on Arm.
- Listed. It is in the catalog. Back up the data volume before changing an image tag.
Settings and environment
You do not have to fill in anything. Values are never shown here.
| Service | Variable | Value |
|---|---|---|
| chroma | ANONYMIZED_TELEMETRY | Preset by the template |
| chroma | IS_PERSISTENT | Preset by the template |
| chroma | PERSIST_DIRECTORY | Preset by the template |
Install Chroma on a VPS
-
Install Levelrail on a fresh VPS
Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.
curl -fsSL https://levelrail.com/install.sh | sudo sh -
Sign in
Open the setup link, choose a password, then log the CLI in. The CLI install command is
curl -fsSL https://levelrail.com/install-cli.sh | shif the machine does not have it. See Getting started.levelrail-cli login --device -
Read the template
Shows the entry, including its full compose.yaml.
levelrail-cli templates get chroma -
Deploy it
This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.
levelrail-cli templates deploy chroma --name my-chroma
Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Chroma.
Docs and upstream
More in Database Tools
- ClickHouseA columnar database built for fast analytical queries over large datasets.
- CloudBeaverA web-based database manager for browsing and querying Postgres, MySQL, SQLite and more.
- CockroachDBA distributed SQL database that speaks the Postgres wire protocol, run as one insecure node for development and small workloads. The SQL port is private, the admin console is the web page. Source available license.
- BytebaseA database schema change and migration tool with review workflows built in.
- CouchDBA document database with an HTTP API, built-in replication and the Fauxton admin console.
- DbGateA web database client for SQL and NoSQL databases with a generated login and a data volume. Sign in as admin with the generated password, then add connections to other services here.