Levelrail
Skip to content

Self-host Chroma with Docker ​

A developer-friendly embedding database for AI applications, served over a simple HTTP API.

This page describes the Levelrail template for Chroma (Database Tools). It deploys the services below as one Docker Compose app on your own server.

Project site: https://docs.trychroma.com.

Recommended memory: about 512 MiB.

Services, ports and volumes ​

ServiceImageContainer portsVolumes
chromaghcr.io/chroma-core/chroma:1.0.08000
chroma_data -> /data

Environment variables ​

ServiceVariableValue
chromaANONYMIZED_TELEMETRYPreset in the template
chromaIS_PERSISTENTPreset in the template
chromaPERSIST_DIRECTORYPreset in the template

Passwords and keys marked as generated are created for you when the app is deployed and stored as secrets. Values are not shown here.

Deploy Chroma with Levelrail ​

In the dashboard, open Apps, choose New app, then Browse templates, and select Chroma. Review the Compose body and deploy.

With the CLI:

levelrail-cli templates deploy chroma --name my-chroma

See Service template catalog for how templates work, and Getting started if you have not installed Levelrail yet.

More Database Tools templates ​

All templates are listed in the self-host gallery.

Released under the Apache 2.0 License.