Self-host LightRAG on a VPS

Graph based retrieval augmented generation server with a web UI and API. Runs on local file storage; point it at a model provider with the LLM and embedding settings.

levelrail-cli templates install lightrag --name my-lightrag

Specification

Status
Listed
Category
AI
Services
lightrag
Ports
9621
Volumes
2
Memory
about 1 GiB
arm64
unknown
amd64
unknown
Settings to fill in
none
Listing
Community template

About LightRAG

Graph based retrieval augmented generation server with a web UI and API. Runs on local file storage; point it at a model provider with the LLM and embedding settings.

What it deploys

LightRAG runs as one service in a single Compose app, listening on port 9621, with 2 named volume mounts.

ServiceImageTagPortsVolumes
lightrag ghcr.io/hkuds/lightrag v1.5.7 9621 rag -> /app/data/rag_storageinputs -> /app/data/inputs

Before you install

  • CPU architecture. arm64 unknown. The scan could not read a manifest or the tag is chosen at install time. This is not a claim either way.
  • Listed. It is in the catalog. Back up the data volume before changing an image tag.

Settings and environment

You do not have to fill in anything. 1 secret is generated at deploy and stored encrypted. Values are never shown here.

ServiceVariableValue
lightragEMBEDDING_BINDINGPreset by the template
lightragEMBEDDING_BINDING_API_KEYPreset by the template
lightragEMBEDDING_BINDING_HOSTPreset by the template
lightragEMBEDDING_DIMPreset by the template
lightragEMBEDDING_MODELPreset by the template
lightragHOSTPreset by the template
lightragLIGHTRAG_API_KEYGenerated at deploy
lightragLLM_BINDINGPreset by the template
lightragLLM_BINDING_API_KEYPreset by the template
lightragLLM_BINDING_HOSTPreset by the template
lightragLLM_MODELPreset by the template
lightragPORTPreset by the template

First run

  1. Set the LLM and embedding settings for your provider, then open the address to upload documents and query them. The generated API key protects the API.

Install LightRAG on a VPS

  1. Install Levelrail on a fresh VPS

    Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.

    curl -fsSL https://levelrail.com/install.sh | sudo sh
  2. Sign in

    Open the setup link, choose a password, then log the CLI in. The CLI install command is curl -fsSL https://levelrail.com/install-cli.sh | sh if the machine does not have it. See Getting started.

    levelrail-cli login --device
  3. Read the template

    Shows the entry, including its full compose.yaml.

    levelrail-cli templates get lightrag
  4. Install it

    This template has an install form, so the CLI fills each setting from --env, a generated secret or its default.

    levelrail-cli templates install lightrag --name my-lightrag

    To put a service behind a domain at install, add --domain SERVICE=HOST:

    levelrail-cli templates install lightrag --name my-lightrag --domain lightrag=lightrag.example.com

Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then LightRAG.

More in AI

All AI templates