Self-host Docling Serve on a VPS

An API server that converts PDFs, Office files and images into Markdown, JSON or text for RAG pipelines, using the Docling library on CPU. MIT licensed. The image is about 5 GB, the interactive UI is at /ui and the API docs at /docs. There is no login, so keep it private or behind an auth proxy.

levelrail-cli templates install docling-serve --name my-docling-serve

Specification

Status
Listed
Category
AI
Services
docling
Ports
5001
Volumes
0
Memory
about 3 GiB
arm64
image published
amd64
image published
Settings to fill in
none

About Docling Serve

An API server that converts PDFs, Office files and images into Markdown, JSON or text for RAG pipelines, using the Docling library on CPU. MIT licensed. The image is about 5 GB, the interactive UI is at /ui and the API docs at /docs. There is no login, so keep it private or behind an auth proxy.

What it deploys

Docling Serve runs as one service in a single Compose app, listening on port 5001.

ServiceImageTagPortsVolumes
docling ghcr.io/docling-project/docling-serve-cpu v1.38.2 5001 none

Before you install

  • CPU architecture. arm64 listed. Every image lists linux/arm64 in its registry manifest. That is a manifest fact, not proof the app runs on Arm.
  • Listed. It is in the catalog. Back up the data volume before changing an image tag.

Settings and environment

You do not have to fill in anything. Values are never shown here.

ServiceVariableValue
doclingDOCLING_SERVE_ENABLE_UIPreset by the template
doclingTZPreset by the template

Install Docling Serve on a VPS

  1. Install Levelrail on a fresh VPS

    Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.

    curl -fsSL https://levelrail.com/install.sh | sudo sh
  2. Sign in

    Open the setup link, choose a password, then log the CLI in. The CLI install command is curl -fsSL https://levelrail.com/install-cli.sh | sh if the machine does not have it. See Getting started.

    levelrail-cli login --device
  3. Read the template

    Shows the entry, including its full compose.yaml.

    levelrail-cli templates get docling-serve
  4. Install it

    This template has an install form, so the CLI fills each setting from --env, a generated secret or its default.

    levelrail-cli templates install docling-serve --name my-docling-serve

    To put a service behind a domain at install, add --domain SERVICE=HOST:

    levelrail-cli templates install docling-serve --name my-docling-serve --domain docling=docling-serve.example.com

Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Docling Serve.

More in AI

All AI templates