Self-host Crawl4AI on a VPS
An open source web crawler API that turns pages into clean Markdown and structured data for LLM pipelines, with a built-in playground and MCP endpoint. API calls need the generated token as a Bearer header.
levelrail-cli templates install crawl4ai --name my-crawl4aiSpecification
- Status
- Verified on arm64 with image tag 0.9.5
- Category
- AI
- Services
- crawl4ai
- Ports
- 11235
- Volumes
- 0
- Memory
- about 2 GiB
- arm64
- tested
- amd64
- image published
- Settings to fill in
- none
- License
- Permissive license, Apache-2.0
About Crawl4AI
An open source web crawler API that turns pages into clean Markdown and structured data for LLM pipelines, with a built-in playground and MCP endpoint. API calls need the generated token as a Bearer header.
What it deploys
Crawl4AI runs as one service in a single Compose app, listening on port 11235.
| Service | Image | Tag | Ports | Volumes |
|---|---|---|---|---|
| crawl4ai | unclecode/crawl4ai | 0.9.5 | 11235 | none |
Before you install
- CPU architecture. arm64 listed. Every image lists linux/arm64 in its registry manifest. That is a manifest fact, not proof the app runs on Arm.
- Verified. Verified on arm64 with image tag 0.9.5. Verified means our CI ran this exact image version and it answered on its health path. Evidence
- Review. Changes container security options (no-new-privileges:true).
Settings and environment
You do not have to fill in anything. 1 secret is generated at deploy and stored encrypted. Values are never shown here.
| Service | Variable | Value |
|---|---|---|
| crawl4ai | CRAWL4AI_API_TOKEN | Generated at deploy |
Install Crawl4AI on a VPS
-
Install Levelrail on a fresh VPS
Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.
curl -fsSL https://levelrail.com/install.sh | sudo sh -
Sign in
Open the setup link, choose a password, then log the CLI in. The CLI install command is
curl -fsSL https://levelrail.com/install-cli.sh | shif the machine does not have it. See Getting started.levelrail-cli login --device -
Read the template
Shows the entry, including its full compose.yaml.
levelrail-cli templates get crawl4ai -
Install it
This template has an install form, so the CLI fills each setting from --env, a generated secret or its default.
levelrail-cli templates install crawl4ai --name my-crawl4aiTo put a service behind a domain at install, add
--domain SERVICE=HOST:levelrail-cli templates install crawl4ai --name my-crawl4ai --domain crawl4ai=crawl4ai.example.com
Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Crawl4AI.
Docs and upstream
More in AI
- ComfyUIA node-graph editor for building and running Stable Diffusion and other image generation pipelines.
- Docling ServeAn API server that converts PDFs, Office files and images into Markdown, JSON or text for RAG pipelines, using the Docling library on CPU. MIT licensed. The image is about 5 GB, the interactive UI is at /ui and the API docs at /docs. There is no login, so keep it private or behind an auth proxy.
- Big-AGIA multi-model chat workspace with personas, side by side answers and voice, using your own API keys. MIT licensed. Keys stay in your browser unless you set them on the server.
- BifrostFast open source LLM gateway that routes requests to many providers behind one OpenAI compatible API, with a web UI for keys and routing rules.
- FlowiseDrag-and-drop builder for LLM chatbots, agents, and RAG flows, with an API for each flow.
- Flowise (Postgres + Qdrant)Flowise with a Postgres record manager, a Redis cache, and a Qdrant vector store, for production RAG flows.