Self-host Text Embeddings Inference on a VPS
A lean server that turns text into embeddings with popular open models, on CPU with no extra setup.
levelrail-cli templates deploy text-embeddings-inference --name my-text-embeddings-inferenceSpecification
- Status
- Listed
- Category
- AI
- Services
- tei
- Ports
- 80
- Volumes
- 1
- Memory
- about 2 GiB
- arm64
- not available
- amd64
- image published
- Settings to fill in
- none
- License
- Permissive license, Apache-2.0
About Text Embeddings Inference
A lean server that turns text into embeddings with popular open models, on CPU with no extra setup. Runs as a single container from the text-embeddings-inference image, listening on port 80; data is kept in named volumes.
What it deploys
Text Embeddings Inference runs as one service in a single Compose app, listening on port 80, with 1 named volume mount.
| Service | Image | Tag | Ports | Volumes |
|---|---|---|---|---|
| tei | ghcr.io/huggingface/text-embeddings-inference | cpu-1.8 | 80 | tei_data -> /data |
Before you install
- CPU architecture. amd64 only. At least one image lists no linux/arm64, so there is no native Arm image.
- Listed. It is in the catalog. Back up the data volume before changing an image tag.
- Host ports. It publishes port 80 directly on the host, so open them in the VPS firewall only if you want that.
Settings and environment
The catalog lists no environment variables for this template.
Install Text Embeddings Inference on a VPS
-
Install Levelrail on a fresh VPS
Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.
curl -fsSL https://levelrail.com/install.sh | sudo sh -
Sign in
Open the setup link, choose a password, then log the CLI in. The CLI install command is
curl -fsSL https://levelrail.com/install-cli.sh | shif the machine does not have it. See Getting started.levelrail-cli login --device -
Read the template
Shows the entry, including its full compose.yaml.
levelrail-cli templates get text-embeddings-inference -
Deploy it
This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.
levelrail-cli templates deploy text-embeddings-inference --name my-text-embeddings-inference
Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Text Embeddings Inference.
Docs and upstream
More in AI
- Text Generation InferenceHugging Face's production inference server for transformer language models, with continuous batching and streaming.
- UnstructuredAn API that turns PDFs, Word files, and other documents into clean data for RAG pipelines.
- Stable Diffusion WebUIA browser interface for generating and editing images with Stable Diffusion checkpoints.
- SpeachesAn OpenAI-compatible speech server: Whisper transcription and text-to-speech behind one API.
- vLLMA fast, high-throughput inference server that exposes an OpenAI-compatible API for open-weight language models.
- SillyTavernA local chat front end for language models with characters, lorem books and extensions, bringing your own model API. AGPL-3.0 licensed. Sign in with the admin user and the generated password.