Self-host SillyTavern on a VPS
A local chat front end for language models with characters, lorem books and extensions, bringing your own model API. AGPL-3.0 licensed. Sign in with the admin user and the generated password.
levelrail-cli templates deploy sillytavern --name my-sillytavernSpecification
- Status
- Listed
- Category
- AI
- Services
- sillytavern
- Ports
- 8000
- Volumes
- 2
- Memory
- about 256 MiB
- arm64
- unknown
- amd64
- unknown
- Settings to fill in
- none
- Listing
- Community template
About SillyTavern
A local chat front end for language models with characters, lorem books and extensions, bringing your own model API. AGPL-3.0 licensed. Sign in with the admin user and the generated password.
What it deploys
SillyTavern runs as one service in a single Compose app, listening on port 8000, with 2 named volume mounts.
| Service | Image | Tag | Ports | Volumes |
|---|---|---|---|---|
| sillytavern | ghcr.io/sillytavern/sillytavern | 1.19.0 | 8000 | config -> /home/node/app/configdata -> /home/node/app/data |
Before you install
- CPU architecture. arm64 unknown. The scan could not read a manifest or the tag is chosen at install time. This is not a claim either way.
- Listed. It is in the catalog. Back up the data volume before changing an image tag.
Settings and environment
You do not have to fill in anything. 1 secret is generated at deploy and stored encrypted. Values are never shown here.
| Service | Variable | Value |
|---|---|---|
| sillytavern | SILLYTAVERN_BASICAUTHMODE | Preset by the template |
| sillytavern | SILLYTAVERN_BASICAUTHUSER_PASSWORD | Generated at deploy |
| sillytavern | SILLYTAVERN_BASICAUTHUSER_USERNAME | Preset by the template |
| sillytavern | SILLYTAVERN_LISTEN | Preset by the template |
| sillytavern | SILLYTAVERN_WHITELISTMODE | Preset by the template |
First run
- Sign in with user admin and the generated password, then add your model API key under API Connections.
Install SillyTavern on a VPS
-
Install Levelrail on a fresh VPS
Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.
curl -fsSL https://levelrail.com/install.sh | sudo sh -
Sign in
Open the setup link, choose a password, then log the CLI in. The CLI install command is
curl -fsSL https://levelrail.com/install-cli.sh | shif the machine does not have it. See Getting started.levelrail-cli login --device -
Read the template
Shows the entry, including its full compose.yaml.
levelrail-cli templates get sillytavern -
Deploy it
This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.
levelrail-cli templates deploy sillytavern --name my-sillytavern
Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then SillyTavern.
Docs and upstream
More in AI
- SpeachesAn OpenAI-compatible speech server: Whisper transcription and text-to-speech behind one API.
- Stable Diffusion WebUIA browser interface for generating and editing images with Stable Diffusion checkpoints.
- PromptfooTest and compare prompts, models and agents with a local web UI for browsing evaluation results. Runs the viewer with results stored on a volume.
- Text Embeddings InferenceA lean server that turns text into embeddings with popular open models, on CPU with no extra setup.
- Text Generation InferenceHugging Face's production inference server for transformer language models, with continuous batching and streaming.
- UnstructuredAn API that turns PDFs, Word files, and other documents into clean data for RAG pipelines.