Self-host SillyTavern on a VPS

A local chat front end for language models with characters, lorem books and extensions, bringing your own model API. AGPL-3.0 licensed. Sign in with the admin user and the generated password.

levelrail-cli templates deploy sillytavern --name my-sillytavern

Specification

Status
Listed
Category
AI
Services
sillytavern
Ports
8000
Volumes
2
Memory
about 256 MiB
arm64
unknown
amd64
unknown
Settings to fill in
none
Listing
Community template

About SillyTavern

A local chat front end for language models with characters, lorem books and extensions, bringing your own model API. AGPL-3.0 licensed. Sign in with the admin user and the generated password.

What it deploys

SillyTavern runs as one service in a single Compose app, listening on port 8000, with 2 named volume mounts.

ServiceImageTagPortsVolumes
sillytavern ghcr.io/sillytavern/sillytavern 1.19.0 8000 config -> /home/node/app/configdata -> /home/node/app/data

Before you install

  • CPU architecture. arm64 unknown. The scan could not read a manifest or the tag is chosen at install time. This is not a claim either way.
  • Listed. It is in the catalog. Back up the data volume before changing an image tag.

Settings and environment

You do not have to fill in anything. 1 secret is generated at deploy and stored encrypted. Values are never shown here.

ServiceVariableValue
sillytavernSILLYTAVERN_BASICAUTHMODEPreset by the template
sillytavernSILLYTAVERN_BASICAUTHUSER_PASSWORDGenerated at deploy
sillytavernSILLYTAVERN_BASICAUTHUSER_USERNAMEPreset by the template
sillytavernSILLYTAVERN_LISTENPreset by the template
sillytavernSILLYTAVERN_WHITELISTMODEPreset by the template

First run

  1. Sign in with user admin and the generated password, then add your model API key under API Connections.

Install SillyTavern on a VPS

  1. Install Levelrail on a fresh VPS

    Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.

    curl -fsSL https://levelrail.com/install.sh | sudo sh
  2. Sign in

    Open the setup link, choose a password, then log the CLI in. The CLI install command is curl -fsSL https://levelrail.com/install-cli.sh | sh if the machine does not have it. See Getting started.

    levelrail-cli login --device
  3. Read the template

    Shows the entry, including its full compose.yaml.

    levelrail-cli templates get sillytavern
  4. Deploy it

    This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.

    levelrail-cli templates deploy sillytavern --name my-sillytavern

Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then SillyTavern.

More in AI

All AI templates