Self-host Bifrost on a VPS

Fast open source LLM gateway that routes requests to many providers behind one OpenAI compatible API, with a web UI for keys and routing rules.

levelrail-cli templates deploy bifrost --name my-bifrost

Specification

Status
Listed
Category
AI
Services
bifrost
Ports
8080
Volumes
1
Memory
about 256 MiB
arm64
unknown
amd64
unknown
Settings to fill in
none
Listing
Community template

About Bifrost

Fast open source LLM gateway that routes requests to many providers behind one OpenAI compatible API, with a web UI for keys and routing rules.

What it deploys

Bifrost runs as one service in a single Compose app, listening on port 8080, with 1 named volume mount.

ServiceImageTagPortsVolumes
bifrost maximhq/bifrost v2.5.1 8080 data -> /app/data

Before you install

  • CPU architecture. arm64 unknown. The scan could not read a manifest or the tag is chosen at install time. This is not a claim either way.
  • Listed. It is in the catalog. Back up the data volume before changing an image tag.

Settings and environment

The catalog lists no environment variables for this template.

First run

  1. Open the address, add provider keys in the web UI, then point your OpenAI compatible clients at it. Keep it private or add a login in front.

Install Bifrost on a VPS

  1. Install Levelrail on a fresh VPS

    Run this as root on a Linux server (amd64 or arm64) with ports 80 and 443 reachable. The installer prints a setup link.

    curl -fsSL https://levelrail.com/install.sh | sudo sh
  2. Sign in

    Open the setup link, choose a password, then log the CLI in. The CLI install command is curl -fsSL https://levelrail.com/install-cli.sh | sh if the machine does not have it. See Getting started.

    levelrail-cli login --device
  3. Read the template

    Shows the entry, including its full compose.yaml.

    levelrail-cli templates get bifrost
  4. Deploy it

    This deploys the template compose file as an app. The app name defaults to the template id; --name sets another.

    levelrail-cli templates deploy bifrost --name my-bifrost

Without a domain the app gets an sslip.io address. You can also deploy it from the dashboard: Apps, New app, Browse templates, then Bifrost.

More in AI

All AI templates