Skip to content

Template · AI & LLM

LiteLLM Proxy

OpenAI-compatible gateway to 100+ LLM providers with keys, spend tracking and a UI.

Deploy on Skiffly

Opens the dashboard with this template pre-selected. Sign in with GitHub if you are new; the free tier needs no card.

  • Postgrespostgres:17
  • LiteLLMghcr.io/berriai/litellm:main-latest
Upstream documentation

What gets deployed

2 services in the environment you pick, on the private network of the project.

About this template

ghcr.io/berriai/litellm:main-latest + PostgreSQL 17 (models are stored in the DB and managed from the UI at /ui).

Postgres

Image: postgres:17

  • Port 5432/tcp
  • 10 GB volume at /var/lib/postgresql/data
  • 1 vCPU · 1 GB

LiteLLM

Image: ghcr.io/berriai/litellm:main-latest

  • Port 4000/http
  • Public domain with TLS
  • 1 vCPU · 1 GB
  • /health/liveliness

Variables

Generated secrets never leave the platform; references are resolved on the private network. Anything marked required is asked for at deploy time.

Postgres

NameValue
POSTGRES_USERpostgresSuperuser name
POSTGRES_PASSWORDgenerated (password)Generated at deploy
POSTGRES_DBlitellmDatabase created on first start
PGDATA/var/lib/postgresql/data/pgdata
DATABASE_URLpostgresql://${{self.POSTGRES_USER}}:${{self.POSTGRES_PASSWORD}}@${{self.SKIFFLY_PRIVATE_DOMAIN}}:5432/${{self.POSTGRES_DB}}Connection string on the private network

LiteLLM

NameValue
DATABASE_URL${{Postgres.DATABASE_URL}}
LITELLM_MASTER_KEYgenerated (secret)Prefix it with sk- when using it as an API key
LITELLM_SALT_KEYgenerated (secret)
STORE_MODEL_IN_DBTrue
UI_USERNAMEadmin
UI_PASSWORDgenerated (password)
PORT4000

Deploy button for your README

Add a one-click deploy link to your repository or docs. Two variants: for light and dark backgrounds.

Deploy on SkifflyDeploy on Skiffly
Markdown · Light background
[![Deploy on Skiffly](https://skiffly.dev/button.svg)](https://skiffly.dev/templates/litellm)
Markdown · Dark background
[![Deploy on Skiffly](https://skiffly.dev/button-dark.svg)](https://skiffly.dev/templates/litellm)
HTML
<a href="https://skiffly.dev/templates/litellm"><img src="https://skiffly.dev/button.svg" alt="Deploy on Skiffly" height="32"></a>

Deploy LiteLLM Proxy in one click

Volumes, secrets and domain pre-wired. Runs on EU nodes, paid per minute from a prepaid balance.