LiteLLM
LiteLLM is a lightweight OpenAI API-compatible proxy for managing multiple LLM providers with a single endpoint.
Deploy LiteLLM on Dokploy
- Install Dokploy on your server if you haven't already.
- In your Dokploy panel, open a project and click Create Service → Template.
- Search for LiteLLM and click Create — Dokploy configures domains, environment variables, and volumes for you.
Alternatively, create a Compose service, go to Advanced → Import from Base64, and paste this payload:
ewogICJjb21wb3NlIjogInZlcnNpb246IFwiMy44XCJcblxuc2VydmljZXM6XG4gIGxpdGVsbG06XG4gICAgaW1hZ2U6IGdoY3IuaW8vYmVycmlhaS9saXRlbGxtOm1haW4tbGF0ZXN0XG4gICAgcmVzdGFydDogdW5sZXNzLXN0b3BwZWRcbiAgICBkZXBlbmRzX29uOlxuICAgICAgbGl0ZWxsbS1kYjpcbiAgICAgICAgY29uZGl0aW9uOiBzZXJ2aWNlX2hlYWx0aHlcbiAgICBlbnZpcm9ubWVudDpcbiAgICAgIERBVEFCQVNFX1VSTDogJHtEQVRBQkFTRV9VUkx9XG4gICAgICBMSVRFTExNX01BU1RFUl9LRVk6ICR7TElURUxMTV9NQVNURVJfS0VZfVxuICAgICAgVUlfVVNFUk5BTUU6ICR7VUlfVVNFUk5BTUV9XG4gICAgICBVSV9QQVNTV09SRDogJHtVSV9QQVNTV09SRH1cbiAgICAgIFNUT1JFX01PREVMX0lOX0RCOiBcIlRydWVcIlxuXG4gICAgICAjIFByb3ZpZGVyIEtleXNcbiAgICAgIE9QRU5BSV9BUElfS0VZOiAke09QRU5BSV9BUElfS0VZfVxuICAgICAgT1BFTkFJX0JBU0VfVVJMOiAke09QRU5BSV9CQVNFX1VSTH1cbiAgICAgIENPSEVSRV9BUElfS0VZOiAke0NPSEVSRV9BUElfS0VZfVxuICAgICAgT1JfU0lURV9VUkw6ICR7T1JfU0lURV9VUkx9XG4gICAgICBPUl9BUFBfTkFNRTogJHtPUl9BUFBfTkFNRX1cbiAgICAgIE9SX0FQSV9LRVk6ICR7T1JfQVBJX0tFWX1cbiAgICAgIEFaVVJFX0FQSV9CQVNFOiAke0FaVVJFX0FQSV9CQVNFfVxuICAgICAgQVpVUkVfQVBJX1ZFUlNJT046ICR7QVpVUkVfQVBJX1ZFUlNJT059XG4gICAgICBBWlVSRV9BUElfS0VZOiAke0FaVVJFX0FQSV9LRVl9XG4gICAgICBSRVBMSUNBVEVfQVBJX0tFWTogJHtSRVBMSUNBVEVfQVBJX0tFWX1cbiAgICAgIFJFUExJQ0FURV9BUElfVE9LRU46ICR7UkVQTElDQVRFX0FQSV9UT0tFTn1cbiAgICAgIEFOVEhST1BJQ19BUElfS0VZOiAke0FOVEhST1BJQ19BUElfS0VZfVxuICAgICAgSU5GSVNJQ0FMX1RPS0VOOiAke0lORklTSUNBTF9UT0tFTn1cbiAgICAgIE5PVklUQV9BUElfS0VZOiAke05PVklUQV9BUElfS0VZfVxuICAgICAgSU5GSU5JVFlfQVBJX0tFWTogJHtJTkZJTklUWV9BUElfS0VZfVxuXG4gICAgZXhwb3NlOlxuICAgICAgLSA0MDAwXG5cbiAgbGl0ZWxsbS1kYjpcbiAgICBpbWFnZTogcG9zdGdyZXM6MTYtYWxwaW5lXG4gICAgcmVzdGFydDogb24tZmFpbHVyZTo1XG4gICAgaGVhbHRoY2hlY2s6XG4gICAgICB0ZXN0OiBbXCJDTUQtU0hFTExcIiwgXCJwZ19pc3JlYWR5IC1VICR7UE9TVEdSRVNfVVNFUn0gLWQgJHtQT1NUR1JFU19EQn1cIl1cbiAgICAgIGludGVydmFsOiA1c1xuICAgICAgdGltZW91dDogNXNcbiAgICAgIHJldHJpZXM6IDVcbiAgICB2b2x1bWVzOlxuICAgICAgLSBsaXRlbGxtLWRiOi92YXIvbGliL3Bvc3RncmVzcWwvZGF0YVxuICAgIGVudmlyb25tZW50OlxuICAgICAgUE9TVEdSRVNfREI6ICR7UE9TVEdSRVNfREJ9XG4gICAgICBQT1NUR1JFU19VU0VSOiAke1BPU1RHUkVTX1VTRVJ9XG4gICAgICBQT1NUR1JFU19QQVNTV09SRDogJHtQT1NUR1JFU19QQVNTV09SRH1cblxudm9sdW1lczpcbiAgbGl0ZWxsbS1kYjoge30iLAogICJjb25maWciOiAiW3ZhcmlhYmxlc11cbm1haW5fZG9tYWluID0gXCIke2RvbWFpbn1cIlxuXG4jIERhdGFiYXNlXG5wb3N0Z3Jlc19kYiA9IFwibGl0ZWxsbVwiXG5wb3N0Z3Jlc191c2VyID0gXCJsaXRlbGxtXCJcbnBvc3RncmVzX3Bhc3N3b3JkID0gXCIke3Bhc3N3b3JkOjMyfVwiXG5cbiMgTGl0ZUxMTSBVSSArIE1hc3RlciBLZXlcbnVpX3VzZXJuYW1lID0gXCIke3VzZXJuYW1lfVwiXG51aV9wYXNzd29yZCA9IFwiJHtwYXNzd29yZDozMn1cIlxubGl0ZWxsbV9tYXN0ZXJfa2V5ID0gXCIke3Bhc3N3b3JkOjY0fVwiXG5cbiMgUHJvdmlkZXIgQVBJIEtleXMgKGVtcHR5IGJ5IGRlZmF1bHQpXG5vcGVuYWlfYXBpX2tleSA9IFwiXCJcbm9wZW5haV9iYXNlX3VybCA9IFwiXCJcbmNvaGVyZV9hcGlfa2V5ID0gXCJcIlxub3Jfc2l0ZV91cmwgPSBcIlwiXG5vcl9hcHBfbmFtZSA9IFwiTGl0ZUxMTSBFeGFtcGxlIGFwcFwiXG5vcl9hcGlfa2V5ID0gXCJcIlxuYXp1cmVfYXBpX2Jhc2UgPSBcIlwiXG5henVyZV9hcGlfdmVyc2lvbiA9IFwiXCJcbmF6dXJlX2FwaV9rZXkgPSBcIlwiXG5yZXBsaWNhdGVfYXBpX2tleSA9IFwiXCJcbnJlcGxpY2F0ZV9hcGlfdG9rZW4gPSBcIlwiXG5hbnRocm9waWNfYXBpX2tleSA9IFwiXCJcbmluZmlzaWNhbF90b2tlbiA9IFwiXCJcbm5vdml0YV9hcGlfa2V5ID0gXCJcIlxuaW5maW5pdHlfYXBpX2tleSA9IFwiXCJcblxuW2NvbmZpZ11cbm1vdW50cyA9IFtdXG5bW2NvbmZpZy5kb21haW5zXV1cbnNlcnZpY2VOYW1lID0gXCJsaXRlbGxtXCJcbnBvcnQgPSA0MDAwXG5ob3N0ID0gXCIke21haW5fZG9tYWlufVwiXG5cbltjb25maWcuZW52XVxuIyBEYXRhYmFzZVxuREFUQUJBU0VfVVJMID0gXCJwb3N0Z3Jlc3FsOi8vJHtwb3N0Z3Jlc191c2VyfToke3Bvc3RncmVzX3Bhc3N3b3JkfUBsaXRlbGxtLWRiOjU0MzIvJHtwb3N0Z3Jlc19kYn1cIlxuUE9TVEdSRVNfREIgPSBcIiR7cG9zdGdyZXNfZGJ9XCJcblBPU1RHUkVTX1VTRVIgPSBcIiR7cG9zdGdyZXNfdXNlcn1cIlxuUE9TVEdSRVNfUEFTU1dPUkQgPSBcIiR7cG9zdGdyZXNfcGFzc3dvcmR9XCJcblxuIyBMaXRlTExNXG5VSV9VU0VSTkFNRSA9IFwiJHt1aV91c2VybmFtZX1cIlxuVUlfUEFTU1dPUkQgPSBcIiR7dWlfcGFzc3dvcmR9XCJcbkxJVEVMTE1fTUFTVEVSX0tFWSA9IFwiJHtsaXRlbGxtX21hc3Rlcl9rZXl9XCJcblNUT1JFX01PREVMX0lOX0RCID0gXCJUcnVlXCJcblxuIyBQcm92aWRlcnNcbk9QRU5BSV9BUElfS0VZID0gXCIke29wZW5haV9hcGlfa2V5fVwiXG5PUEVOQUlfQkFTRV9VUkwgPSBcIiR7b3BlbmFpX2Jhc2VfdXJsfVwiXG5DT0hFUkVfQVBJX0tFWSA9IFwiJHtjb2hlcmVfYXBpX2tleX1cIlxuT1JfU0lURV9VUkwgPSBcIiR7b3Jfc2l0ZV91cmx9XCJcbk9SX0FQUF9OQU1FID0gXCIke29yX2FwcF9uYW1lfVwiXG5PUl9BUElfS0VZID0gXCIke29yX2FwaV9rZXl9XCJcbkFaVVJFX0FQSV9CQVNFID0gXCIke2F6dXJlX2FwaV9iYXNlfVwiXG5BWlVSRV9BUElfVkVSU0lPTiA9IFwiJHthenVyZV9hcGlfdmVyc2lvbn1cIlxuQVpVUkVfQVBJX0tFWSA9IFwiJHthenVyZV9hcGlfa2V5fVwiXG5SRVBMSUNBVEVfQVBJX0tFWSA9IFwiJHtyZXBsaWNhdGVfYXBpX2tleX1cIlxuUkVQTElDQVRFX0FQSV9UT0tFTiA9IFwiJHtyZXBsaWNhdGVfYXBpX3Rva2VufVwiXG5BTlRIUk9QSUNfQVBJX0tFWSA9IFwiJHthbnRocm9waWNfYXBpX2tleX1cIlxuSU5GSVNJQ0FMX1RPS0VOID0gXCIke2luZmlzaWNhbF90b2tlbn1cIlxuTk9WSVRBX0FQSV9LRVkgPSBcIiR7bm92aXRhX2FwaV9rZXl9XCJcbklORklOSVRZX0FQSV9LRVkgPSBcIiR7aW5maW5pdHlfYXBpX2tleX1cIiIKfQ==
Configuration
The exact Docker Compose and template configuration this template deploys.
Related Templates
Langfuse
Version: 4
Langfuse is an open-source LLM engineering platform for tracing, prompt management, evaluation, and cost/usage analytics of LLM applications.
9Router
Version: 0.5.40
Self-hosted AI model router that rotates requests across 40+ providers with automatic fallback, exposing an OpenAI-compatible endpoint for coding agents.
AnythingLLM
Version: latest
AnythingLLM is a private, self-hosted, and local document chatbot platform that allows you to chat with your documents using various LLM providers.
Arche
Version: latest
Arche is a self-hosted AI workspace platform that spawns per-user OpenCode coding containers backed by a shared Knowledge Base. Requires the `arche-internal` external Docker network and `/opt/arche/{kb-content,kb-config,users}` directories on the host before deploy. Images are linux/amd64 by default; override `ARCHE_WEB_IMAGE` and `ARCHE_WORKSPACE_IMAGE` to the `-arm64` tag variants for ARM64 hosts.
bolt.diy
Version: latest
Prompt, run, edit, and deploy full-stack web applications using any LLM you want!
Crawl4AI
Version: 0.7.3
Crawl4AI is a modern AI-powered web crawler with support for screenshots, PDFs, JavaScript execution, and LLM-based extraction. Includes an interactive playground and MCP (Model Context Protocol) integration.
Self-host LiteLLM in minutes
Dokploy is a free, open source deployment platform. Deploy LiteLLM and 517+ other templates on your own infrastructure with a single click.