LLM Harbor

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.

GitHub stars: 3,246
License: Apache-2.0
Latest release: v0.5.14
25 September 2026
Last commit: 25 September 2026
Runs on: Docker, Shell

Commits per month, last 12 months

1,288 commits

How to self-host LLM Harbor

LLM Harbor runs on Docker and Shell. The project's own install guide is the place to start; most people put it on a small server with Docker and a reverse proxy for HTTPS.

Get a server: a home server, a VPS, or a managed app host.
Install it the way the project's docs describe, usually with Docker Compose.
Put it behind HTTPS and set up backups before you add real data.
Update it regularly. Watch the project's releases.

New to self-hosting? Start with the beginner's guide.

Similar apps

Ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
183k stars
Open-WebUI
User-friendly AI Interface, supports Ollama, OpenAI API.
155k stars
LobeHub
Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.
83.2k stars
AnythingLLM
All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
67k stars
LocalAI
Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).
49.5k stars
LibreChat
Enhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support.
45.6k stars

Questions

Is LLM Harbor free?

Yes. LLM Harbor is open source under the Apache-2.0 license, so you can use it without paying for a license. You pay only for the server it runs on.

Can I self-host LLM Harbor?

Yes. LLM Harbor runs on Docker and Shell. Follow the install guide in the project's documentation, or use a host that installs it for you.

Is LLM Harbor still maintained?

The last change to LLM Harbor's code was on 25 September 2026, with 1288 commits in the last 12 months.

Topics

App data from awesome-selfhosted (CC BY-SA 3.0), stars and activity from GitHub.