Skip to content

Search tools

LLM Harbor

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.

Description from awesome-selfhosted (CC BY-SA 3.0)

Still maintained? Yes: 304 commits in the last 90 days, latest release v0.5.17 (Oct 2026).

Docker #10 of 14 in Generative Artificial Intelligence (GenAI)

At a glance

LLM Harbor quick facts

Health score
94/100 GOOD
Stars
3,256
Last commit
6 days ago (Oct 2026)
Latest release
v0.5.17, Oct 2026
Licence
Apache-2.0

Top alternatives to LLM Harbor

In its own words

The project's README opens: "Harbor is a CLI and companion app that lets you spin up a complete local LLM stack—backends like Ollama, llama.cpp, or vLLM, frontends like Open WebUI, plus supporting services like SearXNG for web search, Speaches for voice chat, and ComfyUI for image generation—all pre-wired to work together with a single harbor up command."

Why it ranks here

Health score explained

LLM Harbor scores 94/100, #10 of 14 in Generative Artificial Intelligence (GenAI): 304 commits in the last 90 days earn 35.0 of 35 points, the latest release (v0.5.17, 6 days ago) earns 25.0 of 25, 3,256 stars add 14.1 of 20, an active, unarchived repository keeps 10 and Docker support adds the final 10. That places it in the good band (70 and above). The biggest shortfall is star count, worth 5.9 more points.

Recomputed nightly from the GitHub API. How the score is calculated.

  • Commit activity 35.0 / 35

    304 commits in 90 days (30+ scores full marks)

  • Release recency 25.0 / 25

    v0.5.17 released 6 days ago

  • Stars biggest shortfall 14.1 / 20

    3.3k stars on GitHub (logarithmic)

  • Not archived 10.0 / 10

    Repository is active

  • Docker support 10.0 / 10

    Docker image or Compose file available

Commit activity

1311 commits over the last 12 months
304
Last 90 days
1,311
Last 12 months
6 days ago
Last push

Ranked #10 of 14 tools in Generative Artificial Intelligence (GenAI) by health , between Agenta (#9) and GoModel (#11) .

Details

LicenceApache-2.0
PlatformsDocker, Shell
Latest releasev0.5.17 · 6 days ago
Stars3,256
Open issues40
DockerYes
Repositoryav/harbor ↗

LLM Harbor vs its top 5 alternatives

Active tools that share a category with LLM Harbor (Generative Artificial Intelligence (GenAI)), scored on the same five terms.

Tool Health Stars Licence Last commit
LobeHub 100 84k ⊘ Proprietary today
Ollama 100 185k MIT today
Open-WebUI 100 157k BSD-3-Clause today
AnythingLLM 99 68k MIT today
LibreChat 99 46k MIT today
LLM Harbor (this tool) 94 3.3k Apache-2.0 6 days ago

LLM Harbor: common questions

Is LLM Harbor still maintained?

LLM Harbor had 304 commits in the last 90 days and its last push was 6 days ago; the latest tagged release, v0.5.17, is from 6 days ago. Repoly recomputes this nightly.