harbor

Harbor crossed its 127th (next one is special) release. One notable added feature is ability to manage all my LLMs with a single CLI. # list all models harbor ls # pairs well with jq harbor ls --json # Ollama harbor pull qwen3.5:35b # llama.cpp harbor pull unsloth/Qwen3.5-35B-A3B-GGUF:Q8_0 # vllm (HuggingFace Hub cache) harbor pull Qwen/Qwen3.5-35B-A3B # Remove any of the models by the same id # used to pull it harbor rm <id> Hopefully it'll be useful for someone too.

I use coding agents for similar kind of problem very frequently. It makes wonders debugging obscure system issues related to components that I have no faintest idea about. Also building a homelab very soon. I think you may find this project useful: https://github.com/av/harbor

Just a fun little workflow I made. You can find the code here: https://github.com/av/harbor/blob/main/boost/src/modules/dnd...

There are too many LLM-related projects. Setting up multiple runtimes, Python, Node, Go, Rust and then some environments, different CUDA versions, dependencies is tedious. Managing updates later is even worse. So, I'm building a toolkit that allows to keep things simple for the end user. Run Ollama and Open WebUI configured to work together: `harbor up ollama webui`. Don't like Ollama? Then `harbor up llamacpp webui`. There are 17 backends, 14 frontends and 50+ different satellite projects, config profiles that can be imported from a URL, tunnels, and a helper desktop app. https://github.com/av/harbor?tab=readme-ov-file#what-can-har...

I work on Harbor (https://github.com/av/harbor), it is a project to save hours when setting up LLMs locally. I pre-integrated over 50 different LLM-related projects, added a nice CLI and a Desktop app on top to manage the configs.

harbor is a great docker bedrock for llm tools, has some tts stuff havent tried them https://github.com/av/harbor/wiki/1.1-Harbor-App#installatio...

This is a "Deep Dive" podcast generated with the NotebookLM using information from Harbor's Wiki. Harbor is a containerized LLM toolkit that allows you to run LLMs and additional services via a concise CLI. Repository: https://github.com/av/harbor

Building a toolkit to save hours of time when working with LLMs locally. For example, adding a TTS or Web RAG to the Open WebUI setup both are a single command. https://github.com/av/harbor

Hi, Harbor is a toolkit to run LLMs and related services locally. It's not designed as a deployment solution, rather as a convenient local environment. I was rocking a very similar setup (less components and features though) and then decided to polish it a little bit and make it open source. Few interesting details about the project: - Dynamic sub-selection of compose files to run together depending on which services are currently running. For example, Harbor knows that you're running SearXNG and Open WebUI together and injects a config for Web RAG based on SearXNG into the WebUI, same for TTS and LLM backends - CLI supports arguments scrambling via a retry, e.g. `harbor set config` and `harbor config set` run the same command, it's supported for nearly all first pairs of arguments to the CLI - Being an LLM project - after the setup you c