Skip to main content

Hosting Overview

Standard Hosting​

Start with Getting Started

Advanced Hosting​

System OS​

Container Management​

External Network (Access Remotely)​

  • VPN — the most secure option (skip Caddy/Cloudflare)
  • Caddy — Reverse proxy (Alt: Traefik/Nginx)
  • Cloudflare — DNS/domain manager

Networking​

All services connect to a single Docker bridge network named exist, created automatically by docker compose up. Containers reach each other by container name (http://ollama:11434); see How It Works for the full model.

Traffic on this network is not encrypted

A bridge network is single-host and carries plain traffic between containers. It is not an overlay, there is no IPsec, and it does not span hosts. To run services on more than one box, treat them as complementary services reached over a URL rather than trying to stretch this network across hosts.

GPU on Another Host​

  • A Separate AI Box: llama.cpp, ComfyUI and TTS on one GPU box, with the stack pointed at it

Observability​

  • Prometheus — Metrics collection (+ Pushgateway for Decree)
  • Loki — Log aggregation (+ Alloy for Decree run logs)
  • Grafana — Dashboards over Prometheus and Loki
  • Uptime-Kuma — Simple availability monitoring, separate from the Prometheus/Grafana stack above

Network​

  • Pi-hole — DNS ad blocking and DHCP