Guides about llm
- How to install Ollama on Ubuntu or Debian and run local LLMs Install Ollama as a systemd service, pull and run open models on CPU or GPU, test the REST API, move model storage and reach the API securely without exposing port 11434. Beginner 30 min
- How to run Open WebUI with Ollama using Docker Compose and HTTPS Deploy Open WebUI with Docker Compose next to Ollama, connect them without opening port 11434, create the admin account privately, publish it over HTTPS with Caddy and keep it backed up and updated. Intermediate 35 min
- How to run llama.cpp server as an OpenAI-compatible API Compile llama.cpp, test llama-server with a GGUF model from Hugging Face, run it as a hardened systemd service on 127.0.0.1 with an API key, and publish the OpenAI-compatible API over HTTPS. Intermediate 40 min
- How to install vLLM on an NVIDIA GPU server with Docker Prepare an NVIDIA GPU server, run vllm/vllm-openai with Docker Compose on 127.0.0.1, secure it with an API key and a Caddy proxy that only exposes /v1, tune memory and multi-GPU settings, or install it with uv and systemd. Advanced 45 min
- How to install LocalAI with Docker Compose as an OpenAI-compatible API Deploy LocalAI from the official container images, require an API key for every request, install a model from the gallery, test the OpenAI-compatible API and publish it over HTTPS behind Caddy. Intermediate 35 min
- How to install AnythingLLM with Docker, HTTPS and Ollama Run the official AnythingLLM Docker image with persistent storage and your own secrets, switch on multi-user mode before going public, publish it over HTTPS with Caddy and connect Ollama. Intermediate 30 min
- How to self-host Dify with Docker Compose and HTTPS Clone a Dify release, replace the default passwords and keys in .env, bind the bundled Nginx to localhost behind Caddy, protect the first-run page and learn the backup and upgrade routine. Intermediate 45 min
- How to install Flowise with Docker Compose and HTTPS Install the final Flowise 3.1.4 image with Docker Compose, store data and keys on the host, create the admin account through an SSH tunnel, publish it with Caddy and plan for an archived project. Intermediate 30 min
- How to install Langflow with Docker Compose and PostgreSQL Run the official Langflow image with PostgreSQL, turn off auto-login with a superuser and your own secret key, publish it over HTTPS with Caddy, connect Ollama and keep code execution private. Intermediate 35 min
- How to self-host the OpenHands AI agent platform with Docker Deploy OpenHands Agent Canvas, the open-source platform for AI coding agents, with Docker Compose, protect it with an API key and an IP allowlist, connect a model and keep the agent's sandbox tight. Advanced 40 min