Results for “llm api”
- How to run llama.cpp server as an OpenAI-compatible API …run it as a hardened systemd service on 127.0.0.1 with an API key, and publish the OpenAI-compatible API over HTTPS. llama.cpp is an open-source C/C++ engine for running large… Intermediate 40 min
- How to install LocalAI with Docker Compose as an OpenAI-compatible API …LocalAI from the official container images, require an API key for every request, install a model from the gallery, test the OpenAI-compatible API and publish it over HTTPS… Intermediate 35 min
- How to install vLLM on an NVIDIA GPU server with Docker …with Docker Compose on 127.0.0.1, secure it with an API key and a Caddy proxy that only exposes /v1, tune memory and multi-GPU settings, or install it with uv and systemd.… Advanced 45 min
- How to install Ollama on Ubuntu or Debian and run local LLMs …pull and run open models on CPU or GPU, test the REST API, move model storage and reach the API securely without exposing port 11434. Ollama is a runtime that downloads open… Beginner 30 min
- How to self-host the OpenHands AI agent platform with Docker …AI coding agents, with Docker Compose, protect it with an API key and an IP allowlist, connect a model and keep the agent's sandbox tight. An AI agent framework lets a language… Advanced 40 min
- How to install AnythingLLM with Docker, HTTPS and Ollama …meant for servers, with roles, password protection and an API. This guide runs the official mintplexlabs/anythingllm image with Docker Compose on Ubuntu or Debian. You keep all… Intermediate 30 min
- How to install Flowise with Docker Compose and HTTPS …archived project. Flowise is a low-code tool for building LLM applications and agents: you connect nodes for models, prompts, document loaders, vector stores and tools on a… Intermediate 30 min
- How to install Langflow with Docker Compose and PostgreSQL …private. Langflow is a visual builder for AI agents and LLM workflows. You drag components for models, prompts, vector stores, tools and agents onto a canvas, test the flow in… Intermediate 35 min
- How to self-host Dify with Docker Compose and HTTPS …retrieval (RAG) and visual workflows, each with its own API. The official way to self-host it is Docker Compose from the project's repository. The default stack runs the API,… Intermediate 45 min
- How to run Open WebUI with Ollama using Docker Compose and HTTPS …and it works with Ollama as well as with OpenAI-compatible APIs. This guide runs Open WebUI with Docker Compose, connects it to Ollama without exposing Ollama's API, publishes… Intermediate 35 min