Results for “gpu servers”
- How to install vLLM on an NVIDIA GPU server with Docker Prepare an NVIDIA GPU server, run vllm/vllm-openai with Docker Compose on 127.0.0.1, secure it with an API key and a Caddy proxy that only exposes /v1, tune memory and multi-GPU… Advanced 45 min
- How to install ComfyUI on an NVIDIA GPU server securely Set up ComfyUI from the official repository on a GPU server, run it under its own user with systemd, keep it off the public internet, add HTTPS with basic authentication, and… Intermediate 45 min
- How to install Ollama on Ubuntu or Debian and run local LLMs …as a systemd service, pull and run open models on CPU or GPU, test the REST API, move model storage and reach the API securely without exposing port 11434. Ollama is a runtime… Beginner 30 min
- How to install LocalAI with Docker Compose as an OpenAI-compatible API …HTTPS behind Caddy. LocalAI is an open-source engine that serves language, image, speech and embedding models through a REST API compatible with OpenAI's. Applications written… Intermediate 35 min
- How to install JupyterLab on a Linux server with systemd and HTTPS …service bound to 127.0.0.1, SSH tunnel or Caddy access, GPU support, backups and updates. JupyterLab is Project Jupyter's web-based environment for notebooks, code, terminals… Intermediate 30 min
- Fix Remote Desktop connection problems on Windows servers …credentials and sessions, and get back to your Windows server. Remote Desktop problems fall into a few groups: the connection does not reach the server, the sign-in is… Beginner 10 min
- Windows Defender Firewall rules with PowerShell Windows Server's built-in firewall is all most servers need. These PowerShell commands cover the rules you will use, and how to test them safely. Windows Defender Firewall is… Intermediate 15 min
- How to run llama.cpp server as an OpenAI-compatible API Compile llama.cpp, test llama-server with a GGUF model from Hugging Face, run it as a hardened systemd service on 127.0.0.1 with an API key, and publish the OpenAI-compatible API… Intermediate 40 min
- How to install Jellyfin with Docker and HTTPS …the configuration. Jellyfin is a free, open-source media server. It organises your movies, shows and music, fetches artwork and metadata, and streams everything to its web… Intermediate 30 min
- How to install Immich with Docker Compose and HTTPS …before you upload your library. Prerequisites A 64-bit server (amd64 or arm64) running Ubuntu 24.04 or 26.04 LTS or Debian 12 or 13. Since v3, the machine learning image on… Intermediate 35 min