Skip to content

Windows

Matthew Altenburg edited this page May 16, 2025 · 1 revision

πŸͺŸ Setting Up Docker on Windows

This guide walks you through installing Docker on Windows 10/11 using Docker Desktop, with optional GPU support via WSL2 and NVIDIA drivers.

⚠️ Note: Windows setup can vary depending on version, hardware, and existing software.
If you hit issues, consult the official Docker docs, or ask in our Discord.


πŸ“¦ Step 1: Install Docker Desktop

Download and install Docker Desktop for Windows:

πŸ‘‰ Download Docker Desktop

During installation:

  • Accept default settings
  • Ensure "Use WSL2 instead of Hyper-V" is selected
  • Reboot if prompted

βš™οΈ Step 2: Enable WSL2

Docker Desktop requires Windows Subsystem for Linux 2 (WSL2).

  1. Open PowerShell as Administrator and run:
wsl --install
  1. Reboot your machine when prompted

  2. After reboot, verify WSL2 is working:

wsl --status

It should show Default Version: 2 and your installed distro (like Ubuntu).

If needed, install Ubuntu from the Microsoft Store.


πŸ› οΈ Step 3: Enable WSL Integration in Docker

After installing Docker Desktop:

  1. Open Docker Desktop
  2. Go to Settings β†’ Resources β†’ WSL Integration
  3. Enable Docker integration for your Linux distro (e.g. Ubuntu)

⚑ Step 4: (Optional) Enable GPU Support with NVIDIA + WSL2

If you have a supported NVIDIA GPU, you can run GPU-accelerated containers under WSL2.

🧩 Prerequisites

  • Windows 10 (Build 20145+) or Windows 11
  • WSL2 enabled
  • Recent NVIDIA GPU and drivers

πŸ“₯ Install NVIDIA WSL2 Drivers

  1. Install the latest Windows GPU Driver for WSL:
    πŸ‘‰ NVIDIA WSL Driver Download

  2. Inside WSL (e.g., Ubuntu), install nvidia-container-toolkit:

sudo apt update
sudo apt install -y nvidia-container-toolkit
sudo systemctl restart docker

βœ… Step 5: Test the Setup

To test Docker and GPU support (inside WSL):

docker run --rm --gpus all nvidia/cuda:12.0-base nvidia-smi

You should see GPU details printed if everything is working.

To test Docker in general:

docker run hello-world

🎯 Next Step: Set Up the JoeyLLM Container

Once Docker is installed and WSL2 is ready, continue here:
πŸš€ Launching the JoeyLLM Development Container

Clone this wiki locally