MacOS

🍎 Setting Up Docker on macOS

This guide helps you install Docker on macOS to run the JoeyLLM development container in CPU-only mode. While JoeyLLM supports GPU acceleration on Linux and Windows (WSL2), macOS does not support GPU passthrough for Docker.

⚠️ Note: JoeyLLM runs fine on macOS for development and testing, but will be slower compared to GPU-enabled environments. You can still clone, build, test, and contribute without issues.

---

📦 Step 1: Install Docker Desktop for Mac

1. Download Docker Desktop:
   👉 Download Docker for macOS

2. Install the .dmg file and follow the prompts.

3. After installation, launch Docker Desktop from your Applications folder.

4. Ensure it is running (you should see the whale icon in the menu bar).

---

✅ Step 2: Verify Docker Installation

Open Terminal and run:

docker version

You should see client and server versions listed.

Then, run a test container:

docker run hello-world

You should see a success message confirming Docker is working.

---

⚡ Note on GPU Support

macOS does not support NVIDIA GPU passthrough in Docker. All containers will run on CPU only.

💡 That’s OK! You can still:

• Develop and test code
• Run inference in CPU mode
• Prepare pull requests and contribute to the project

---

🎯 Next Step: Set Up the JoeyLLM Container

Now that Docker is installed and verified, continue here:
🚀 Launching the JoeyLLM Development Container