Skip to content

Docs: Added hardware recommendations for running Gemma #402

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Docs: Added hardware recommendations for running Gemma #402

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -86,8 +86,9 @@ To download the model weights. See

### System Requirements

Gemma can run on a CPU, GPU and TPU. For GPU, we recommend 8GB+ RAM on GPU for
The 2B checkpoint and 24GB+ RAM on GPU are used for the 7B checkpoint.
Gemma can run on a CPU, GPU, and TPU. For GPU, we recommend 8GB+ VRAM for the 2B checkpoint, which can be provided by the RTX 40 Series, RTX 30 Series, and RTX 20 Series (with the exception of the standard RTX 2060).

24GB+ VRAM is recommended for the 7B checkpoint. This capacity is available on consumer GPUs like the RTX 4090, RTX 3090 Ti, and RTX 3090, as well as professional and workstation cards like the RTX A5000, RTX A6000, and RTX 6000 Ada Generation.

### Contributing

Expand Down