Skip to content

Commit

Permalink
Update src/accelerate/utils/modeling.py
Browse files Browse the repository at this point in the history
Co-authored-by: Zach Mueller <[email protected]>
  • Loading branch information
SunMarc and muellerzr authored Dec 8, 2023
1 parent 728ccfb commit 67bc228
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/accelerate/utils/modeling.py
Original file line number Diff line number Diff line change
Expand Up @@ -697,7 +697,7 @@ def get_max_memory(max_memory: Optional[Dict[Union[int, str], Union[int, str]]]
max_memory["cpu"] = psutil.virtual_memory().available * 0.8
logger.info(
"We will use 80% of the memory on cpu for storing the model."
"You can set `max_memory["cpu"]` in to a higher value to use more memory (at your own risk)."
"You can set `max_memory['cpu']` in to a higher value to use more memory (at your own risk)."
)

# Need to sort the device by type to make sure that we allocate the gpu first.
Expand Down

0 comments on commit 67bc228

Please sign in to comment.