Argument gpu_layers=auto
#2365
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
It would be nice if there was something like gpu_layers =auto that automatically could query gpu for vram and calculate no of layers it could offload.
Beta Was this translation helpful? Give feedback.
All reactions