Replies: 1 comment 9 replies
-
hi @olad32 that's interesting when would you do it this way? |
Beta Was this translation helpful? Give feedback.
9 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, is it planned to be able to apply rate limit tpm/rpm on key but with a different rate limit per model ? the same way we can already apply a budget for a key and a specific model as describe here https://litellm.vercel.app/docs/proxy/users#add-model-specific-budgets-to-keys
As of today a key can grant access to multiple model, but the rate limit applied globally to multiple model does not makes a lot of sense in practical use.
Thanks
Beta Was this translation helpful? Give feedback.
All reactions