Introduce provider and key cost optimization strategy

[mcowger]

Title

Introduce provider and key cost optimization strategy

Relevant issues

NA

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

• I have Added testing in the tests/litellm/ directory
• I have added a screenshot of my new test passing locally
• My PR passes all unit tests on make test-unit
  • Author Note: All added tests pass, as do tests for any touched files. The repo's test passing rate is not currently healthy on the unmodified main branch - if you check out the branch on a net new machine and run make test-unit, they do not all (or even mostly) pass.
• My PR's scope is as isolated as possible, it only solves 1 specific problem
  • Yes, this is as small as I could make it, while keeping it revert-able as a unit.

Type

🆕 New Feature
📖 Documentation
✅ Test

Changes

• Implement hierarchical cost lookup: litellm_params > model_info > global_cost_map > token_usage_fallback
• Add support for explicit zero costs in model_info for free models
• Add comprehensive logging for deployment selection decisions including cost sources and calculations
• Update documentation with cost configuration examples and troubleshooting guide
• Add test coverage for new cost lookup priority system

Passing Tests:

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jul 19, 2025 11:47pm