Skip to content

Feature/vertex ai fine tuning #12835

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

stuagano
Copy link

Title

Relevant issues

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

  • I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
  • I have added a screenshot of my new test passing locally
  • My PR passes all unit tests on make test-unit
  • My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🆕 New Feature
🐛 Bug Fix
🧹 Refactoring
📖 Documentation
🚄 Infrastructure
✅ Test

Changes

stuagano added 7 commits July 19, 2025 07:44
- Add supervised fine-tuning module with job creation, monitoring, and validation
- Add online prediction module for custom Vertex AI endpoints
- Integrate both modules with main LiteLLM API
- Add fine-tuning constants and model definitions
- Create comprehensive examples and documentation
- Add web-based data validation interface
- Update implementation plan with completed features
- Update .gitignore with comprehensive development artifacts
- Add upstream synchronization rules and git workflow guidelines
- Include Python and JAX best practices
- Add code quality standards and documentation requirements
- Include project-specific rules for Vertex AI integration
- Add maintenance tasks and troubleshooting guidelines
- Include security and privacy best practices
- Complete validation of code quality and standards
- Comprehensive testing and documentation review
- Security and best practices assessment
- Performance and compatibility evaluation
- Final approval for PR submission
- Remove unused imports (F401): json, httpx, typing.Union, etc.
- Remove unused variables (F841): vertex_ai_project, vertex_ai_location
- Remove print statements (T201): Replace with proper assertions in tests
- Clean up test files: Remove unused imports and print statements
- Maintain all functionality while ensuring code quality

All files now pass linting checks and compile successfully.
- Add typing.Optional import to minimal_test.py
- Add json import to transformation.py for error handling
- Resolves remaining F821 undefined name errors
Copy link

vercel bot commented Jul 21, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 21, 2025 9:46pm

- Remove inheritance from VertexLLM to avoid signature conflicts
- Use composition pattern with vertex_llm instance for authentication
- Simplify completion method signature to match expected interface
- Resolves MyPy type checking errors while maintaining functionality
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant