DEPS: migrate to Pydantic 2

[fangchenli]

Reference Issues or PRs

What does this implement/fix?

Put a x in the boxes that apply

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds a feature)
• Breaking change (fix or feature that would cause existing features not to work as expected)
• Documentation Update
• Code style update (formatting, renaming)
• Refactoring (no functional changes, no API changes)
• Build related changes
• Other (please describe):

Testing

• Did you test the pull request locally?
• Did you add new tests?

Any other comments?

[fangchenli]

Hey @fangchenli, how much more work do you think is involved in getting this PR ready for review? Currently only the Test Conda Build is failing. Is that the only thing that needs to be fixed?

Yes, the conda build test is the only thing left. It's unclear why it's failing. My plan is to split this PR and move some of the refactoring and cleanups to separate PRs.

[Adam-D-Lewis]

I'd like to take this over

[Adam-D-Lewis]

@fangchenli Thanks for your work on this! It looks great. Since your internship has ended, I'll assume you moved on to other things (but let me know if I'm wrong if you'd like to continue working on this), but I'd like to get this into Nebari. I'm going to close this PR and create a new one so I can commit to the working branch.