feat: google vertex llm #599
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
|
@jrj5423 is attempting to deploy a commit to the pingcap Team on Vercel. A member of the Team first needs to authorize it. |
There was a problem hiding this comment.
Keep the ANTHROPIC_VERTEX for compatibility, we will delete it in the feature.
Please also support dsp.GoogleVertexAI on dspy LM
autoflow/backend/app/utils/dspy.py
Line 76 in 61597f7
backend/app/rag/llms/provider.py
Outdated
| @@ -132,6 +133,22 @@ class LLMProviderOption(BaseModel): | |||
| "private_key_id": "****", | |||
| }, | |||
| ), | |||
| LLMProviderOption( | |||
There was a problem hiding this comment.
rename the provider name of ANTHROPIC_VERTEX option to Anthropic Vertex AI (Deprecated)
| @@ -8,6 +8,7 @@ class LLMProvider(str, enum.Enum): | |||
| OPENAI = "openai" | |||
| GEMINI = "gemini" | |||
| ANTHROPIC_VERTEX = "anthropic_vertex" | |||
There was a problem hiding this comment.
Keep the LLMProvider.ANTHROPIC_VERTEX enumeration to avoid errors for users who are already using it.
There was a problem hiding this comment.
It is probably only us who are using ANTHROPIC_VERTEX, so I suggest to delete it in the code. we(tidb.ai) can re-configure it in production environment.
Mini256
force-pushed
the
vertex_support
branch
from
374aae7 to
c03e728
Compare
Mini256
force-pushed
the
vertex_support
branch
from
c03e728 to
0eaab28
Compare
Close pingcap#523. Considering that our current `llama_index` can already support `Vertex`, should we merge `ANTHROPIC_VERTEX` into the same type as `VERTEX` in this commit? --------- Co-authored-by: Mini256 <[email protected]>
Close pingcap#523. Considering that our current `llama_index` can already support `Vertex`, should we merge `ANTHROPIC_VERTEX` into the same type as `VERTEX` in this commit? --------- Co-authored-by: Mini256 <[email protected]>
Close #523.
Considering that our current
llama_indexcan already supportVertex, should we mergeANTHROPIC_VERTEXinto the same type asVERTEXin this commit?