-
Notifications
You must be signed in to change notification settings - Fork 19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement Automatic Model List Retrieval for SiliconCloud LLM API Node #135
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
非常感谢你的工作,做了我们一直想做但是没做的事情。 有个小小的建议,现在 model list 已经可以通过加 type 参数过滤出语言模型了,可否同步更新上:
|
doombeaker
reviewed
Oct 11, 2024
doombeaker
approved these changes
Oct 16, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Implement Automatic Model List Retrieval for SiliconCloud LLM API Node
Description
This PR implements the functionality of automatically retrieving the model list for the "☁️BizyAir SiliconCloud LLM API" node. By querying the https://api.siliconflow.cn/v1/models interface, it dynamically updates the model dropdown options, thereby enhancing user experience and allowing users to access real-time information about available models.
Changes
The automatic model list retrieval for the "☁️BizyAir SiliconCloud LLM API" node is implemented through frontend-backend interaction:
Backend:
/bizyair/get_silicon_cloud_models
as the interface for the frontend to retrieve the model listFrontend:
Frontend-Backend Interaction:
This implementation ensures that users see the most up-to-date model list every time they create a node, without the need for manual updates or application restarts.
Current Limitations
Currently, the API response does not include information about model categories or whether models are free or not. This limits our ability to effectively filter models. As a result, all available models are displayed without categorization.
Future Improvements
SiliconFlow has indicated that model filtering functionality will be supported in the near future. Once this feature becomes available, we can further improve this implementation:
为SiliconCloud LLM API节点实现自动获取模型列表功能
描述
本 PR 为"☁️BizyAir SiliconCloud LLM API"节点实现了自动获取模型列表的功能。通过查询 https://api.siliconflow.cn/v1/models 接口,动态更新模型下拉选项,从而提升了用户体验,使用户能够实时了解可用的模型。
变更
为"☁️BizyAir SiliconCloud LLM API"节点实现了自动获取模型列表的功能,主要通过前后端的联动实现:
后端:
/bizyair/get_silicon_cloud_models
,作为前端获取模型列表的接口前端:
前后端联动:
这种实现确保了每次创建节点时,用户都能看到最新的模型列表,无需手动更新或重启应用。
当前局限性
目前,API 返回的信息不包含模型分类或是否免费等信息,这限制了我们有效筛选模型的能力。因此,所有可用模型都会被显示,没有进行分类。
未来改进
SiliconFlow 表示近期将支持模型筛选功能。一旦这个功能可用,我们可以进一步改进此实现: