Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to reuse a llm_client in awel #2320

Open
316xu opened this issue Jan 23, 2025 · 3 comments
Open

how to reuse a llm_client in awel #2320

316xu opened this issue Jan 23, 2025 · 3 comments

Comments

@316xu
Copy link

316xu commented Jan 23, 2025

llm_task1=LLMOperator(llm_client)
llm_task2=LLMOperator(llm_client)

input_task >> llm_task1 >> merge_task
input_task >> merge_task
merge_task >> llm_task2

fail with:
Share data key share_data_key_model_name already exists.

@Aries-ckt
Copy link
Collaborator

Can you show me your case in full? I'll try.

@paul-yangmy
Copy link

! 遇到同样的报错了,ValueError: Share data key share_data_key_model_name already exists 应该是无法复用llm_client的问题

Image

@paul-yangmy
Copy link

! 遇到同样的报错了,ValueError: Share data key share_data_key_model_name already exists 应该是无法复用llm_client的问题

Image

感谢程老师,已解决。LLMOperator执行时会保存share_data,默认算子中存在SHARE_DATA_KEY唯一,当第二次调用时就会报这个错了,设计的key为SHARE_DATA_KEY_MODEL_NAME和SHARE_DATA_KEY_MODEL_OUTPUT,可以自己重写一个LLMOperator算子,添加overwrite=True即可

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants