Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GenAI Evaluation: Update built-in component #3775

Open
prise6 opened this issue Jan 20, 2025 · 0 comments
Open

GenAI Evaluation: Update built-in component #3775

prise6 opened this issue Jan 20, 2025 · 0 comments

Comments

@prise6
Copy link

prise6 commented Jan 20, 2025

As i described in another issue in azureml-ai sdk (Azure/azure-sdk-for-python#39075) : the monitoring in AzureML for LLMs is broken due to marshmallow updates.

Therefore, I saw that you updated the component generation_safety_quality_signal_monitor in this repo to v0.5.23.

But it's not updated with AzureML Monitor REST API because it creates a monitoring signal with old version of generation_safety_quality_signal_monitor (v0.4.16).

Please take a look to my issue i opened in your other repo. Do you update sometimes the monitor API to update the component version ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant