Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Unmarshalling metrics failure leads to forced deny writing. #38551

Closed
1 task done
jaime0815 opened this issue Dec 18, 2024 · 0 comments
Closed
1 task done

[Bug]: Unmarshalling metrics failure leads to forced deny writing. #38551

jaime0815 opened this issue Dec 18, 2024 · 0 comments
Assignees
Labels
kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one.
Milestone

Comments

@jaime0815
Copy link
Contributor

jaime0815 commented Dec 18, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version:master
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

Writing will be denied if the rate limiter enabled

2024-12-18 03:27:08.417 | [2024/12/18 03:27:08.417 +00:00] [WARN] [rootcoord/quota_center.go:921] ["QuotaCenter force deny writing due to long timeTick delay"] [collectionID=454683903180698811] [curTs=2024/12/18 03:27:08.412 +00:00] [delay=481803h27m8.412s] [MaxDelay=20m0s] |  
 2024-12-18 03:27:08.416 | [2024/12/18 03:27:08.416 +00:00] [WARN] [datacoord/metrics_info.go:383] ["invalid metrics of IndexNode found"] [error="json: invalid use of ,string struct tag, trying to unmarshal unquoted value into float64"]

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

@jaime0815 jaime0815 added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Dec 18, 2024
@jaime0815 jaime0815 added this to the 2.5.0 milestone Dec 18, 2024
sre-ci-robot pushed a commit that referenced this issue Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one.
Projects
None yet
Development

No branches or pull requests

2 participants