Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: The producer of kafka breaks the wal semantics #38531

Closed
1 task done
chyezh opened this issue Dec 17, 2024 · 0 comments
Closed
1 task done

[Bug]: The producer of kafka breaks the wal semantics #38531

chyezh opened this issue Dec 17, 2024 · 0 comments
Assignees
Labels
kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. severity/critical Critical, lead to crash, data missing, wrong result, function totally doesn't work.

Comments

@chyezh
Copy link
Contributor

chyezh commented Dec 17, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version: master-8916fbf12274da2e3689843ff961788e4ff0c7dc
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    kafka
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

Milvus's Kafka use a shared channel to receive the produce result.
Which can make one produce operation receive the result of other produce operation.
When concurrent write on milvus of kafka, the behaviour is generally undefined.

	err := kp.p.Produce(&kafka.Message{
		TopicPartition: kafka.TopicPartition{Topic: &kp.topic, Partition: mqwrapper.DefaultPartitionIdx},
		Value:          message.Payload,
		Headers:        headers,
	}, kp.deliveryChan)

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

@chyezh chyezh added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Dec 17, 2024
@chyezh chyezh added the severity/critical Critical, lead to crash, data missing, wrong result, function totally doesn't work. label Dec 17, 2024
sre-ci-robot pushed a commit that referenced this issue Dec 17, 2024
sre-ci-robot pushed a commit that referenced this issue Dec 18, 2024
@chyezh chyezh closed this as completed Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. severity/critical Critical, lead to crash, data missing, wrong result, function totally doesn't work.
Projects
None yet
Development

No branches or pull requests

2 participants