Skip to content

[tidbx] the upstream and downstream data are inconsistent after run some HA test with downstream is kafka #5588

Description

@Lily2025

What did you do?

1,create changefeed with downstream is kafka
2,run ha test such as tikv failure,pd failure
3,stop workload
4,compare the data consistency between upstream and downstream

What did you expect to see?

data consistent between upstream and downstream

What did you see instead?

the upstream and downstream data are inconsistent after run some HA test with downstream is kafka

�[1A�[JProgress [============================================================>] 100%!/(MISSING)0
�[1A�[JProgress [============================================================>] 100%!/(MISSING)0
The data of sysbench_64_7000w.sbtest49 is not equal

The rest of tables are all equal.

A total of 1 tables have been compared, 0 tables finished, 1 tables failed, 0 tables skipped.
The patch file has been generated in
'output_20260705_131711/fix-on-downstream/'
You can view the comparison details through './output_20260705_131711/sync_diff.log'

Versions of the cluster

./cdc version
Release Version: v26.3.2
Git Commit Hash: fdac244
Git Branch: HEAD
UTC Build Time: 2026-06-23 06:38:13
Go Version: go version go1.25.10 linux/amd64
Failpoint Build: false
Kernel Type: Next Generation
2026-07-05T12:22:25.008+0800

consumer version
[2026/07/05 00:36:56.399 +00:00] [INFO] [version.go:47] ["Welcome to kafka consumer"] [release-version=v8.5.4-nextgen.202510.5-303-gd2da619] [git-hash=d2da619279f877a9964facdabebdc608044523cd] [git-branch=HEAD] [utc-build-time="2026-07-02 08:14:34"] [go-version="go version go1.25.10 linux/amd64"] [failpoint-build=false] [kernel-type=Classic]

Metadata

Metadata

Assignees

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions