Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

consumer oom when progress big message #11322

Open
Lily2025 opened this issue Jun 17, 2024 · 3 comments
Open

consumer oom when progress big message #11322

Lily2025 opened this issue Jun 17, 2024 · 3 comments
Assignees
Labels
area/ticdc Issues or PRs related to TiCDC. severity/moderate This is a moderate bug. type/bug This is a bug.

Comments

@Lily2025
Copy link

Lily2025 commented Jun 17, 2024

What did you do?

1、create changefeed
2、run cdc boundary workload which exist big message
/workload --database-host=tc-tidb.endless-ha-test-ticdc-simple-protocol-tps-7545174-1-679 --database-port=4000 --database-db-name=cdc_boundary --database-user=root --workload-type=large_row --tps=1000 --row-count=10000000 --table-count=16 --large-row-size=1048576 --large-ratio=0.010000 --thread=16 -skip-create-table
3、consumer oom (the memory of consumer is 32GB)

What did you expect to see?

no oom

What did you see instead?

consumer oom when progress big message

Versions of the cluster

[2024/06/15 17:36:27.810 +08:00] [INFO] [version.go:47] ["Welcome to kafka consumer"] [release-version=v8.2.0-master] [git-hash=854a4abb24eb486ad026a6b95a0215a05224f8ed] [git-branch=HEAD] [utc-build-time="2024-06-11 06:45:38"] [go-version="go version go1.21.11 linux/amd64"] [failpoint-build=false]
[2024/06/15 17:36:27.812 +08:00] [INFO] [tz.go:35] ["Use the timezone of the TiCDC server machine"] [timezoneName=System] [timezone=Asia/Shanghai]

current status of DM cluster (execute query-status <task-name> in dmctl)

No response

@Lily2025 Lily2025 added area/dm Issues or PRs related to DM. type/bug This is a bug. labels Jun 17, 2024
@Lily2025
Copy link
Author

/remove-area dm
/area ticdc

@github-actions github-actions bot added this to Need Triage in Question and Bug Reports Jun 17, 2024
@ti-chi-bot ti-chi-bot bot added area/ticdc Issues or PRs related to TiCDC. and removed area/dm Issues or PRs related to DM. labels Jun 17, 2024
@Lily2025
Copy link
Author

/assign 3AceShowHand

@fubinzh
Copy link

fubinzh commented Jun 17, 2024

/severity moderate

@ti-chi-bot ti-chi-bot bot added the severity/moderate This is a moderate bug. label Jun 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ticdc Issues or PRs related to TiCDC. severity/moderate This is a moderate bug. type/bug This is a bug.
Projects
Development

No branches or pull requests

3 participants