Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[doc] CDC docs changes for 2024.2.2 release #25794

Conversation

Sumukh-Phalgaonkar
Copy link
Contributor

@Sumukh-Phalgaonkar Sumukh-Phalgaonkar commented Jan 29, 2025

This PR contains the following changes to CDC documentation for 2024.2.2 release:

  • The flags cdc_intent_retention_ms and cdcsdk_tablet_not_of_interest_timeout_secs are now both master as well as tserver flags. So here we add these flags to the master list as well.
  • The default value of the flag cdcsdk_publication_list_refresh_interval_secs has been reduced to 900 seconds (15 mins) from 3600 seconds (1 hr). This change also required changing an example in documentation about the behaviour of dynamic tables in logical replication.
  • Added a limitation regarding prevention of consumption of a slot by multiple consumers at the same time.
  • A new metric cdcsdk_flush_lag has been introduced for logical replication. In this PR we have added it to the list of CDC metrics

Copy link

netlify bot commented Jan 29, 2025

Deploy Preview for infallible-bardeen-164bc9 ready!

Name Link
🔨 Latest commit 667ea95
🔍 Latest deploy log https://app.netlify.com/sites/infallible-bardeen-164bc9/deploys/67c100e612b1d80008f32402
😎 Deploy Preview https://deploy-preview-25794--infallible-bardeen-164bc9.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@Sumukh-Phalgaonkar Sumukh-Phalgaonkar force-pushed the add-intent-retention-flag-to-master-docs branch from 8d87a4e to 86e594d Compare February 6, 2025 10:59
@Sumukh-Phalgaonkar Sumukh-Phalgaonkar changed the title [doc] Doc changes for the recent update in the default values of CDC flags [doc] CDC doucmentation changes for 2024.2.2 release Feb 6, 2025
@ddhodge ddhodge added the area/documentation Documentation needed label Feb 11, 2025
@ddhodge ddhodge changed the title [doc] CDC doucmentation changes for 2024.2.2 release [doc] CDC docs changes for 2024.2.2 release Feb 17, 2025
```

{{< note title="Important" >}}
In the event that a user ends up reducing the value of `cdcsdk_publication_list_refresh_interval_secs`, it is recommended to increase the value of the flag back to its original value once you start receiving changes from the new table.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For every publication refresh we incur overhead to invalidate the relcache. Reducing the interval for publication refresh would mean we incur this overhead much more frequently.

@ddhodge ddhodge merged commit 73e3aef into yugabyte:master Feb 28, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/documentation Documentation needed
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

3 participants