Skip to content

Chunking overview: remove usage note about not setting combine text >= new after n characters #662

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 20, 2025

Conversation

Paul-Cornell
Copy link
Collaborator

After spending several hours testing the previously-published usage note's admonitions with a variety of different chunking settings and document types, there seemed to be no impact on the results. If this surfaces as a significant issue with customers, the removed content can of course be added back in later with additional explanation as necessary.

Also, added slightly more commentary to explain some of the remaining conceptual diagrams.

@Paul-Cornell Paul-Cornell requested a review from vannestn June 17, 2025 17:03
@Paul-Cornell Paul-Cornell changed the title Chunking overview: remove usage note about note setting combine text >= new after n characters Chunking overview: remove usage about note setting combine text >= new after n characters Jun 17, 2025
@Paul-Cornell Paul-Cornell changed the title Chunking overview: remove usage about note setting combine text >= new after n characters Chunking overview: remove usage note about not setting combine text >= new after n characters Jun 17, 2025
Copy link
Contributor

@vannestn vannestn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Paul-Cornell Paul-Cornell merged commit 237d8fa into main Jun 20, 2025
1 check passed
@Paul-Cornell Paul-Cornell deleted the combine-text-2025-06-17 branch June 20, 2025 16:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants