Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lower default chunking max segment sizes #15

Merged
merged 1 commit into from
Nov 4, 2024

Conversation

melw66
Copy link
Contributor

@melw66 melw66 commented Nov 4, 2024

For each embedding model, lowered the default chunking max segment size in characters from the max character limit to a lower value for each Bedrock embedding model so that model token count limits are not hit with the default configuration.

  • Amazon Titan Text Embeddings V1
    • Token limit: 8,192 tokens
    • Max character limit: 50,000
    • New default character limit: 16,000
  • Amazon Titan Text Embeddings V2
    • Token limit: 8,192 tokens
    • Max character limit: 50,000
    • New default character limit: 16,000
  • Amazon Titan Multimodal Embeddings G1
    • Token limit: 128 tokens
    • Max character limit: 100,000
    • New default character limit: 50,000
  • Cohere Embed English
    • Token limit: 512 tokens
    • Max character limit: 2048
    • New default character limit: 1000
  • Cohere Embed Multilingual
    • Token limit: 512 tokens
    • Max character limit: 2048
    • New default character limit: 1000

@melw66 melw66 requested a review from vaibhavisobti November 4, 2024 21:48
@melw66 melw66 merged commit 195b1e5 into main Nov 4, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants