Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: predownload Tiktoken tokenizer during Docker image build time #201

Merged
merged 4 commits into from
Feb 21, 2025
Merged

fix: predownload Tiktoken tokenizer during Docker image build time #201

merged 4 commits into from
Feb 21, 2025

Conversation

adubovik
Copy link
Collaborator

Resolves #188

@adubovik adubovik self-assigned this Feb 20, 2025
@adubovik
Copy link
Collaborator Author

adubovik commented Feb 20, 2025 •
edited by ai-dial-actions
Loading

/deploy-review

Environment URL: https://chat-ai-dial-adapter-openai-pr-201.nightly-test.deltixhub.io
E2E tests status: success

@adubovik
Copy link
Collaborator Author

adubovik commented Feb 20, 2025 •
edited by ai-dial-actions
Loading

/deploy-review

Environment URL: https://chat-ai-dial-adapter-openai-pr-201.nightly-test.deltixhub.io
E2E tests status: failed

@adubovik adubovik changed the title fix: urllib logs are enabled temporarily fix: predownload Tiktoken tokenizer during Docker image build time Feb 20, 2025
@adubovik adubovik marked this pull request as ready for review February 20, 2025 18:03
@adubovik
Copy link
Collaborator Author

adubovik commented Feb 21, 2025 •
edited by ai-dial-actions
Loading

/deploy-review

Environment URL: https://chat-ai-dial-adapter-openai-pr-201.nightly-test.deltixhub.io
E2E tests status: failed

@adubovik adubovik merged commit 850a5d2 into development Feb 21, 2025
6 checks passed
@adubovik adubovik deleted the fix/predownload-tictoken-bpe branch February 21, 2025 10:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@roman-romanov-o roman-romanov-o roman-romanov-o approved these changes

Assignees

@adubovik adubovik

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Preload tiktoken BPEs while building the Docker image
2 participants
@adubovik @roman-romanov-o