Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When to support lightseq? #3

Open
dogfeedsheep opened this issue Mar 21, 2022 · 1 comment
Open

When to support lightseq? #3

dogfeedsheep opened this issue Mar 21, 2022 · 1 comment

Comments

@dogfeedsheep
Copy link

dogfeedsheep commented Mar 21, 2022

We have been using lightseq to speed up training and inference of Transformer model, which seems to be your product too.

How to use vegiantmodel + lightseq to speedup large scale Transformer model training?

@gongwei-130
Copy link
Collaborator

gongwei-130 commented Mar 26, 2022

hi dogfeedsheep, thanks for you inquiry, it cannot use with lightseq currently, but we are working on some op optimization, which is still in progress, will update you once we are in a good shape to release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants