New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[1] Release causal prefix flashattn #1

Closed

timt51 opened this issue Nov 16, 2022 · 1 comment · May be fixed by #2

Assignees

Collaborator

timt51 commented Nov 16, 2022 •

edited

Loading

Release a new version of flash attention with causal prefix cross-attention.

Since only the forward pass is implemented, this should be released on its own branch. We should maybe also block backprop from running or something...
Include tests

timt51 changed the title ~~Release causal prefix flashattn~~ [1] Release causal prefix flashattn

timt51 self-assigned this

timt51 linked a pull request

that will close this issue

WIP: causal prefix mask with adjusted tests #2

Draft

Collaborator Author

timt51 commented Nov 18, 2022

Released https://github.com/OpenProteinAI/flash-attention/releases/tag/v0.1.2-causal-prefix

timt51 closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment