Releases: feifeibear/long-context-attention
Releases · feifeibear/long-context-attention
v0.2 released on 24th June 2024!
- Ulysses supports T4 and V100.
- Updates some directory structures.
v0.1
Sequence parallel attention adopting a hybrid ulysses and ring attention approach.
Support GQA
Support QKV packed.