-
Notifications
You must be signed in to change notification settings - Fork 210
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
h2o for kv cache compression #1468
Commits on Apr 10, 2024
-
Signed-off-by: n1ck-guo <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 41d8647 - Browse repository at this point
Copy the full SHA 41d8647View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for eb7f564 - Browse repository at this point
Copy the full SHA eb7f564View commit details
Commits on Apr 23, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c46ea7d - Browse repository at this point
Copy the full SHA c46ea7dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 95ff9ae - Browse repository at this point
Copy the full SHA 95ff9aeView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 9d27733 - Browse repository at this point
Copy the full SHA 9d27733View commit details
Commits on Apr 25, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 444490d - Browse repository at this point
Copy the full SHA 444490dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4309089 - Browse repository at this point
Copy the full SHA 4309089View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8c5272e - Browse repository at this point
Copy the full SHA 8c5272eView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 1b83e52 - Browse repository at this point
Copy the full SHA 1b83e52View commit details
Commits on May 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 3fd73cb - Browse repository at this point
Copy the full SHA 3fd73cbView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for a2d3ae0 - Browse repository at this point
Copy the full SHA a2d3ae0View commit details
Commits on May 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for ddf5445 - Browse repository at this point
Copy the full SHA ddf5445View commit details
Commits on May 14, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 91d4394 - Browse repository at this point
Copy the full SHA 91d4394View commit details -
Configuration menu - View commit details
-
Copy full SHA for a83e6d6 - Browse repository at this point
Copy the full SHA a83e6d6View commit details
Commits on May 15, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 92c8a62 - Browse repository at this point
Copy the full SHA 92c8a62View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 70a1cf3 - Browse repository at this point
Copy the full SHA 70a1cf3View commit details
Commits on May 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for bc9eade - Browse repository at this point
Copy the full SHA bc9eadeView commit details -
update for real drop and sim mode, using the same api
Signed-off-by: n1ck-guo <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 9aa25f6 - Browse repository at this point
Copy the full SHA 9aa25f6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 03cdc8d - Browse repository at this point
Copy the full SHA 03cdc8dView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for e51b5b9 - Browse repository at this point
Copy the full SHA e51b5b9View commit details -
support for sdpa and flash attention
Signed-off-by: n1ck-guo <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for b8e9df2 - Browse repository at this point
Copy the full SHA b8e9df2View commit details -
Merge branch 'hengguo/h2o' of https://github.com/intel/intel-extensio…
…n-for-transformers into hengguo/h2o
Configuration menu - View commit details
-
Copy full SHA for 02f31b2 - Browse repository at this point
Copy the full SHA 02f31b2View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 274b7ed - Browse repository at this point
Copy the full SHA 274b7edView commit details
Commits on May 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 877329d - Browse repository at this point
Copy the full SHA 877329dView commit details -
Merge branch 'hengguo/h2o' of https://github.com/intel/intel-extensio…
…n-for-transformers into hengguo/h2o
Configuration menu - View commit details
-
Copy full SHA for b435e3e - Browse repository at this point
Copy the full SHA b435e3eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5068552 - Browse repository at this point
Copy the full SHA 5068552View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 5e5f589 - Browse repository at this point
Copy the full SHA 5e5f589View commit details
Commits on May 20, 2024
-
Configuration menu - View commit details
-
Copy full SHA for d0dce7d - Browse repository at this point
Copy the full SHA d0dce7dView commit details -
Merge branch 'hengguo/h2o' of https://github.com/intel/intel-extensio…
…n-for-transformers into hengguo/h2o
Configuration menu - View commit details
-
Copy full SHA for febb76a - Browse repository at this point
Copy the full SHA febb76aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 24c4725 - Browse repository at this point
Copy the full SHA 24c4725View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5bd3f16 - Browse repository at this point
Copy the full SHA 5bd3f16View commit details -
Configuration menu - View commit details
-
Copy full SHA for 955e132 - Browse repository at this point
Copy the full SHA 955e132View commit details -
Configuration menu - View commit details
-
Copy full SHA for 91efe57 - Browse repository at this point
Copy the full SHA 91efe57View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 4190edb - Browse repository at this point
Copy the full SHA 4190edbView commit details -
Configuration menu - View commit details
-
Copy full SHA for e71bf92 - Browse repository at this point
Copy the full SHA e71bf92View commit details -
Configuration menu - View commit details
-
Copy full SHA for 41f016c - Browse repository at this point
Copy the full SHA 41f016cView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for d49487f - Browse repository at this point
Copy the full SHA d49487fView commit details
Commits on May 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 9ac5eca - Browse repository at this point
Copy the full SHA 9ac5ecaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 09def0b - Browse repository at this point
Copy the full SHA 09def0bView commit details -
Merge branch 'hengguo/h2o' of https://github.com/intel/intel-extensio…
…n-for-transformers into hengguo/h2o
Configuration menu - View commit details
-
Copy full SHA for 5cae1fd - Browse repository at this point
Copy the full SHA 5cae1fdView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 3042dd4 - Browse repository at this point
Copy the full SHA 3042dd4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3a992ab - Browse repository at this point
Copy the full SHA 3a992abView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8c89cbc - Browse repository at this point
Copy the full SHA 8c89cbcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 072ad76 - Browse repository at this point
Copy the full SHA 072ad76View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 4c26487 - Browse repository at this point
Copy the full SHA 4c26487View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 741c7cd - Browse repository at this point
Copy the full SHA 741c7cdView commit details
Commits on May 27, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0800df2 - Browse repository at this point
Copy the full SHA 0800df2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 558dfd9 - Browse repository at this point
Copy the full SHA 558dfd9View commit details -
Configuration menu - View commit details
-
Copy full SHA for d6de2b3 - Browse repository at this point
Copy the full SHA d6de2b3View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 693983f - Browse repository at this point
Copy the full SHA 693983fView commit details
Commits on Jun 6, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 30bed25 - Browse repository at this point
Copy the full SHA 30bed25View commit details
Commits on Jun 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f8a64fc - Browse repository at this point
Copy the full SHA f8a64fcView commit details
Commits on Jun 11, 2024
-
Merge branch 'hengguo/h2o' of https://github.com/intel/intel-extensio…
…n-for-transformers into hengguo/h2o
Configuration menu - View commit details
-
Copy full SHA for d892e74 - Browse repository at this point
Copy the full SHA d892e74View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 7a12ec6 - Browse repository at this point
Copy the full SHA 7a12ec6View commit details
Commits on Jun 18, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 124bb72 - Browse repository at this point
Copy the full SHA 124bb72View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5181afc - Browse repository at this point
Copy the full SHA 5181afcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 93ad39b - Browse repository at this point
Copy the full SHA 93ad39bView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 58bfcd0 - Browse repository at this point
Copy the full SHA 58bfcd0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 76656c9 - Browse repository at this point
Copy the full SHA 76656c9View commit details
Commits on Jun 20, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 91c5f3c - Browse repository at this point
Copy the full SHA 91c5f3cView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 4884b3a - Browse repository at this point
Copy the full SHA 4884b3aView commit details
Commits on Jun 24, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 812a838 - Browse repository at this point
Copy the full SHA 812a838View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2cc6a8f - Browse repository at this point
Copy the full SHA 2cc6a8fView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 2d82bb5 - Browse repository at this point
Copy the full SHA 2d82bb5View commit details
Commits on Jun 25, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a9488b4 - Browse repository at this point
Copy the full SHA a9488b4View commit details -
Merge branch 'hengguo/h2o' of https://github.com/intel/intel-extensio…
…n-for-transformers into hengguo/h2o
Configuration menu - View commit details
-
Copy full SHA for 3c185ad - Browse repository at this point
Copy the full SHA 3c185adView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for a6d3fc7 - Browse repository at this point
Copy the full SHA a6d3fc7View commit details
Commits on Jun 26, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 9698230 - Browse repository at this point
Copy the full SHA 9698230View commit details
Commits on Jun 27, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 14f5a6d - Browse repository at this point
Copy the full SHA 14f5a6dView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for dd6ee3c - Browse repository at this point
Copy the full SHA dd6ee3cView commit details
Commits on Jun 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 523ca76 - Browse repository at this point
Copy the full SHA 523ca76View commit details
Commits on Jul 2, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 2618e6f - Browse repository at this point
Copy the full SHA 2618e6fView commit details
Commits on Jul 3, 2024
-
Configuration menu - View commit details
-
Copy full SHA for cedcd43 - Browse repository at this point
Copy the full SHA cedcd43View commit details
Commits on Jul 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for eb8441c - Browse repository at this point
Copy the full SHA eb8441cView commit details
Commits on Jul 15, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0894b6d - Browse repository at this point
Copy the full SHA 0894b6dView commit details -
Signed-off-by: n1ck-guo <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for d241c25 - Browse repository at this point
Copy the full SHA d241c25View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 0c547c5 - Browse repository at this point
Copy the full SHA 0c547c5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3723158 - Browse repository at this point
Copy the full SHA 3723158View commit details -
Merge branch 'hengguo/h2o' of https://github.com/intel/intel-extensio…
…n-for-transformers into hengguo/h2o
Configuration menu - View commit details
-
Copy full SHA for 7da0cf5 - Browse repository at this point
Copy the full SHA 7da0cf5View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for d600112 - Browse repository at this point
Copy the full SHA d600112View commit details
Commits on Jul 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b1ab771 - Browse repository at this point
Copy the full SHA b1ab771View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4bee0f0 - Browse repository at this point
Copy the full SHA 4bee0f0View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 3fad641 - Browse repository at this point
Copy the full SHA 3fad641View commit details -
Configuration menu - View commit details
-
Copy full SHA for 46fa4d7 - Browse repository at this point
Copy the full SHA 46fa4d7View commit details
Commits on Jul 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for fda316d - Browse repository at this point
Copy the full SHA fda316dView commit details
Commits on Jul 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 268fb80 - Browse repository at this point
Copy the full SHA 268fb80View commit details -
Configuration menu - View commit details
-
Copy full SHA for b7a1bd1 - Browse repository at this point
Copy the full SHA b7a1bd1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2ae387a - Browse repository at this point
Copy the full SHA 2ae387aView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 2706d5d - Browse repository at this point
Copy the full SHA 2706d5dView commit details
Commits on Jul 29, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b2d5768 - Browse repository at this point
Copy the full SHA b2d5768View commit details