Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

h2o for kv cache compression #1468

Merged
merged 90 commits into from
Jul 29, 2024
Merged

h2o for kv cache compression #1468

merged 90 commits into from
Jul 29, 2024

Commits on Apr 10, 2024

  1. h2o for kv cache compression

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    41d8647 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    eb7f564 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. rebuild

    Signed-off-by: biao.fang <[email protected]>
    BiaoFangAIA committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    c46ea7d View commit details
    Browse the repository at this point in the history
  2. merge

    Signed-off-by: biao.fang <[email protected]>
    BiaoFangAIA committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    95ff9ae View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9d27733 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. update

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    444490d View commit details
    Browse the repository at this point in the history
  2. update

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    4309089 View commit details
    Browse the repository at this point in the history
  3. merge

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    8c5272e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1b83e52 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. update

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 7, 2024
    Configuration menu
    Copy the full SHA
    3fd73cb View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a2d3ae0 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Configuration menu
    Copy the full SHA
    ddf5445 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Configuration menu
    Copy the full SHA
    91d4394 View commit details
    Browse the repository at this point in the history
  2. real drop

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 14, 2024
    Configuration menu
    Copy the full SHA
    a83e6d6 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. modify real drop code

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 15, 2024
    Configuration menu
    Copy the full SHA
    92c8a62 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    70a1cf3 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. fix

    Signed-off-by: biao.fang <[email protected]>
    BiaoFangAIA committed May 16, 2024
    Configuration menu
    Copy the full SHA
    bc9eade View commit details
    Browse the repository at this point in the history
  2. update for real drop and sim mode, using the same api

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 16, 2024
    Configuration menu
    Copy the full SHA
    9aa25f6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    03cdc8d View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e51b5b9 View commit details
    Browse the repository at this point in the history
  5. support for sdpa and flash attention

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 16, 2024
    Configuration menu
    Copy the full SHA
    b8e9df2 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    02f31b2 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    274b7ed View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. change to new api

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 17, 2024
    Configuration menu
    Copy the full SHA
    877329d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b435e3e View commit details
    Browse the repository at this point in the history
  3. clean code

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 17, 2024
    Configuration menu
    Copy the full SHA
    5068552 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5e5f589 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. fix

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 20, 2024
    Configuration menu
    Copy the full SHA
    d0dce7d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    febb76a View commit details
    Browse the repository at this point in the history
  3. add example

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 20, 2024
    Configuration menu
    Copy the full SHA
    24c4725 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5bd3f16 View commit details
    Browse the repository at this point in the history
  5. clean

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 20, 2024
    Configuration menu
    Copy the full SHA
    955e132 View commit details
    Browse the repository at this point in the history
  6. pylint

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 20, 2024
    Configuration menu
    Copy the full SHA
    91efe57 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    4190edb View commit details
    Browse the repository at this point in the history
  8. pylint

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 20, 2024
    Configuration menu
    Copy the full SHA
    e71bf92 View commit details
    Browse the repository at this point in the history
  9. pylint

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 20, 2024
    Configuration menu
    Copy the full SHA
    41f016c View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    d49487f View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. fix import error

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 21, 2024
    Configuration menu
    Copy the full SHA
    9ac5eca View commit details
    Browse the repository at this point in the history
  2. update

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 21, 2024
    Configuration menu
    Copy the full SHA
    09def0b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5cae1fd View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    3042dd4 View commit details
    Browse the repository at this point in the history
  5. pylint

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 21, 2024
    Configuration menu
    Copy the full SHA
    3a992ab View commit details
    Browse the repository at this point in the history
  6. pylint

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 21, 2024
    Configuration menu
    Copy the full SHA
    8c89cbc View commit details
    Browse the repository at this point in the history
  7. merge

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 21, 2024
    Configuration menu
    Copy the full SHA
    072ad76 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    4c26487 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    741c7cd View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. add example readme

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 27, 2024
    Configuration menu
    Copy the full SHA
    0800df2 View commit details
    Browse the repository at this point in the history
  2. update

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 27, 2024
    Configuration menu
    Copy the full SHA
    558dfd9 View commit details
    Browse the repository at this point in the history
  3. merge

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed May 27, 2024
    Configuration menu
    Copy the full SHA
    d6de2b3 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    693983f View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. fix acc bug

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    30bed25 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. fix

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    f8a64fc View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Configuration menu
    Copy the full SHA
    d892e74 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7a12ec6 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. refactor code

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    124bb72 View commit details
    Browse the repository at this point in the history
  2. fix

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    5181afc View commit details
    Browse the repository at this point in the history
  3. merge

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    93ad39b View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    58bfcd0 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    76656c9 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. new api

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    91c5f3c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4884b3a View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. support for gaudi

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    812a838 View commit details
    Browse the repository at this point in the history
  2. merge

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    2cc6a8f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2d82bb5 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. update

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    a9488b4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3c185ad View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a6d3fc7 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. pylint

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    9698230 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. pylint

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    14f5a6d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    dd6ee3c View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Configuration menu
    Copy the full SHA
    523ca76 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Configuration menu
    Copy the full SHA
    2618e6f View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. Configuration menu
    Copy the full SHA
    cedcd43 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. Configuration menu
    Copy the full SHA
    eb8441c View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. Configuration menu
    Copy the full SHA
    0894b6d View commit details
    Browse the repository at this point in the history
  2. add desc to h2o in readme

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    d241c25 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0c547c5 View commit details
    Browse the repository at this point in the history
  4. add doc for h2o

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    3723158 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    7da0cf5 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    d600112 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. update

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    b1ab771 View commit details
    Browse the repository at this point in the history
  2. add ut

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    4bee0f0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3fad641 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    46fa4d7 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. fix

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    fda316d View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Configuration menu
    Copy the full SHA
    268fb80 View commit details
    Browse the repository at this point in the history
  2. update

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    b7a1bd1 View commit details
    Browse the repository at this point in the history
  3. merge

    Signed-off-by: n1ck-guo <[email protected]>
    n1ck-guo committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    2ae387a View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    2706d5d View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2024

  1. Configuration menu
    Copy the full SHA
    b2d5768 View commit details
    Browse the repository at this point in the history