Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mtf #47

Open
wants to merge 24 commits into
base: multi-query-attention
Choose a base branch
from
Open

Mtf #47

wants to merge 24 commits into from

Commits on Mar 6, 2023

  1. add santacoder example script

    @RaymondLi0
    RaymondLi0 committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    ccf78e0 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. Add MTF (alike bloomz/mt0)

    @Muennighoff
    Muennighoff committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    d661d04 View commit details
    Browse the repository at this point in the history

  2. Merge

    @Muennighoff
    Muennighoff committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    2aa3e5a View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2023

  1. Fix logging

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    181593c View commit details
    Browse the repository at this point in the history

  2. Add

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    005dbb0 View commit details
    Browse the repository at this point in the history

  3. Fix warn

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    b64ade1 View commit details
    Browse the repository at this point in the history

  4. Add PAD

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    9c66466 View commit details
    Browse the repository at this point in the history

  5. eos > eod

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    65c81ae View commit details
    Browse the repository at this point in the history

  6. Add size

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    fb234a3 View commit details
    Browse the repository at this point in the history

  7. Fix args

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    9dde9db View commit details
    Browse the repository at this point in the history

  8. Make causal

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    cbd0beb View commit details
    Browse the repository at this point in the history

  9. Mov pos to dev

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    2d8e414 View commit details
    Browse the repository at this point in the history

  10. Packed MTF mask

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    bd22057 View commit details
    Browse the repository at this point in the history

  11. Merge pull request #48 from bigcode-project/packedmtfmask 

    Packed MTF mask
    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    c790969 View commit details
    Browse the repository at this point in the history

  12. Add reset progress

    @Muennighoff
    Muennighoff committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    168e314 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2023

  1. Copy tensors after loading ckpt

    @Muennighoff
    Muennighoff committed Apr 16, 2023
    Configuration menu
    Copy the full SHA
    3991520 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2023

  1. Fix spec toks; Opt ckpt loading; newline

    @Muennighoff
    Muennighoff committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    ad603d6 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2023

  1. Fix tok

    @Muennighoff
    Muennighoff committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    14bc3e5 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2023

  1. Fix var

    @Muennighoff
    Muennighoff committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    5dc080f View commit details
    Browse the repository at this point in the history

  2. Clean init of optimizer when not laoaded

    @Muennighoff
    Muennighoff committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    b4609a7 View commit details
    Browse the repository at this point in the history

  3. Rmv debug

    @Muennighoff
    Muennighoff committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    a828682 View commit details
    Browse the repository at this point in the history

  4. Debug

    @Muennighoff
    Muennighoff committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    57184fc View commit details
    Browse the repository at this point in the history

  5. Clean comments

    @Muennighoff
    Muennighoff committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    6c80f79 View commit details
    Browse the repository at this point in the history

  6. Attn

    @Muennighoff
    Muennighoff committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    9192641 View commit details
    Browse the repository at this point in the history