Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fixing MuP #1061

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

Fixing MuP #1061

wants to merge 10 commits into from

Commits on Oct 19, 2023

  1. added mup version with fixes to neox root

    @marcobellagente93
    marcobellagente93 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    f85352c View commit details
    Browse the repository at this point in the history

  2. removed buggy attention scale factor

    @marcobellagente93
    marcobellagente93 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    a24ba2d View commit details
    Browse the repository at this point in the history

  3. added comment and removed buggy embedding multiplier

    @marcobellagente93
    marcobellagente93 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    e6ae3dc View commit details
    Browse the repository at this point in the history

  4. set use_mup attribute at re-init and fix output multiplier

    @marcobellagente93
    marcobellagente93 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    faff65e View commit details
    Browse the repository at this point in the history

  5. do not reinit the output layer

    @marcobellagente93
    marcobellagente93 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    4ebfb86 View commit details
    Browse the repository at this point in the history

  6. update readme-mup

    @marcobellagente93
    marcobellagente93 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    fe70494 View commit details
    Browse the repository at this point in the history

  7. Delete mup/CODE_OF_CONDUCT.md

    @StellaAthena
    StellaAthena authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    b5308f3 View commit details
    Browse the repository at this point in the history

  8. Delete mup/mup directory

    @StellaAthena
    StellaAthena authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    57ddc14 View commit details
    Browse the repository at this point in the history

  9. Delete mup directory

    @StellaAthena
    StellaAthena authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    a34a6c6 View commit details
    Browse the repository at this point in the history

  10. Update requirements.txt

    @StellaAthena
    StellaAthena authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    05ff7df View commit details
    Browse the repository at this point in the history