Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PhiMoE #33363

Merged
merged 31 commits into from
Oct 4, 2024
Merged

PhiMoE #33363

merged 31 commits into from
Oct 4, 2024

Commits on Sep 4, 2024

  1. onboard phimoe model

    @garg-amit
    garg-amit committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    6ad863a View commit details
    Browse the repository at this point in the history

  2. removed debug code

    @garg-amit
    garg-amit committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    1a1e547 View commit details
    Browse the repository at this point in the history

  3. added unit tests

    @garg-amit
    garg-amit committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    08d73d7 View commit details
    Browse the repository at this point in the history

  4. updated docs

    @garg-amit
    garg-amit committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    1277bc8 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. formatted

    @garg-amit
    garg-amit committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    232588d View commit details
    Browse the repository at this point in the history

  2. fixed unit tests

    @garg-amit
    garg-amit committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    8462783 View commit details
    Browse the repository at this point in the history

  3. fixed test case

    @garg-amit
    garg-amit committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    3668c5d View commit details
    Browse the repository at this point in the history

  4. fixed format

    @garg-amit
    garg-amit committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    e6ed8dc View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. refactored code

    @garg-amit
    garg-amit committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    89f51ea View commit details
    Browse the repository at this point in the history

  2. fixed expected outputs in the integration tests

    @garg-amit
    garg-amit committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    e552e33 View commit details
    Browse the repository at this point in the history

  3. Added a warning msg

    @garg-amit
    garg-amit committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    c8173d7 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into gargamit/onboard_phi3_5_moe

    @garg-amit
    garg-amit authored Sep 6, 2024
    Configuration menu
    Copy the full SHA
    290514e View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Merge branch 'main' into gargamit/onboard_phi3_5_moe

    @garg-amit
    garg-amit authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    5dda7d6 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Merge branch 'gargamit/onboard_phi3_5_moe' of https://github.com/garg… 

    …-amit/transformers into gargamit/onboard_phi3_5_moe
    @garg-amit
    garg-amit committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    11a0f17 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/garg-amit/transformers into… 

    … gargamit/onboard_phi3_5_moe
    @garg-amit
    garg-amit committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    dd02bf9 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Addressed comments

    @garg-amit
    garg-amit committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    43f9cc9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/garg-amit/transformers into… 

    … gargamit/onboard_phi3_5_moe
    @garg-amit
    garg-amit committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    b3f8af5 View commit details
    Browse the repository at this point in the history

  3. Addressed comments

    @garg-amit
    garg-amit committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    b6acc3e View commit details
    Browse the repository at this point in the history

  4. fixed test cases

    @garg-amit
    garg-amit committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    33caa63 View commit details
    Browse the repository at this point in the history

  5. added paper link

    @garg-amit
    garg-amit committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    e01a78e View commit details
    Browse the repository at this point in the history

  6. Addressed comments

    @garg-amit
    garg-amit committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    d1f847e View commit details
    Browse the repository at this point in the history

  7. Refactored PhimoeForCausalLM forward fn

    @garg-amit
    garg-amit committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    dd8b8b0 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Refactored PhimoeRotaryEmbedding class

    @garg-amit
    garg-amit committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    42b59c6 View commit details
    Browse the repository at this point in the history

  2. fixed test cases

    @garg-amit
    garg-amit committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    e4e2f1a View commit details
    Browse the repository at this point in the history

  3. fixed testcase

    @garg-amit
    garg-amit committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    8359a59 View commit details
    Browse the repository at this point in the history

  4. fixed test case

    @garg-amit
    garg-amit committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    bebad97 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Merge branch 'main' of https://github.com/garg-amit/transformers into… 

    … gargamit/onboard_phi3_5_moe
    @garg-amit
    garg-amit committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    4c28bd5 View commit details
    Browse the repository at this point in the history

  2. Addressed comments

    @garg-amit
    garg-amit committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    1311e80 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. fixed test cases

    @garg-amit
    garg-amit committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    2671887 View commit details
    Browse the repository at this point in the history

  2. fixed testcases

    @garg-amit
    garg-amit committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    18830f5 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. Used cache position instead to get the seq len

    @garg-amit
    garg-amit committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    36891bf View commit details
    Browse the repository at this point in the history