Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deepseek v2 support #31976

Draft
wants to merge 17 commits into
base: main
Choose a base branch
from
Draft

Deepseek v2 support #31976

wants to merge 17 commits into from

Commits on Jul 15, 2024

  1. adding initial version of deepseek v2 files, copied from existing rep… 

    …o and llama
    @itazap
    itazap committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    43e8548 View commit details
    Browse the repository at this point in the history

  2. initial ruff

    @itazap
    itazap committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    e339caa View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. testing files

    @itazap
    itazap committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    e844440 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. adding tokenizer config files

    @itazap
    itazap committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    48e84ed View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. updating based on paper and making more meaningful naming

    @itazap
    itazap committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    90554fb View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. cleaning

    @itazap
    itazap committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    0ee5bb7 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. update diff file

    @itazap
    itazap committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    9d7cdbd View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. update

    @itazap
    itazap committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    6f66d60 View commit details
    Browse the repository at this point in the history

  2. removed some ep size refs

    @itazap
    itazap committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    9c3a0ea View commit details
    Browse the repository at this point in the history

  3. update diff file

    @itazap
    itazap committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    d8d9ac0 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. update to use MoeCausalLM

    @itazap
    itazap committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    afea6ca View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. run script

    @itazap
    itazap committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8370023 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. updated MOE to be like mixtral

    [email protected] committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    9c524ea View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. removing seperate inference logic and using mixtral for ref

    [email protected] committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    c3436e4 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. moe update

    [email protected] committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    1feb843 View commit details
    Browse the repository at this point in the history

  2. update diff file

    [email protected] committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    a14b489 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. add modular file

    [email protected] committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    cd8b36c View commit details
    Browse the repository at this point in the history