Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Generalize sharding spec for ShardedFlatTensor #15

Merged
merged 13 commits into from
May 7, 2024
Merged

Generalize sharding spec for ShardedFlatTensor #15

merged 13 commits into from
May 7, 2024

Commits on May 3, 2024

  1. update docstrings

    @epwalsh
    epwalsh committed May 3, 2024
    Configuration menu
    Copy the full SHA
    2569e49 View commit details
    Browse the repository at this point in the history

  2. generalize checkpointer to accept multiple offsets per rank

    @epwalsh
    epwalsh committed May 3, 2024
    Configuration menu
    Copy the full SHA
    2495cd2 View commit details
    Browse the repository at this point in the history

  3. support multiple offsets per shard with ShardedFlatTensor

    @epwalsh
    epwalsh committed May 3, 2024
    Configuration menu
    Copy the full SHA
    e20814a View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. fix

    @epwalsh
    epwalsh committed May 7, 2024
    Configuration menu
    Copy the full SHA
    9b6e515 View commit details
    Browse the repository at this point in the history

  2. fix shardedflatparameter test

    @epwalsh
    epwalsh committed May 7, 2024
    Configuration menu
    Copy the full SHA
    dc16384 View commit details
    Browse the repository at this point in the history

  3. fix checkpoint test

    @epwalsh
    epwalsh committed May 7, 2024
    Configuration menu
    Copy the full SHA
    3aa30bf View commit details
    Browse the repository at this point in the history

  4. fix init device for sharded flat tensor

    @epwalsh
    epwalsh committed May 7, 2024
    Configuration menu
    Copy the full SHA
    7f68b89 View commit details
    Browse the repository at this point in the history

  5. fix

    @epwalsh
    epwalsh committed May 7, 2024
    Configuration menu
    Copy the full SHA
    b42c20f View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into epwalsh/sharding

    @epwalsh
    epwalsh authored May 7, 2024
    Configuration menu
    Copy the full SHA
    a2f8f69 View commit details
    Browse the repository at this point in the history

  7. more logging

    @epwalsh
    epwalsh committed May 7, 2024
    Configuration menu
    Copy the full SHA
    e3978d4 View commit details
    Browse the repository at this point in the history

  8. add option to unshard with threads

    @epwalsh
    epwalsh committed May 7, 2024
    Configuration menu
    Copy the full SHA
    1d006b0 View commit details
    Browse the repository at this point in the history

  9. fix debug logging

    @epwalsh
    epwalsh committed May 7, 2024
    Configuration menu
    Copy the full SHA
    f316407 View commit details
    Browse the repository at this point in the history

  10. check for nans earlier

    @epwalsh
    epwalsh committed May 7, 2024
    Configuration menu
    Copy the full SHA
    23848e2 View commit details
    Browse the repository at this point in the history