Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: Count full dataset in DatasetShard.__len__ #3414

Open
wants to merge 12 commits into
base: master
Choose a base branch
from
Open

fix: Count full dataset in DatasetShard.__len__ #3414

wants to merge 12 commits into from

Commits on May 21, 2023

  1. add dataset length test

    @jeffkinnison
    jeffkinnison committed May 21, 2023
    Configuration menu
    Copy the full SHA
    ca59cbe View commit details
    Browse the repository at this point in the history

  2. fix dataset size computation for DatasetIterator

    @jeffkinnison
    jeffkinnison committed May 21, 2023
    Configuration menu
    Copy the full SHA
    f1180ad View commit details
    Browse the repository at this point in the history

  3. docstring

    @jeffkinnison
    jeffkinnison committed May 21, 2023
    Configuration menu
    Copy the full SHA
    8a16a59 View commit details
    Browse the repository at this point in the history

  4. reduce dataset size and runtime

    @jeffkinnison
    jeffkinnison committed May 21, 2023
    Configuration menu
    Copy the full SHA
    013e997 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. Merge branch 'master' into ray-nightly-count-fix

    @jeffkinnison
    jeffkinnison authored May 22, 2023
    Configuration menu
    Copy the full SHA
    e6325f8 View commit details
    Browse the repository at this point in the history

  2. add back nightly updates

    @jeffkinnison
    jeffkinnison committed May 22, 2023
    Configuration menu
    Copy the full SHA
    4e7f1e1 View commit details
    Browse the repository at this point in the history

  3. bad pip install

    @jeffkinnison
    jeffkinnison committed May 22, 2023
    Configuration menu
    Copy the full SHA
    889801c View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. count using underlying pipeline if possible

    @jeffkinnison
    jeffkinnison committed May 23, 2023
    Configuration menu
    Copy the full SHA
    01dbfbe View commit details
    Browse the repository at this point in the history

  2. gate with ray 2.3.x check

    @jeffkinnison
    jeffkinnison committed May 23, 2023
    Configuration menu
    Copy the full SHA
    94d41de View commit details
    Browse the repository at this point in the history

  3. Skip tokenizer test which seems to be broken on python 3.8 and 3.9.

    @justinxzhao
    justinxzhao committed May 23, 2023
    Configuration menu
    Copy the full SHA
    3e44310 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'ray-nightly-count-fix' of github.com:ludwig-ai/ludwig i… 

    …nto ray-nightly-count-fix
    @justinxzhao
    justinxzhao committed May 23, 2023
    Configuration menu
    Copy the full SHA
    5317817 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2023

  1. Revert spacy test skip. Seems to be working again? https://github.com… 

    …/ludwig-ai/ludwig/actions/runs/5063105910/jobs/9089341604
    @justinxzhao
    justinxzhao committed May 24, 2023
    Configuration menu
    Copy the full SHA
    8ff5f4d View commit details
    Browse the repository at this point in the history