Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support downloading specific splits in load_dataset #6832

Open
wants to merge 18 commits into
base: main
Choose a base branch
from
Open

Support downloading specific splits in load_dataset #6832

wants to merge 18 commits into from

Commits on Feb 2, 2024

  1. download_and_prepare if missing splits

    @lhoestq
    lhoestq committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    b7d854b View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. fix tests

    @lhoestq
    lhoestq committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    dfeb762 View commit details
    Browse the repository at this point in the history

  2. style

    @lhoestq
    lhoestq committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    32fd734 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. Merge branch 'main' of github.com:huggingface/datasets into download_… 

    …and_prepare-if-missing-splits
    @mariosasko
    mariosasko committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    4d083f6 View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2024

  1. Support downloading specific splits

    @mariosasko
    mariosasko committed Apr 21, 2024
    Configuration menu
    Copy the full SHA
    80c434b View commit details
    Browse the repository at this point in the history

  2. Update packaged modules

    @mariosasko
    mariosasko committed Apr 21, 2024
    Configuration menu
    Copy the full SHA
    fd73e6a View commit details
    Browse the repository at this point in the history

  3. Add tests

    @mariosasko
    mariosasko committed Apr 21, 2024
    Configuration menu
    Copy the full SHA
    72ba149 View commit details
    Browse the repository at this point in the history

  4. Remove pdb commnet

    @mariosasko
    mariosasko committed Apr 21, 2024
    Configuration menu
    Copy the full SHA
    aabede8 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Nit

    @mariosasko
    mariosasko committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    bee2fd2 View commit details
    Browse the repository at this point in the history

  2. Fixes

    @mariosasko
    mariosasko committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    03abb24 View commit details
    Browse the repository at this point in the history

  3. More tests

    @mariosasko
    mariosasko committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    ca68130 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of github.com:huggingface/datasets into download-… 

    …partial-dataset
    @mariosasko
    mariosasko committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    5a45909 View commit details
    Browse the repository at this point in the history

  5. Fix packaged_modules tests

    @mariosasko
    mariosasko committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    531bd7e View commit details
    Browse the repository at this point in the history

  6. Reproduce error

    @mariosasko
    mariosasko committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    73bcc50 View commit details
    Browse the repository at this point in the history

  7. More fixes

    @mariosasko
    mariosasko committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    01b0a7c View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. API to know splits in advance

    @mariosasko
    mariosasko committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    a42a9dd View commit details
    Browse the repository at this point in the history

  2. Improve tests

    @mariosasko
    mariosasko committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    15973ba View commit details
    Browse the repository at this point in the history

  3. Final test fix (hopefully)

    @mariosasko
    mariosasko committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    2ec71a2 View commit details
    Browse the repository at this point in the history