Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ADD] PyTorch embedding layer to reduce memory footprint #451

Open
wants to merge 22 commits into
base: reg_cocktails
Choose a base branch
from
Open

[ADD] PyTorch embedding layer to reduce memory footprint #451

wants to merge 22 commits into from

Commits on Oct 25, 2022

  1. update eta for experiments

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    0bd7d5f View commit details
    Browse the repository at this point in the history

  2. add check if True is in value range

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    76dae54 View commit details
    Browse the repository at this point in the history

  3. Reg cocktails common paper modifications 2 (#417) 

    * remove remaining differences

* Reg cocktails common paper modifications 5 (#418)

* add hasttr

* fix run summary
    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    d26c611 View commit details
    Browse the repository at this point in the history

  4. have working embedding from pytroch

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    bc60e31 View commit details
    Browse the repository at this point in the history

  5. divide columns to encode and embed based on threshold

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    13fad76 View commit details
    Browse the repository at this point in the history

  6. cleanup unwanted changes

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    cf4fd98 View commit details
    Browse the repository at this point in the history

  7. use shape after preprocessing in base network backbone

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    af41dd7 View commit details
    Browse the repository at this point in the history

  8. remove redundant call to load datamanager

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    9706875 View commit details
    Browse the repository at this point in the history

  9. add init file for column splitting

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    def144c View commit details
    Browse the repository at this point in the history

  10. fix tests

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    926a757 View commit details
    Browse the repository at this point in the history

  11. fix precommit and add test changes

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    7567d26 View commit details
    Browse the repository at this point in the history

  12. [ADD] Calculate memory of dataset after one hot encoding (pytorch emb… 

    …edding) (#437)

* add updates for apt1.0+reg_cocktails

* debug loggers for checking data and network memory usage

* add support for pandas, test for data passing, remove debug loggers

* remove unwanted changes

* :

* Adjust formula to account for embedding columns

* Apply suggestions from code review

Co-authored-by: nabenabe0928 <[email protected]>

* remove unwanted additions

* Update autoPyTorch/pipeline/components/preprocessing/tabular_preprocessing/TabularColumnTransformer.py

Co-authored-by: nabenabe0928 <[email protected]>
    @ravinkohli @nabenabe0928
    ravinkohli and nabenabe0928 committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    09fdc0d View commit details
    Browse the repository at this point in the history

  13. suggestions from review

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    3aef02e View commit details
    Browse the repository at this point in the history

  14. add preprocessed_dtype to determine double or float

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    8e3dbef View commit details
    Browse the repository at this point in the history

  15. test fix in progress

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    52427bc View commit details
    Browse the repository at this point in the history

  16. TODO: fix errors after rebase

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    90512ee View commit details
    Browse the repository at this point in the history

  17. Reg cocktails apt1.0+reg cocktails pytorch embedding reduced (#454) 

    * reduce number of hyperparameters for pytorch embedding

* remove todos for the preprocessing PR, and apply suggestion from code review

* remove unwanted exclude in test
    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    895b904 View commit details
    Browse the repository at this point in the history

  18. fix embeddings after rebase

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    033bca7 View commit details
    Browse the repository at this point in the history

  19. fix error with pytorch embeddings

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    d4cd8b4 View commit details
    Browse the repository at this point in the history

  20. fix redundant code

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    a5807cb View commit details
    Browse the repository at this point in the history

  21. change userdefined to False

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    960e1ef View commit details
    Browse the repository at this point in the history

  22. remove using categorical columns

    @ravinkohli
    ravinkohli committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    1be80d5 View commit details
    Browse the repository at this point in the history