Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Num embeddings #200

Merged
merged 29 commits into from
Feb 17, 2024
Merged

Num embeddings #200

merged 29 commits into from
Feb 17, 2024

Conversation

jrzaurin
Copy link
Owner

Added two new methods to embed continuous columns, described in the paper: On Embeddings for Numerical Features in Tabular Deep Learning.

Namely:

  1. Piecewise
  2. Periodic

This involved a series of adaptations to all existing models

…feats. Now the two changes that need to happen are: 1. add the activation funcion in the Encoding Layer itself and 2. Define the embedding process in the base models rather than the DiffSizeCatAndContEmbeddings and the SameSizeCatAndContEmbeddings wrappers
…edding layers. Needs to be added within the cat embed layers and then move to 2. Define the embedding process in the base models rather than the DiffSizeCatAndContEmbeddings and the SameSizeCatAndContEmbeddings wrappers
…dding layers. Now onto 2. Define the embedding process in the base models rather than the DiffSizeCatAndContEmbeddings and the SameSizeCatAndContEmbeddings wrappers
…ed to test the two classes manually and then change the main models accordingly
… Now I need to 1. Adjust docs. 2. Adjust/Fix tests. 3. Redo the examples. 4. Add new examples
… Just have an overall look at the code. 3. Re-do examples. 4. Have a look to the mkdocs
…otebook with num embeddings. 2. Review the docs 3. Test in all possible platforms. Nearly there...
…res. I want to increase the coverage for the deeptabular_utils module and we are done
@jrzaurin jrzaurin merged commit 452b143 into master Feb 17, 2024
5 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant