New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fashion_bert: masked_lm_ids #9

Open

jantje676 opened this issue Oct 7, 2020 · 1 comment

jantje676 commented Oct 7, 2020

Hello,

I would like to train fashion_bert on a different dataset.
To construct the data, I need to input "masked_lm_ids".
I was wondering what this is?

Thank you for your help.

search-opensource-space commented Oct 14, 2020

masked_lm_ids: the masked word_piece id in the task of masked language modeling during pretraining

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment