Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

german distilbert not available? #7499

Closed
datistiquo opened this issue Oct 1, 2020 · 7 comments
Closed

german distilbert not available? #7499

datistiquo opened this issue Oct 1, 2020 · 7 comments

Comments

@datistiquo
Copy link

I try using the distilbert-base-german-cased

which is also listed here

https://huggingface.co/transformers/pretrained_models.html

but I get the message that this model is not avaiable. Seems also not here listed?

https://huggingface.co/models?filter=tf,de

Is this just currently the case?

@datistiquo
Copy link
Author

Or is this model only available for pytorch and not TF?

@julien-c
Copy link
Member

julien-c commented Oct 1, 2020

https://huggingface.co/distilbert-base-german-cased

^^ currently only the Pytorch weights, but you can load into TF pretty easily (follow the README/doc). If needed we can upload the converted TF weights (cc @stefan-it who I believe trained this model? This predates our user/organization namespaces)

@julien-c
Copy link
Member

julien-c commented Oct 1, 2020

And I've added a de language tag so that the model is discoverable via https://huggingface.co/models?filter=de&search=distilbert

Thanks for reporting!

@julien-c julien-c closed this as completed Oct 1, 2020
@stefan-it
Copy link
Collaborator

Oh, we've an open issue regarding to the TF checkpoint 😅

dbmdz/berts#8

@julien-c could you convert the model and upload it (not sure if I've access to root S3), thanks ❤️

@datistiquo
Copy link
Author

but you can load into TF pretty easily (follow the README/doc).

COuld you show me where I can read about htis? Cab just find from the getting stared tour:

bert_model = TFDistilBertModel.from_pretrained('distilbert-base-german-cased', from_tf=False)
...but this does not work...

@julien-c
Copy link
Member

julien-c commented Oct 2, 2020

from_pt=True?

@datistiquo
Copy link
Author

Ok, great. So easy.^^

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants