Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请教一下，怎么提取Bert训练的词向量，加载到其他模型上 #6

Open
HooFaya opened this issue Jun 6, 2019 · 4 comments
Open

请教一下，怎么提取Bert训练的词向量，加载到其他模型上 #6

HooFaya opened this issue Jun 6, 2019 · 4 comments

Comments

@HooFaya
Copy link

HooFaya commented Jun 6, 2019

No description provided.

@renxingkai
Copy link
Owner

No description provided.

取出最后一层的bert输出，然后后面接你要加入的其他模型即可，具体可以看其他代码

@HooFaya
Copy link
Author

HooFaya commented Jun 7, 2019

嗯，懂了，谢谢你的回复！

@Crescentz
Copy link

No description provided.

取出最后一层的bert输出，然后后面接你要加入的其他模型即可，具体可以看其他代码

这个是微调吧。。。想把bert的词表embedding裁剪或者增加到自己的词表，，，这个您知道怎么操作么

@yummy936
Copy link

No description provided.

取出最后一层的bert输出，然后后面接你要加入的其他模型即可，具体可以看其他代码

这个是微调吧。。。想把bert的词表embedding裁剪或者增加到自己的词表，，，这个您知道怎么操作么

请问你们运行出来自己的模型了吗，将bert与其他模型结合

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@renxingkai @HooFaya @Crescentz @yummy936