Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LM语言模型与预训练模型的关系 #14

Open
im73 opened this issue Apr 17, 2021 · 0 comments
Open

LM语言模型与预训练模型的关系 #14

im73 opened this issue Apr 17, 2021 · 0 comments

Comments

@im73
Copy link

im73 commented Apr 17, 2021

train.py中训练得到的结果对应的是pretrained目录下预训练模型的结果。
LM语言是使用在beamcode.py中的decoder的部分，我并没有看到是如何得到的。
但是LM语言模型在train.py的过程中并没有使用，请问预训练模型与LM语言模型之间是否是一一对应的关系，比如我换了相应的预训练模型我的LM语言模型是否也要发生改变？
或者我的预训练模型不变是否可以直接换成你的70G的LM模型？
希望能得到你的解答
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@im73