Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

您好,InstructUIE是11B全参数微调吗?有没有用微调工具,类似lora什么的?另外复现这个项目要的硬件环境是啥呢?我目前有4块3090,不知道能不能行 #35

Open
orangezfj opened this issue Jan 4, 2024 · 0 comments

Comments

@orangezfj
Copy link

您好,InstructUIE是11B全参数微调吗?有没有用微调工具,类似lora什么的?另外复现这个项目要的硬件环境是啥呢?我目前有4块3090,不知道能不能行

文章中提到的zero-shot实验情景,指令仅在训练期间为任务子集提供,并在看不见的任务上评估模型,而无需额外的微调。这里的训练是什么意思呢?我理解zero-shot可能没有训练这个环节(可能是我了解太少)

最后我想问,我们是用多种数据集,一起训练出三种类型的模型(NER,RE和EE),那么每一种模型是可以预测任何的数据集,评估也是这样的。还是说每一个数据单独训练一个模型评估呢?

期待您的回复,谢谢~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant