【开源实习】biogpt模型微调 #2036

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

Lyn0222 wants to merge 5 commits into mindspore-lab:0.4 from Lyn0222:0.4

+287 −0

Lyn0222 commented May 7, 2025 •

edited

Loading

BIOGPT微调

任务

任务编号 IAUPBO
任务链接 https://gitee.com/mindspore/community/issues/IAUPBO
模型 biogpt预训练模型
数据集 PubMedQA问答数据集

结果对比

mindnlp+ascend

Epoch	train_loss	eval_loss
1	5.7824	5.3499
2	5.7634	5.3031
3	5.7294	5.2572
4	5.6852	5.2124
5	5.6479	5.1694

pytorch+cuda

Epoch	train_loss	eval_loss
1	18.3063	18.3917
2	18.2658	18.3477
3	18.1949	18.3043
4	18.1446	18.2619
5	18.1251	18.2187

Lyn0222 added 3 commits

May 7, 2025 19:54


          Create finetune_torch.py

d9b1b6c


          Create finetune_mindspore.py

702c51a


          Create biogpt_finetune.md

14955aa

Lyn0222 changed the title ~~0.4~~ 【开源实习】biogpt模型微调

Lyn0222 added 2 commits

May 10, 2025 15:16


          Update finetune_torch.py

16dd42a


          Update biogpt_finetune.md

f6c73c4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet