Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

💡 [REQUEST] - minicpm是否可以用来做目标检测任务呢？ #323

Closed
xyw1 opened this issue Jul 5, 2024 · 5 comments
Closed

💡 [REQUEST] - minicpm是否可以用来做目标检测任务呢？ #323

xyw1 opened this issue Jul 5, 2024 · 5 comments
Labels
question Further information is requested

Comments

@xyw1
Copy link

xyw1 commented Jul 5, 2024

起始日期 | Start Date

No response

实现PR | Implementation PR

No response

相关Issues | Reference Issues

No response

摘要 | Summary

minicpm是否可以用来做目标检测任务呢？
图像数据标注为目标的坐标和标签

基本示例 | Basic Example

图像数据标注为目标的坐标和标签

缺陷 | Drawbacks

未知

未解决问题 | Unresolved questions

No response
@xyw1 xyw1 added the question Further information is requested label Jul 5, 2024
@LDLINGLINGLING
Copy link
Collaborator

目前minicpmv的预训练中这一类任务较少，可能需要补充大量数据

@daihuidai
Copy link

经过测试MiniCPM2.0 lora微调或仅微调对齐模块后的定位能力很差，能简单识别，但是定位偏差很大。没有做过全量微调测试

@LDLINGLINGLING
Copy link
Collaborator

经过用于以及我方多模态同学测试，训练后，2.5版本定位能力不错

@qyc-98
Copy link
Collaborator

qyc-98 commented Jul 15, 2024

您好我们更新了lora微调和加载参数的方式，模型代码也有更新，您可以重新尝试一下

@qyc-98 qyc-98 closed this as completed Jul 16, 2024
@gjd2017
Copy link

gjd2017 commented Sep 29, 2024

经过用于以及我方多模态同学测试，训练后，2.5版本定位能力不错

有测评文档么？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@xyw1 @gjd2017 @qyc-98 @daihuidai @LDLINGLINGLING