Skip to content

About 2D mIOU for joint training #24

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
chaolongy opened this issue Jul 24, 2022 · 2 comments
Open

About 2D mIOU for joint training #24

chaolongy opened this issue Jul 24, 2022 · 2 comments

Comments

@chaolongy
Copy link

I reproduced your source code with no other substantial changes, and with the parameter settings of UNet34 for the 2D network and Mink18A for the 3D network and voxel size=5cm, the 3D mIOU basically achieves the performance of 70.6 reported in your paper. However, the 2D mIOU is only 47.3, while your paper's result is 65.1, is this something I'm missing?
屏幕截图 2022-07-24 204435

@Holycomfort
Copy link

I met with similar problem. I loaded the pretrained model provided by this project and tested the performance of BPNet with config/scannet/bpnet_5cm.yaml. The mIoU 2D is only about 57, while 3D is about 68.

@yhyang-myron
Copy link

@chaolongy @Holycomfort Hi, do you use the 2d label from _2d-label-filt.zip file? Why did I only get 26 miou for 2D with the pretrained model? But I got 70.6 miou for 3D just like the performance in the paper.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants