error while test the mvxnet

[markwave]

Branch

main branch https://mmdetection3d.readthedocs.io/en/latest/

📚 The doc issue

i use the command "python tools/test.py configs/mvxnet/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class.py
checkpoints/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class-8963258a.pth
--show-dir ./data/mvxnet/show_results" to test the mvxnet, and a error happen:"AssertionError: got unexpected vis_task None."
then I add the command --task multi-view_det ,it runs but the final result shows all AP result are 0.0,
so how to test the mvx model correctly?

"

Suggest a potential alternative/fix

No response

[markwave]

and test the pointpillar model using the command:"python tools/test.py configs/pointpillars/pointpillars_hv_secfpn_8xb6-160e_kitti-3d-car.py checkpoints/hv_pointpillars_secfpn_6x8_160e_kitti-3d-car_20220331_134606-d42d15ed.pth --show --show-dir ./data/pointpillar/show_results
", the error"UnboundLocalError: local variable 'img_path' referenced before assignment" happen, how to solve it

[WuYanXingege]

-task multi-view_det ,it runs but the final result shows all AP result are 0.0,
Have you solve this problem? I also encounter this error

[Lcl159]

I have the same problem, did you solve it?

[sunjiahao1999]

@markwave pointpillars' bug need to download or generate a new infos.pkl file in https://mmdetection3d.readthedocs.io/en/latest/user_guides/dataset_prepare.html#summary-of-annotation-files.

[sunjiahao1999]

MVXNet's bug is maybe the same as pointpillars'. When I tested it, it worked fine and no bugs were reproduced.

[markwave]

@markwave pointpillars' bug need to download or generate a new infos.pkl file in https://mmdetection3d.readthedocs.io/en/latest/user_guides/dataset_prepare.html#summary-of-annotation-files.

I create these kitti datasets as the latest mmdet3d guides that describe before, so the bug you solve through download the new infos.pkl file? and the generate method which the latest docs provide will cause these bug? Is download the new pkl the only way to solve these question?

[sunjiahao1999]

@markwave Can you provide the detailed code and the location of the error of the reported error? It's work well in my computer.

[markwave]

I say the bug which is the
”i use the command "python tools/test.py configs/mvxnet/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class.py
checkpoints/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class-8963258a.pth
--show-dir ./data/mvxnet/show_results" to test the mvxnet, and a error happen:"AssertionError: got unexpected vis_task None."
then I add the command --task multi-view_det, and it runs but the final result shows all AP results are 0.0,
so how to test the mvx model correctly?”
so the mvxnet result I run， all the results were 0， does it runs well in your computer？ And if you try to generate the
kitti dataset as the docs write, then run the model well? Or solve these question only by downloading the pkl files from the websites to get the normal results and runs Pointpillar well ?

[sunjiahao1999]

--task is not multi-view_det. MVXNet is a multi-modality_det model. Can you check that MVXNet outputs a right mAP without adding the show-dir and task parameters?

[sunjiahao1999]

@markwave this is my new log when run:

python tools/test.py configs/mvxnet/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class.py checkpoints/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class-8963258a.pth

I hope this is helpful to you
20230629_105841.log

[markwave]

@markwave this is my new log when run:

python tools/test.py configs/mvxnet/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class.py checkpoints/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class-8963258a.pth

I hope this is helpful to you 20230629_105841.log

thanks for your help, I will try your advice first，and tell you the results soon

[markwave]

@markwave this is my new log when run:

python tools/test.py configs/mvxnet/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class.py checkpoints/mvxnet_fpn_dv_second_secfpn_8xb2-80e_kitti-3d-3class-8963258a.pth

I hope this is helpful to you 20230629_105841.log

the results below also shows that，i use your advice not to add any parameters，
“
06/29 11:27:28 - mmengine - INFO - Results of pred_instances_3d:

----------- AP11 Results ------------

Pedestrian [email protected], 0.50, 0.50:
bbox AP11:0.0000, 0.0000, 0.0000
bev AP11:0.0000, 0.0000, 0.0000
3d AP11:0.0000, 0.0000, 0.0000
Pedestrian [email protected], 0.25, 0.25:
bbox AP11:0.0000, 0.0000, 0.0000
bev AP11:0.0000, 0.0000, 0.0000
3d AP11:0.0000, 0.0000, 0.0000
Cyclist [email protected], 0.50, 0.50:
bbox AP11:0.0000, 0.0000, 0.0000
bev AP11:0.0000, 0.0000, 0.0000
3d AP11:0.0000, 0.0000, 0.0000
Cyclist [email protected], 0.25, 0.25:
bbox AP11:0.0000, 0.0000, 0.0000
bev AP11:0.0000, 0.0000, 0.0000
3d AP11:0.0000, 0.0000, 0.0000
Car [email protected], 0.70, 0.70:
bbox AP11:0.0000, 0.0000, 0.0000
bev AP11:0.0000, 0.0000, 0.0000
3d AP11:0.0000, 0.0000, 0.0000
Car [email protected], 0.50, 0.50:
bbox AP11:0.0000, 0.0000, 0.0000
bev AP11:0.0000, 0.0000, 0.0000
3d AP11:0.0000, 0.0000, 0.0000

Overall AP11@easy, moderate, hard:
bbox AP11:0.0000, 0.0000, 0.0000
bev AP11:0.0000, 0.0000, 0.0000
3d AP11:0.0000, 0.0000, 0.0000

----------- AP40 Results ------------

Pedestrian [email protected], 0.50, 0.50:
bbox AP40:0.0000, 0.0000, 0.0000
bev AP40:0.0000, 0.0000, 0.0000
3d AP40:0.0000, 0.0000, 0.0000
Pedestrian [email protected], 0.25, 0.25:
bbox AP40:0.0000, 0.0000, 0.0000
bev AP40:0.0000, 0.0000, 0.0000
3d AP40:0.0000, 0.0000, 0.0000
Cyclist [email protected], 0.50, 0.50:
bbox AP40:0.0000, 0.0000, 0.0000
bev AP40:0.0000, 0.0000, 0.0000
3d AP40:0.0000, 0.0000, 0.0000
Cyclist [email protected], 0.25, 0.25:
bbox AP40:0.0000, 0.0000, 0.0000
bev AP40:0.0000, 0.0000, 0.0000
3d AP40:0.0000, 0.0000, 0.0000
Car [email protected], 0.70, 0.70:
bbox AP40:0.0000, 0.0000, 0.0000
bev AP40:0.0000, 0.0000, 0.0000
3d AP40:0.0000, 0.0000, 0.0000
Car [email protected], 0.50, 0.50:
bbox AP40:0.0000, 0.0000, 0.0000
bev AP40:0.0000, 0.0000, 0.0000
3d AP40:0.0000, 0.0000, 0.0000

Overall AP40@easy, moderate, hard:
bbox AP40:0.0000, 0.0000, 0.0000
bev AP40:0.0000, 0.0000, 0.0000
3d AP40:0.0000, 0.0000, 0.0000

06/29 11:27:28 - mmengine - INFO - Epoch(test) [3769/3769] Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP11_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP11_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP11_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP11_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP11_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP11_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP11_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP11_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP11_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP11_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP11_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP11_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP11_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP11_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP11_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP11_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP11_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP11_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP11_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP11_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP11_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP11_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP11_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP11_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP11_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP11_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP11_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP11_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP11_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP11_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP11_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP11_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP11_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP11_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP11_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP11_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP11_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP11_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP11_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP11_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP11_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP11_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP11_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP11_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP11_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP11_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP11_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP11_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP11_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP11_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP11_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP11_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP11_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP11_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_3D_AP11_easy: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_BEV_AP11_easy: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_2D_AP11_easy: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_3D_AP11_moderate: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_BEV_AP11_moderate: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_2D_AP11_moderate: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_3D_AP11_hard: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_BEV_AP11_hard: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_2D_AP11_hard: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP40_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP40_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP40_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP40_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP40_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP40_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP40_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP40_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP40_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP40_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP40_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP40_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP40_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP40_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP40_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_3D_AP40_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_BEV_AP40_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Pedestrian_2D_AP40_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP40_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP40_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP40_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP40_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP40_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP40_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP40_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP40_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP40_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP40_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP40_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP40_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP40_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP40_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP40_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_3D_AP40_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_BEV_AP40_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Cyclist_2D_AP40_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP40_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP40_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP40_easy_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP40_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP40_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP40_moderate_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP40_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP40_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP40_hard_strict: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP40_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP40_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP40_easy_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP40_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP40_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP40_moderate_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_3D_AP40_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_BEV_AP40_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Car_2D_AP40_hard_loose: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_3D_AP40_easy: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_BEV_AP40_easy: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_2D_AP40_easy: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_3D_AP40_moderate: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_BEV_AP40_moderate: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_2D_AP40_moderate: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_3D_AP40_hard: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_BEV_AP40_hard: 0.0000 Kitti metric/pred_instances_3d/KITTI/Overall_2D_AP40_hard: 0.0000 data_time: 0.0024 time: 0.0581
INFO - 2023-06-29 11:27:28,100 - driver - add pending dealloc: module_unload ? bytes
“

[sunjiahao1999]

@markwave It looks strange. Can you run python mmdet3d/utils/collect_env.py to check your environment? I guess you do not install spconv correctly.

[Blinkblade]

@markwave It looks strange. Can you run python mmdet3d/utils/collect_env.py to check your environment? I guess you do not install spconv correctly.

thanks, I had the same problem and solved it by re install spconv