FCOS3D model conversion to onnx

[xiaoxiongmaoxuexi]

Traceback (most recent call last):
File "/home/zhanggan/mmdetection3d-master/demo/onnx-runtime.py", line 4, in
sess = rt.InferenceSession('test.onnx')
File "/home/zhanggan/anaconda3/envs/mmdetectiond3d1/lib/python3.7/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 324, in init
self._create_inference_session(providers, provider_options, disabled_optimizers)
File "/home/zhanggan/anaconda3/envs/mmdetectiond3d1/lib/python3.7/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 358, in _create_inference_session
sess = C.InferenceSession(session_options, self._model_path, True, self._read_config_from_model)
onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Load model from test.onnx failed:Fatal error: MMCVModulatedDeformConv2d is not a registered function/op

[ZCMax]

I'm not quietly familiar with onnx, and the release of onnx conversion is currently not in our short-term plan. Maybe you can refer to this issue: open-mmlab/mmcv#1422

[xiaoxiongmaoxuexi]

@ZCMax :Thank you for your reply. I try to follow #1422 operation, but there reasoning model still has this problem. Is there a relevant communication group? I want to join in and study together. Thank you.

[ZCMax]

We do have a wechat group for mmdetection3d, but mainly talk about LiDAR based 3d object detection, I'm not sure whether someone could you help.

[xiaoxiongmaoxuexi]

@ZCMax ：Can I join you? I'm looking forward to joining you to discuss relevant issues. thank you.

[Tai-Wang]

We have colleagues working on the deployment and model conversion for MMDet3D models. PointPillars and SECOND will have the highest priority, and then we will consider FCOS3D. So currently I will keep this issue open for community discussion, and update related changes if we make any progress.

[xiaoxiongmaoxuexi]

@Tai-Wang ：Thank you for your reply and look forward to the emergence of fcos3d model transform.

[Thomas-Kb]

@Tai-Wang Can you estimate on when the onnx conversion for PointPillars and SECOND will be finished?

[Tai-Wang]

@Thomas-Kb I can not estimate the concrete time for now. We need to finish the migration of ops from mmdet3d to mmcv first. Afterward, we will continue to work on the conversion issue.
I will update related information here if there is any progress.

[scuizhibin]

Hello, how can I convert FCOS3D to ONNX format? Hope to get your help, thank you

[saesaria]

Hi, is there any updates on how to convert FCOS3D to onnx model? thank you in advance.

[Superyanzhuang]

Hello, I also want to convert FCOS3D to ONNX, but it keeps failing. If you succeed, please leave me a message. thank you

[perfectworld0415]

do you successed in convert FCOS3D to ONNX ?

[yuhanqing1996]

Hello, I also want to convert FCOS3D++ to ONNX. If there is any progress, please leave me a message. thank you！！！

[shibukazu]

This error might occur because the custom ops for ONNX Runtime are not built correctly. Let's try to rebuild the custom ops by following the instructions in the link below
https://github.com/open-mmlab/mmdeploy/blob/main/docs/en/01-how-to-build/linux-x86_64.md#build-model-converter

[PraveenKumar-Rajendran]

Has anyone successfully converted the FCOS3D model to ONNX format?
I see that this issue has been open since November 2021.
Any updates or insights would be greatly appreciated.