tiny yolov2 doesn't work on raspberry pi zero

[iamfaith]

pi@raspberrypi:~/cONNXr-master $ build/connxr test/tiny_yolov2/Model.onnx test/tiny_yolov2/test_data_set_0/input_0.pb
Loading model test/tiny_yolov2/Model.onnx...ok!
Loading input test/tiny_yolov2/test_data_set_0/input_0.pb...ok!
values = 1
Resolving model...
Running inference on Example Model model...
Killed

[nopeslide]

hey ho, thanks for reporting this.
could you run

make clean
make TRACE_LEVEL=1 connxr
./build/connxr test/tiny_yolov2/Model.onnx test/tiny_yolov2/test_data_set_0/input_0.pb 2>&1 | tee tiny_yolov2.log

and post the tiny_yolov2.log file ?

[iamfaith]

pi@raspberrypi:~/cONNXr-master $ ./build/connxr test/tiny_yolov2/Model.onnx test/tiny_yolov2/test_data_set_0/input_0.pb
Loading model test/tiny_yolov2/Model.onnx...[ENTRY 1] src/utils.c:144 entering function openOnnxFile
[TRACE 1] src/utils.c:161 length of file is 63480982
[EXIT 1] src/utils.c:165 exiting function openOnnxFile
ok!
Loading input test/tiny_yolov2/test_data_set_0/input_0.pb...[ENTRY 1] src/utils.c:170 entering function openTensorProtoFile
[TRACE 1] src/utils.c:173 Opening .pb file test/tiny_yolov2/test_data_set_0/input_0.pb
[TRACE 1] src/utils.c:189 length of file 2076688
[EXIT 1] src/utils.c:193 exiting function openTensorProtoFile
ok!
[ENTRY 1] src/utils.c:203 entering function convertRawDataOfTensorProto
[TRACE 1] src/utils.c:218 Tensor has raw data. Unserializing it
[TRACE 1] src/utils.c:219 Tensor type = 1
[EXIT 1] src/utils.c:291 exiting function convertRawDataOfTensorProto
values = 1
Resolving model...
[ENTRY 1] src/inference.c:18 entering function resolve
[ENTRY 1] src/utils.c:15 entering function searchTensorProtoByName
[TRACE 1] src/utils.c:16 Searching for TensorProto with name=image
[TRACE 1] src/utils.c:34 Found TensorProto in inputs to de model with name=image
[EXIT 1] src/utils.c:35 exiting function searchTensorProtoByName
[ENTRY 1] src/utils.c:15 entering function searchTensorProtoByName
[TRACE 1] src/utils.c:16 Searching for TensorProto with name=scalerPreprocessor_scale
[TRACE 1] src/utils.c:23 Found TensorProto in initializer list with name=scalerPreprocessor_scale
[EXIT 1] src/utils.c:24 exiting function searchTensorProtoByName
[ENTRY 1] src/utils.c:353 entering function init_tensor_proto
[EXIT 1] src/utils.c:410 exiting function init_tensor_proto
[ENTRY 1] src/operators/ai.onnx/Mul/7/prepare_operator__ai_onnx__mul__7.c:11 entering function prepare_operator__ai_onnx__mul__7
[ENTRY 1] src/utils.c:66 entering function searchInputByName
[EXIT 1] src/utils.c:90 exiting function searchInputByName
[ENTRY 1] src/utils.c:102 entering function searchOutputByName
[EXIT 1] src/utils.c:116 exiting function searchOutputByName
Killed

[nopeslide]

thanks! now we know the problem lies in prepare_operator__ai_onnx__mul__7
so please run once again (no need to recompile) and post the log

CONNXR_TRACE_FUNCTION="prepare_operator__ai_onnx__mul__7:9" ./build/connxr test/tiny_yolov2/Model.onnx test/tiny_yolov2/test_data_set_0/input_0.pb

[iamfaith]

pi@raspberrypi:~/cONNXr-master $ CONNXR_TRACE_FUNCTION="prepare_operator__ai_onnx__mul__7:9" ./build/connxr test/tiny_yolov2/Model.onnx test/tiny_yolov2/test_data_set_0/input_0.pb
Loading model test/tiny_yolov2/Model.onnx...[ENTRY 1] src/utils.c:144 entering function openOnnxFile
[TRACE 1] src/utils.c:161 length of file is 63480982
[EXIT 1] src/utils.c:165 exiting function openOnnxFile
ok!
Loading input test/tiny_yolov2/test_data_set_0/input_0.pb...[ENTRY 1] src/utils.c:170 entering function openTensorProtoFile
[TRACE 1] src/utils.c:173 Opening .pb file test/tiny_yolov2/test_data_set_0/input_0.pb
[TRACE 1] src/utils.c:189 length of file 2076688
[EXIT 1] src/utils.c:193 exiting function openTensorProtoFile
ok!
[ENTRY 1] src/utils.c:203 entering function convertRawDataOfTensorProto
[TRACE 1] src/utils.c:218 Tensor has raw data. Unserializing it
[TRACE 1] src/utils.c:219 Tensor type = 1
Killed

[nopeslide]

wow, not even as far as before :D
there seems to be something very basic broken.
could you test if this occurs randomly or always at the same point?
than try to building it again with TRACE_LEVEL=9 to enable all tracing levels and post the log again.

you could also try to produce a core dump by running ulimit -S -c unlimited and send it over with the connxr binary,
than I can at least identify the problem further.

will test this on my raspberry pi 1 (which has the same chipset as the zero).
but this will take a moment (days,weeks) on my side.
so if you want to debug this, feel free :D

[nopeslide]

One simple thing this could be is a failing malloc without error handling. There are still quite few in the codebase and tiny yolo is not as tiny as the name suggests :D
You could simply run it on another machine and check the ram usage (it runs a few minutes) (I checked and it's almost 200MB)

[alrevuelta]

There are still quite few in the codebase and tiny yolo is not as tiny as the name suggests :D

This was exactly was I was thinking when I read raspberry pi. Tiny yolo is quite big and computation intensive. But really nice that @iamfaith you are trying cONNXr in a RPI. Have you tried the other models we have?

[nopeslide]

I hate this ui x.x

[Coderitter-GmbH]

One problem is, that the allocated memory of the tensors is not freed when they are not needed anymore.
I had the same problem and added the functionality for freeing the tensors, but the algorithm only works for linear networks.