feat(autoware_image_projection_based_fusion): add mask cluster fusion node #9482
+422
−0
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR introduces a new node for fusing instance segmentation results with clusters, assigning label values to the clusters. It serves as an alternative to the roi_cluster_fusion node, which relies on bounding boxes.
Following table shows results with old and new approach:
roi_cluster_fusion
only_allow_inside_cluster = false
roi_cluster_fusion
only_allow_inside_cluster = true
mask_cluster_fusion
default
Related links
Parent Issue:
How was this PR tested?
Testers can follow these steps to test PR.
1) Download the pre-trained RTMDet model:
2) For
autoware
use following PR:3) For
autoware_internal_msgs
use following PR:4) For
autoware.universe
use this and following PR:5) Build your Autoware workspace with new changes.
6) Run e2e or logging simulator.
7) Update the topic parameters from
launch/rtmdet.launch.xml
and run the launch file8) Update the topic parameters from
launch/mask_cluster_fusion.launch.xml
and run the launch file/perception/object_recognition/detection/clustering/camera_lidar_fusion/clusters
topic.Notes for reviewers
Interface changes
None.
Effects on system behavior
None.