Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorporating handrail segmentation into ISAAC #101

Draft
wants to merge 41 commits into
base: develop
Choose a base branch
from

Conversation

morgannewellsun
Copy link

@morgannewellsun morgannewellsun commented Jul 25, 2023

What is this PR

This PR contains no changes outside of the addition of astrobee/localization/cnn_object_localization and astrobee/localization/lightweight_cnn_object_detection. It serves to incorporate the work done by Aryan Naveen on MRCNN-based detection and localization of handrails on the ISS., as well as some cleanup, integration, and experimental work that builds on it.

Things this PR depends on

The code in this PR expects the following changes within the Astrobee repo for cnn_object_localization to run in simulation. For a minimal "quick-fix" example of these changes, see this comparison.

  • Addition of a publisher for color dock-cam images
  • Updating of the dock-cam camera parameters used in gazebo simulation

Additionally, the following data is not included in this PR, but is associated with handrail segmentation. These materials are currently located on bartlett:/usr/local/home/mnsun/CNN_LOCALIZATION_RESOURCES.

  • Synthetically generated dataset
  • Manually labelled dataset for fine-tuning
  • Small image dataset of demo results
  • Pretrained checkpoints/models
  • Reference pointclouds for ICP
  • Compiled libtorch and libtorchvision binaries for armv7l

morgannewellsun and others added 30 commits July 14, 2023 13:22
…-downgrade

Morgan develop torchscript downgrade
… can be compiled with catkin for native (not arm)
…rks when arm binaries are avaiable, for what it's worth.
…oss-compilation; other documentation reformatting
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant