Skip to content

LiDAR-Based Deep Loop Closure Detection and Registration using Panoptic Attention

License

Notifications You must be signed in to change notification settings

robot-learning-freiburg/PADLoC

Repository files navigation

PADLoC

arXiv | IEEE Xplore | Website | Video

This repository is the official implementation of the paper:

PADLoC: LiDAR-Based Deep Loop Closure Detection and Registration using Panoptic Attention

José Arce, Niclas Vödisch, Daniele Cattaneo, Wolfram Burgard, and Abhinav Valada.

IEEE Robotics and Automation Letters (RA-L), vol. 8, issue 3, pp. 1319-1326, March 2023

Overview of PADLoC architecture

If you find our work useful, please consider citing our paper:

@article{arce2022padloc,
  author={Arce, Jos{\'e}, and V{\"o}disch, Niclas and Cattaneo, Daniele and Burgard, Wolfram and Valada, Abhinav},
  journal={IEEE Robotics and Automation Letters},
  title={PADLoC: LiDAR-Based Deep Loop Closure Detection and Registration Using Panoptic Attention},
  year={2023},
  volume={8},
  number={3},
  pages={1319-1326}
}

📔 Abstract

A key component of graph-based SLAM systems is the ability to detect loop closures in a trajectory to reduce the drift accumulated over time from the odometry. Most LiDAR-based methods achieve this goal by using only the geometric information, disregarding the semantics of the scene. In this work, we introduce PADLoC, a LiDAR-based loop closure detection and registration architecture comprising a shared 3D convolutional feature extraction backbone, a global descriptor head for loop closure detection, and a novel transformer-based head for point cloud matching and registration. We present multiple methods for estimating the point-wise matching confidence based on diversity indices. Additionally, to improve forward-backward consistency, we propose the use of two shared matching and registration heads with their source and target inputs swapped by exploiting that the estimated relative transformations must be inverse of each other. Furthermore, we leverage panoptic information during training in the form of a novel loss function that reframes the matching problem as a classification task in the case of the semantic labels and as a graph connectivity assignment for the instance labels. We perform extensive evaluations of PADLoC on multiple real-world datasets demonstrating that it achieves state-of-the-art performance.

👨‍💻 Code Usage

Please check the documentation files for the specific tasks of:

👩‍⚖️ License

For academic usage, the code is released under the GPLv3 license. For any commercial purpose, please contact the authors.

🙏 Acknowledgment

This work was funded by the European Union’s Horizon 2020 research and innovation program under grant agreement No 871449-OpenDR and the DFG Emmy Noether Program.

drawing

About

LiDAR-Based Deep Loop Closure Detection and Registration using Panoptic Attention

Resources

License

Stars

Watchers

Forks