roadmap.md

Lightning Pose development roadmap

General enhancements

• multi-GPU training for supervised models
• introduce jaxtyping (see here)

Losses and backbones

• incorporate transformer backbones (#84, #106)
• compute non-temporal unsupervised losses on labeled data

Multi-view support for non-mirrored setups

• implement supervised datasets/dataloaders that work with multiple views (#115)
• context frames for multi-view (#126)
• unsupervised losses for multi-view (#187)

Single-view dynamic crop (small animals in large frames)

• implement dynamic cropping pipeline with detector model and pose estimator
• context frames for dynamic crop
• unsupervised losses for dynamic crop

Multi-view dynamic crop

• perform view-specific dynamic cropping, re-assemble views after pose estimation stage
• context frames for multi-view dynamic crop
• unsupervised losses for multi-view dynamic crop

Multi-animal

• single-view, supervised
• single-view, context
• single-view, unsupervised losses
• multi-view, supervised
• multi-view, context
• multi-view, unsupervised losses