-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Top-down centered-instance pipeline #3
Comments
In light of pytorch/data#1196, we should be mindful of using the existing patterns and functionality in core PyTorch's implementation of datapipes: https://github.com/pytorch/pytorch/tree/main/torch/utils/data/datapipes Namely, we should consider adding decorators to register our DataPipes with the functional API ( |
For high level pipeline builder, we would like an API that's really convenient and readable like: import sleap_io as sio
import sleap_nn as snn
labels = sio.load_slp("train.pkg.slp")
pipeline = snn.data.TopDownPipeline(labels=labels, anchor_node="thorax", crop_size=160, batch_size=4, rotation=180) Maybe we'll want to use a |
Add the core data pipeline for top-down centered instance models.
Use
TopdownConfmapsPipeline
as reference.Roughly:
Some of these may need to occur in a different order than above or in the reference pipeline to work better with the augmentation backends and/or with the PyTorch Lightning data model.
Notes:
tf.data.Dataset.unbatch()
to go from frame-level examples to instance-level examples.uint8
arrays to GPU will be 4x faster thanfloat32
sqrt(2) * box_size
(or a bit more for rounding error) so that we never have black edges regardless of the rotation angle.The text was updated successfully, but these errors were encountered: