Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create dataloader #7

Open
3 of 5 tasks
YoniSchirris opened this issue Mar 30, 2020 · 2 comments
Open
3 of 5 tasks

Create dataloader #7

YoniSchirris opened this issue Mar 30, 2020 · 2 comments
Assignees
Labels
data Any task related to data obtainment, preprocessing, or loading enhancement New feature or request

Comments

@YoniSchirris
Copy link
Contributor

YoniSchirris commented Mar 30, 2020

  • Allow loading of (offline available) different datasets
  • Allow for different metadata to be loaded related to these datasets
  • Allow for getting all data at once for any regression to be done
  • On initializing the dataset, transform images to three PPGs (1 for each channel)
  • Allow for data augmentation. E.g. using overlapping boxes of a long video
@YoniSchirris YoniSchirris added the enhancement New feature or request label Mar 30, 2020
@YoniSchirris YoniSchirris added the data Any task related to data obtainment, preprocessing, or loading label Mar 30, 2020
@LittlePea13
Copy link
Collaborator

Added a PR with Dataloader and Dataset. Unfortunately I could not improve performance much, each video preprocessing takes around 3 minutes, since it needs to do operations per frame to avoid memory issues. I someone knows more about Threading, I added a version that does the reading from the file on a different Thread but I do not know enough about threading and the performance was similar.

@MalcolmMielle
Copy link
Contributor

I have made python functions in the utils.py file to transform a frame into a PPG signal. Should I move that to a folder containing common functions?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data Any task related to data obtainment, preprocessing, or loading enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants