Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Mosaic Data Augmentation #587

Open
ai-fast-track opened this issue Dec 11, 2020 · 3 comments · May be fixed by #1007
Open

Add Mosaic Data Augmentation #587

ai-fast-track opened this issue Dec 11, 2020 · 3 comments · May be fixed by #1007
Assignees
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@ai-fast-track
Copy link
Collaborator

ai-fast-track commented Dec 11, 2020

🚀 Feature

This feature is an enhancement that can be added to our data augmentation pipeline.

Mosaic Transform represents a new data augmentation method that mixes 4 training images: 4 different contexts are mixed in one single image. It has been successfully used in both YOLOv4 and YOLOv5.

Combining several images having different sizes is clever idea because the model will learn to predict with several images with different scaling. A kind of progressive resizing but done exclusively on the augmented images while the rest of the images are trained with their original sizes in case we only apply the data augmentation on a certain percentage of the total images.

image

Here is a link to the definition of the mosaic augmentation. In case we implement something similar, we should discard the transform they use at the end of the method namely random_perspective because additional transforms can added in the IceVision transforms pipeline.

def load_mosaic(self, index)

@ai-fast-track ai-fast-track added enhancement New feature or request help wanted Extra attention is needed labels Dec 11, 2020
@FraPochetti
Copy link
Contributor

Not enough bandwidth to implement.

@potipot
Copy link
Contributor

potipot commented Dec 20, 2021

I'm currently working on this, reopening. My implementation will be manual as albumentations dont allow this at the moment: albumentations-team/albumentations#677

@potipot potipot reopened this Dec 20, 2021
@FraPochetti
Copy link
Contributor

That'd be so awesome to have!

@potipot potipot self-assigned this Dec 21, 2021
@potipot potipot linked a pull request Dec 21, 2021 that will close this issue
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants