Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cycle dehaze modify #65

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
41 changes: 41 additions & 0 deletions summaries/cycle_dehaze.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
# Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing

- Authors:- Deniz Engin, Anıl Genc, Hazım Kemal Ekenel
- Conference name:- The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Year of publication:- 2018

## Summary

This paper proposes an end-to-end network for single-image dehazing problems, which is an enhanced version of the cycleGAN method, i.e, this also works on unpaired images in the datasets. The provided method is better than the state of the art methods for single-image dehazing which use the atmospheric scattering model.

## Main contributions

- The addition of perceptual cycle loss in the original cycleGAN architecture, which compares images in a feature space rather than the pixel space.

![Losses](https://raw.githubusercontent.com/engindeniz/Cycle-Dehaze/master/figs/model.png)

- Since the paper is adopting the original cycleGAN architecture, hence dataset of unpaired images is used.

- This method does not rely on calculating the parameters of the atmospheric scattering model (which is used in the earlier methods).

- To upscale the output images, Laplacian pyramid is used instead of the bicubic-upscaling method to get a higher resolution and sharp image for better haze free images.

- Due to its cyclic structure, the model turns out to be generalized and can be used for other datasets.

## Implementation details

- The CycleGAN model architecture is adapted from the original [CycleGAN](https://arxiv.org/pdf/1703.10593.pdf) paper, with the addition of a cycle perceptual loss inspired by the [EnhanceNet paper](https://arxiv.org/pdf/1612.07919.pdf). To achieve high-resolution output images, the model utilizes the [Laplacian pyramid](https://arxiv.org/pdf/1506.05751.pdf) method.

## Two-cents

- The model achieves very significant results even in the absence of the ground-truth images, unlike the state of the art methods.

- The is a generalizable model as it learns the dehazing task rather than overfitting on the data.

- Higher weightage is given to cycle consistency loss as compared to perceptual cycle loss, as higher weightage to the perceptual cycle loss causes loss of color information after dehazing.

## Resources

- Paper:- https://arxiv.org/pdf/1805.05308.pdf

- Implementation:- https://github.com/engindeniz/Cycle-Dehaze/