Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clarification on PSNR/SSIM Calculation and Dataset Use for DRCT-L Model on Set5 #38

Open
Ar0Kim opened this issue Jan 9, 2025 · 0 comments

Comments

@Ar0Kim
Copy link

Ar0Kim commented Jan 9, 2025

Hello,

Thank you for sharing your project. I have a question regarding the PSNR and SSIM results for the DRCT-L model. Specifically, for a dataset like Set5, are the PSNR and SSIM values reported in the paper calculated as the average over each super-resolved image's individual PSNR and SSIM scores?
When I run the test.py file using the DRCT-L_X4.pth model, the PSNR log only shows a single best score, as seen below.
image

Did you use a separate script to calculate the PSNR and SSIM for each image individually and then compute their average?

Additionally, I am trying to replicate the paper’s result for Set5 inference with the DRCT-L model, which reports a PSNR of 33.37 and an SSIM of 0.9090. I downloaded the dataset from the link provided (Validation data link, https://github.com/ChaofWang/Awesome-Super-Resolution/blob/master/dataset.md),
image
and for Set5, the folder structure includes images ending in “LR.png” and “HR.png”.
image

In this context, should the dataroot_lq point to the folder containing images ending with “LR.png” and dataroot_gt point to the folder containing images ending with “HR.png”? If not, please let me know which PNG files should be used as HR and LQ images.

To achieve the reported PSNR and SSIM values, could you please clarify which exact dataset was used and provide any details or code regarding the metric calculations? Currently, the best scores I obtain are lower than those presented in the paper.

Thank you very much for your assistance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant