Awesome AI upscaler

[iG8R]

Just found a mind-blowing AI upscaler - https://huggingface.co/spaces/gokaygokay/AuraSR-v2.
It has even a pytorch version - https://github.com/lucidrains/gigagan-pytorch

Examples.
https://senkuro.com/manga/re-monster/chapters/119429828913939988/pages/4

Original image:

Colorized image without upscaling:

Upscaled with RealESRGAN_x4plus_anime_6B:

Upscaled with AuraSR-v2:

[BinitDOX]

Seems good for text and doesn't remove artifacts

ERS:

ASR:

I'll test it in a few hrs.

[iG8R]

Almost exactly like in the original image:

[BinitDOX]

ESRGAN (Current) (2 seconds):

GigaGAN x4 (AuraSR-v2) (40 seconds) (The space uses this):

GigaGAN x4 Overlapped (AuraSR-v2) (80 seconds):

The AuraSR is for generic use-case, so it's not only larger by x130 times than ESR, but also takes a long time for the upscale.
I don't recommend using it but if you want:
Download https://huggingface.co/fal/AuraSR-v2/blob/main/model.ckpt, rename it as GigaGAN.ckpt and save it in networks folder.
Then run app-stream.py python app-stream.py --no-ssl --upscaler_type=GigaGAN --upscaler_path=networks/GigaGAN.ckpt
Also compare the output with this: https://huggingface.co/spaces/gokaygokay/AuraSR-v2, since this space is not loading for me, and I modified the source code a bit.

PS:

[iG8R]

Thank you very much!

[iG8R]

BTW, https://mangadex.org/chapter/d72a3eb8-2b20-4c39-a46f-d282eb05e64f/2 doesn't get colorized.

[BinitDOX]

Oh, just 4s? Great! Must be my GPU then.

Fixed. Does the MC-FJ colorize this?

[iG8R]

Oh, MC-FJ also doesn't colorize it...

Is there a way to forcefully colorize an image, and also re-colorize it, when sometimes MC colorizes placeholders?

https://senkuro.com/manga/zettai-ni-damage-wo-ukenai-skill-wo-moratta-node-boukensha-toshite-musou-shitemiru/chapters/136754949798249996/pages/1

MangaColorizer-placeholder-colorization-Video_2024-08-02_23-16-13.webm

[iG8R]

Oh, just 4s? Great! Must be my GPU then.

Although, AuraSR-vs size is 2.29GB, but the amount of VRAM it uses is about 7.2GB.

[BinitDOX]

when sometimes MC colorizes placeholders?

Oh I forgot about caches. It caches the wrong image. Should work when caching is off. Will fix.

[iG8R]

However, without caching, the load on the system increases, as it has to colorize and upscale again.

[BinitDOX]

Fixed. (Needs some more testing though)

[iG8R]

Thanks a lot!
But, at the moment, when MC encounters placeholders, it starts processing the image, that has the placeholder first, eternally, as it can be seen from the server log and the image from page 7 as an example.

MangaColorizer-placeholder-colorizition-02-Video_2024-08-03_09-33-33.webm

[BinitDOX]

Weird, this shouldn't happen.

[BinitDOX]

Oh src can change anyways, previous bad fix reverted. Alternate temp fix pushed.

[iG8R]

Thank you so much!
Now there are no issues with placeholders, but the issue regarding the "Show Original" option occurred:

MangaColorizer-show-original-issue-Video_2024-08-03_18-12-47.mp4

[BinitDOX]

I'm unable to reproduce it. Is it always happening? Can you send me both the logs?

[iG8R]

Thank you for your efforts!

Here's the entire process, which is why the screencast turned out a bit long and I had to split it into several parts to meet the size limitations (10 MB) on Github.
Please pay attention to the first pages of chapters 1 and 1.5 (they will appear to be exactly the same at the end of the colorization).

Part1

MangaColorizer-show-original-double-colorized-Video_2024-08-04_18-40-43_part1.mp4

---

Part 2

MangaColorizer-show-original-double-colorized-Video_2024-08-04_18-40-43_part2.mp4

---

Part 3

MangaColorizer-show-original-double-colorized-Video_2024-08-04_18-40-43_part3.mp4

---

Part 4

MangaColorizer-show-original-double-colorized-Video_2024-08-04_18-40-43_part4.mp4

---

Part 5

MangaColorizer-show-original-1ch-1.5ch-the-same-1st-page-Video_2024-08-04_18-46-21_part1.mp4

---

Part 6

MangaColorizer-show-original-1ch-1.5ch-the-same-1st-page-Video_2024-08-04_18-46-21_part2.mp4

---

Logs:

MangaColorizer-server-log.txt

Screenshot, big screenshot, really big screenshot

[BinitDOX]

This only occurs with Senkuro right? They load the next chapter if you scroll to the bottom and pages start recoloring due to reuse of page names. But the original still doesn't get affected for me.

[iG8R]

Yes, I only noticed it on senkuro.com. Though, I haven't been watching much manga lately, mostly just manhua.