503 Error - Instead of "silently failing" wait ~20 seconds and retry again

[EpicLPer]

Heya!

I'm currently doing a mass-backup of several services again and I've just had a short hiccup due to a partial server outage from a site.

Some downloads failed after 5 tries and weren't retried, and having to re-run the script just for it to check thousands of duplicate images before getting to the missing ones is a bit time consuming, so my idea would be to just automatically try again if a 503 error (or similar) is received instead of silently failing and having to re-run the whole archive again. Maybe make it a flag in the config so it's not a standard option for everyone so their setups don't break :)

Thanks!

[mikf]

Some downloads failed after 5 tries and weren't retried

They were retried 5 times, as is the default value for the retries option.
Set it to -1 or some high number if you want it to retry more often.

instead of silently failing

You should be getting an error logging message when a download fails after retrying it for the set number of times.