cloudflare challenge 503 continue to occur after solving the first one #5

partyspy · 2019-03-28T13:01:50Z

It seems that your code snippet didn't handle the requests already in the scheduler queue while the concurrent one request challenged by cloudflare. Therefore even if a challenge is resolved, subsequent requests would still face challenges.

guillaumedsde · 2019-06-28T13:44:15Z

having this issue as well, here are my logs:

2019-06-28 13:35:55 [scrapy.utils.log] INFO: Scrapy 1.6.0 started (bot: crawler)
2019-06-28 13:35:55 [scrapy.utils.log] INFO: Versions: lxml 4.3.4.0, libxml2 2.9.9, cssselect 1.0.3, parsel 1.5.1, w3lib 1.20.0, Twisted 19.2.1, Python 3.7.3 (default, May 11 2019, 02:00:41) - [GCC 8.3.0], pyOpenSSL 19.0.0 (OpenSSL 1.1.1b  26 Feb 2019), cryptography 2.7, Platform Linux-5.1.15-arch1-1-ARCH-x86_64-with
2019-06-28 13:35:55 [scrapy.crawler] INFO: Overridden settings: {'AJAXCRAWL_ENABLED': True, 'AUTOTHROTTLE_ENABLED': True, 'AUTOTHROTTLE_MAX_DELAY': 10, 'AUTOTHROTTLE_TARGET_CONCURRENCY': 15.0, 'BOT_NAME': 'crawler', 'CONCURRENT_REQUESTS': 100, 'CONCURRENT_REQUESTS_PER_IP': 30, 'COOKIES_ENABLED': False, 'DEPTH_LIMIT': 2, 'DEPTH_PRIORITY': 1, 'DOWNLOAD_TIMEOUT': 20, 'LOG_FILE': 'logs/default/recursive_spider/a625e99499a911e9bcd934298f900aba.log', 'NEWSPIDER_MODULE': 'crawler.spiders', 'REACTOR_THREADPOOL_MAXSIZE': 30, 'REDIRECT_MAX_TIMES': 10, 'RETRY_ENABLED': False, 'SCHEDULER_DISK_QUEUE': 'scrapy.squeues.PickleFifoDiskQueue', 'SCHEDULER_MEMORY_QUEUE': 'scrapy.squeues.FifoMemoryQueue', 'SPIDER_MODULES': ['crawler.spiders'], 'TELNETCONSOLE_ENABLED': False}
2019-06-28 13:35:55 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.throttle.AutoThrottle']
2019-06-28 13:35:55 [recursive_spider] DEBUG: RecursiveSpider's start url was overridden with https://www.torrentday.com/
2019-06-28 13:35:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Android
2019-06-28 13:35:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV13, Brand: Sony, Model: BDV13
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV14, Brand: Sony, Model: BDV14
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: LG Web0S SmartTV, Brand: LG, Model: Web0S SmartTV
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV11, Brand: Sony, Model: BDV11
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2019-06-28 13:36:00 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:00 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:00 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2019-06-28 13:36:00 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:01 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2019-06-28 13:36:01 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-06-28 13:36:01 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: SMTBot
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: WebKit Nightly
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Robot
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Zune
2019-06-28 13:36:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy_cloudflare_middleware.middlewares.CloudFlareMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy_user_agents.middlewares.RandomUserAgentMiddleware',
 'scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2019-06-28 13:36:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawler.middlewares.StartRequestsMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware']
2019-06-28 13:36:03 [scrapy.middleware] INFO: Enabled item pipelines:
['crawler.pipelines.scrapy_mongodb.MongoDBPipeline']
2019-06-28 13:36:03 [scrapy.core.engine] INFO: Spider opened
2019-06-28 13:36:03 [scrapy-mongodb-pipeline] INFO: Connected to MongoDB mongodb://user:[email protected]:27017, using "scrapy"
2019-06-28 13:36:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:36:03 [recursive_spider] INFO: Spider opened: recursive_spider
2019-06-28 13:36:03 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36
2019-06-28 13:36:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://www.torrentday.com/login.php> from <GET https://www.torrentday.com/>
2019-06-28 13:36:03 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36
2019-06-28 13:36:06 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:06 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:10 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=14a15bc6587d312d14ba88adf5946b6859035fda-1561728966-1800-AbNRLVSRkyNjmObM0dsWWSdrm61ViHmj8RpXyxPe462rrKl%2B1ccU4V8hged8lelggtbjVg1ZilwqCET%2FY1ae8hEHWD3NlcjJclpTcVpeagRDHbqrAN%2BSbQlKnOOnrsny10bFY7im%2FUigaG3p%2FS%2Bv8vU%3D&jschl_vc=023ed0d5e6ae860135a6435e85a9928a&pass=1561728970.941-kwfPWE1Jup&jschl_answer=31.8089354662 HTTP/1.1" 302 159
2019-06-28 13:36:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:11 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:11 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.11 (KHTML, like Gecko) Chrome/23.0.1271.97 Safari/537.11
2019-06-28 13:36:14 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:18 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=aaafb6608a16f68595cc17366e306712a7673652-1561728974-1800-Adh7AaUMfvG6T40yGEm51L64QZBXv%2BYIUFk03fbG2ESSmHZs4VWRZFMr2XT0lAVFUGcFPzue794UkDtDYz4d5Zaxvw5rFvQyqGPCb40SBVqgc2qg0eE4GxelG80AiG5qDUTVbJZNvabBIFF6aOFCdMk%3D&jschl_vc=db173891cc89493816c338b681b6c43c&pass=1561728978.257-aD7VkjJ2xp&jschl_answer=14.1633611252 HTTP/1.1" 302 159
2019-06-28 13:36:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:18 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:18 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
2019-06-28 13:36:20 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:25 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:25 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=1744c8baa4ba0876cade92df8017e10d9477d978-1561728981-1800-AU9YUqqtSMyi7mSkbD8N0ePgHpOyd4jT0Egjc7ySLUmno0IAevRCjom%2F4LEtkKgCkcO7bWM1pGelsmPxeq1WdC%2B4BMimstbs%2Fhzhja8Ed%2FHlzknWZvuoeqXUMIsS1klgcoyLeR1y0amtxGMRr6iOQok%3D&jschl_vc=3330555c4ae88bf6b8dbdb22ed991b25&pass=1561728985.032-D%2FcPFBm9xF&jschl_answer=18.0117289088 HTTP/1.1" 302 159
2019-06-28 13:36:25 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:25 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:25 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36
2019-06-28 13:36:27 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:27 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:31 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:31 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=e469e89bf49ff20d44627f3b0470542beda294fb-1561728987-1800-ASK3c%2BOvYZM81xriCd0uoscbNEqlDBaDDc5EkdKGuNFOc3l%2BrOqSr7SE2ULuXY%2BWiOrChSKaKJt4wqi889f9lHCmZDjtrnairttDA2PvRB1E6LtZ4ohAgLM9bYGVKK6TBaNHTdTV7BQ0ww%2BcO2iPjPU%3D&jschl_vc=3f0a851b9d0e51925b0e7e0f4cff4aa3&pass=1561728991.495-fa%2B5hI6zDF&jschl_answer=27.0484810512 HTTP/1.1" 302 159
2019-06-28 13:36:31 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:31 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:31 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.103 Safari/537.36
2019-06-28 13:36:34 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:34 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:38 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:38 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=3f136be2d3fad068e5645726231faf413094e9a9-1561728994-1800-AX43JCdfCgOUmHPSBkmKOhz70eNXXJMt9uQg6zaZei4q6argic%2FeEYrLHB6HAMS09i4V3tox1aTmgDigxoi3z6A1ucqwpgzQ%2FzlVHjDIjzbQ5%2FMVS4%2B4wUYk5qt2ite1OuuE%2BB2zaa47%2Bc%2FrmPa5mtk%3D&jschl_vc=2694aef6079d374e9880938bbe538e80&pass=1561728998.33-M2dnDnwNj1&jschl_answer=24.4746268179 HTTP/1.1" 302 159
2019-06-28 13:36:38 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:38 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:38 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.82 Safari/537.36
2019-06-28 13:36:41 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:45 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=d660cd9f1ce0effa530b53a283b88977dcc66b38-1561729001-1800-AQ1ZSLaPxxUSdSuiSBlIqLX%2BYGgw5TvSUPagy3oEpgYp5tgtgdfZab8syHB1Uh7e3fIGEb9Lxn%2BgJDYjIjvTjcGje0CsJi2TyBwLajvogBuGxxo1F8RaQ4KgTCzmjYgq%2Fnl%2BXQ1yxjVHpXUxkJ4gCdA%3D&jschl_vc=dfc552c4c3c84995f28c4369609a8caf&pass=1561729005.109-AYZ5EfxB%2FR&jschl_answer=-19.0517155835 HTTP/1.1" 302 159
2019-06-28 13:36:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:45 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:45 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2526.111 Safari/537.36
2019-06-28 13:36:47 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:47 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:51 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=ec24d243972bd369d102b37f33b2ae5f22978556-1561729007-1800-Adhzl%2BP024lnAon6i03SEZLBK4eWYgXvqs8SJIylDUrA8QPNdy77vw7oVqXfCzcbPMnhDK2N7vvqoLp5irO6ls9bMrk8mFKvkXodnQvAxjmj9C2vmqcZExKLveC0nCReJPaYFfJxVv7Spqw8sMFwgj4%3D&jschl_vc=e40cf664ca438ebd238b5188f14c05c8&pass=1561729011.109-CZM9K13cYZ&jschl_answer=18.1586085045 HTTP/1.1" 302 159
2019-06-28 13:36:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:51 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:51 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.140 Safari/537.36
2019-06-28 13:36:53 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:53 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:57 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:58 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4c3ec01a37ab9157ca1c3b9208552fbf8ee501dd-1561729013-1800-AS4WaktnNhqL3CoEmFlo8LAmXADFglsSyRUKkWsc1UNZC2GtohvCF0LrSgsdY9bSYvfHiKol17f95Pa2oIPJOEk%2Be3xIhEaTavepPwEegBrHsOJ%2Fap2t889CNW4sk1DY7zXJN3mSkCdGG8HTEZhFvkU%3D&jschl_vc=ce85f55e54718074115ca141f1f81466&pass=1561729017.966-LNTD2Al%2BjJ&jschl_answer=15.8313619564 HTTP/1.1" 302 159
2019-06-28 13:36:58 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:58 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:58 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Safari/537.36
2019-06-28 13:37:01 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:01 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:05 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:05 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=562c63e21f5511de5bc98a9b84c6509b87d6b20f-1561729021-1800-ATVj1HQ8DUGQkNQ2S0duKQOhLvz5M8FLQ1wMWFwknE8qPzmYaIw9ltDR08ZEdFJqUTc8wVo3tMZVpbtFeJ1dZP56bNLGJGKviDewsH4%2B483KOsVFhTXtt%2Bbmg89hGrOwIqdrunBTsHdff11%2Fp8A2Hfw%3D&jschl_vc=9fdad85eff4e16f58a694942c1dbb518&pass=1561729025.379-dB22GQ0Wqr&jschl_answer=16.2313544974 HTTP/1.1" 302 159
2019-06-28 13:37:05 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:05 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:37:05 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Safari/537.36
2019-06-28 13:37:08 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:08 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:12 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:12 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=24b239f95e67aa658e3befa0550b74000da47062-1561729028-1800-AcoGZ83jSg1oAKnrb3We%2B%2FjM9MY1NwvqxRiZUL2e%2BduJputQFOHFAqYMx2UGMvwJRKyAFsaUSv2a1hnfOGqWAIMZiE42jmyPlQQPwGnSe6QjClX5qTjS9S6iYhkFC0RH6bNY%2BuGg84y04jUeZRS4W2I%3D&jschl_vc=ceaad85009f0f8cddabc0e2981004f5c&pass=1561729032.798-i985mKAcpJ&jschl_answer=43.6792426250 HTTP/1.1" 302 159
2019-06-28 13:37:12 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:16 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:16 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=ee1d1a6545944efa1924ab971d00566aeba8f17f-1561729032-1800-ARcnK59BpqHpqmK7%2F9T8trviSnY%2BBRRZXosAScZ1XMp6i5hfZnUr%2BHYlu%2F%2B4aP0wLCwpV3fHFdUreO6ySHO5nvZ1ZdA8rpbo9eplUP%2BTv2R59TpIoFaSgX%2F%2F6H9Z8Tru2DFIfTAV0xAW%2BsVEUov7L8g%3D&jschl_vc=376f0ed23d2b45e213e98deca81d675c&pass=1561729036.889-ZmIN%2Bppx0b&jschl_answer=11.8442078711 HTTP/1.1" 302 159
2019-06-28 13:37:17 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:17 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:17 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.81 Safari/537.36
2019-06-28 13:37:17 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:17 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:21 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=b11261ac53419bde6d6d65a8766febbebd8f430f-1561729037-1800-AXSjXjx2bM5%2BxXxvGJsXxeZd75CKfr4PLAPlXQaSdWXg2ubn58Xj8TduN%2BjjY3BbkYG%2Bb5cf%2B6QSdbh8S6yXYndafe8NGwKSP0me91bn7ygvCEMo9qWSW9rTMNVpKALnLgkUT2p23eYT7drrTCFRqLk%3D&jschl_vc=d7f80ace5776b9c37078b0b69fd3e204&pass=1561729041.169-75SeYWNjbJ&jschl_answer=21.9466356421 HTTP/1.1" 302 159
2019-06-28 13:37:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:21 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:21 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Safari/537.36
2019-06-28 13:37:22 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:22 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:26 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=3c9ce8354e5bbea3a55fa6a5df15c4de0c1e0586-1561729042-1800-AZd6L0n9ZSL%2BYpn82HjkucVmCVzgKEqkvl2Moe3saMcsbZyrBftGb5qRaqWzQ61Pf7NuV474CQZY67kb4wrC2hOyhnuCfbLKacvwqZRITJ7HVonwofP1cP2keIGIZOx%2Bw58pfG8Q5J45a7%2Fu7ZL9OiE%3D&jschl_vc=c655245748f38893b5b276ee596f8d2e&pass=1561729046.071-OCF3FjOfDs&jschl_answer=31.6688107276 HTTP/1.1" 302 159
2019-06-28 13:37:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:26 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:26 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.108 Safari/537.36
2019-06-28 13:37:29 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:33 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:33 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=41b9de420cc0f0b8e2d684f9dbc60e95a1e74782-1561729049-1800-AaOap6cTevrcW8oB5mbClQXR3QC8GN2vX28RQAJJHT%2BB973Z5JJ%2FEOn8eUT%2BPTXCAYQn%2BNlq7rejOnB3D68s63UA%2BzAWW2AOsHJPEVdUenAsVzskN2bh35nY81qHZYfbYGhKnUoDS6ltJlXrJ3bdoZE%3D&jschl_vc=30079381b028e2e5df08c47fea6cc7ea&pass=1561729053.36-TFynOWBNLh&jschl_answer=29.5543137019 HTTP/1.1" 302 159
2019-06-28 13:37:33 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:33 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:33 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.117 Safari/537.36
2019-06-28 13:37:35 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:35 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:39 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:39 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=6dbaa4c5dc5793d8d3100b4f65be3919dac3e0ad-1561729055-1800-Abaoc6aQydSkFngX2BTMZaI08LiGaSoNF4yirJ%2Fze7M2H0mfRxE2%2Bie8LZYA1GHixyvhR%2BI6DoVbrcWxZTh0e1M8uYN8nj0pxhNyE%2BfLua9uki%2B6MtWgirBvlnMMel952Q2sAVW%2FMzFXAtdIRburNDA%3D&jschl_vc=052622270c539d1f46be171e56696228&pass=1561729059.474-1N%2Ftd5NvXq&jschl_answer=45.4663876991 HTTP/1.1" 302 159
2019-06-28 13:37:39 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:39 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:39 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.89 Safari/537.36
2019-06-28 13:37:40 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:45 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4cfa982b89c939e9042c0ae61b85f67cb0c16010-1561729061-1800-Aczoq4Jbl5wSM9I0zglJxJMFs3dKdbBM719vpQdFExAsPlMOb6kwk14apLnN%2BgB%2BhJFdQiblnLZfadPmGrPePH5tqCP8AkHd7CTq5eJBt2qrnSFeuqPLVpKqB3SeXvPb%2B0nLRFdzryDl1zPNrAjR5q8%3D&jschl_vc=73a95f0920aedfa774bd6ccb7a364fe1&pass=1561729065.039-DfMElqA4Sh&jschl_answer=188.8201194935 HTTP/1.1" 302 159
2019-06-28 13:37:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:45 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:45 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.31 (KHTML, like Gecko) Chrome/26.0.1410.64 Safari/537.31
2019-06-28 13:37:47 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:47 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:51 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=f7405f3d9f809b516c34e3a1fcac59864acdc930-1561729067-1800-AWKD182WiBbYN%2B6WJljS4JU%2BXCNzLztXoXH6OcPxj2WzdpLSaAgTUT0MMSsyuXdghoQNwIuawMlHOa2nJO48k4HmfdBpiKgwtkPqceL0gHzPOw8q5MHLF%2FMCAs0qyfM%2F2DbrXneMc41dbLpiRvwB%2FCs%3D&jschl_vc=dfaf3a798fd86591c6244bfc1c0673b5&pass=1561729071.214-U7rYgw40Im&jschl_answer=30.1382710079 HTTP/1.1" 302 159
2019-06-28 13:37:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:51 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:51 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36
2019-06-28 13:37:53 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:53 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:57 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:57 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=0941231f2c13ada21775c76cfe9532638df3bfd0-1561729073-1800-AUz2VDfzZLK6TZijgbDP4twv4bzZNXlpkuUi%2BiuZPtj0O9%2B1Lq95gTsQLdBRInct%2FRlZuV9DAT5c8xxNTuDKCVvOfc1WdP02t%2BenTAjtVukHYJLt7N7v906CwFE%2BnEdxzClNpYR0PVKqOxJbCUl%2BVGM%3D&jschl_vc=c31ceae12737b7f8d3849a7519cbf592&pass=1561729077.416-WXHp5Oa35N&jschl_answer=29.3958205985 HTTP/1.1" 302 159
2019-06-28 13:37:57 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:57 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:57 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.0.12195 Safari/537.36
2019-06-28 13:38:00 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:00 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:04 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:04 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=e4ad955dd1e709af7e1c15fbeeaea8d27bf280a9-1561729080-1800-AbltC1PZlkVN6PVpmjjeyPLa%2FszGHkWYLS5riXHBC1Hqo1WH0MNDxmdrA%2FNJF0rAqSjX5RkeH0UffNscPwfKYwP1qpPblUO%2BLtlUV2C4QFOwzzZbb4uuqxPM74bb49C2AtslJur%2BiZmhlN6JvXjoaVE%3D&jschl_vc=b9a60ed19314322d3e2287ecfe5b1054&pass=1561729084.471-Y3cWMdnqoX&jschl_answer=18.0540262708 HTTP/1.1" 302 159
2019-06-28 13:38:04 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:04 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:38:04 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36
2019-06-28 13:38:05 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:05 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:09 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=0a8d8de860fec31c1d805a576e5cf7e2d20c8074-1561729085-1800-ARiDu3wUZbhikMYNmvEW%2Fd4seKSSM%2BHLBV%2BAgt8As11QA%2BTxPCAWMnSOvTwkzgavTg6VEflOlGuiaWd%2FJyscVJ%2F2v9eZhib4TEG4YIAeJBkcirSSmhapNKvxE7nnCiAuFsb2%2BP%2Fw%2FXR%2FlBA9r5SizB4%3D&jschl_vc=30fd63b0dd59834ba0b3270cb65c7d03&pass=1561729089.577-x1yFjyZ%2Fpi&jschl_answer=24.8685860979 HTTP/1.1" 302 159
2019-06-28 13:38:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:09 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:09 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36
2019-06-28 13:38:09 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:10 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=85530b0c28f3ac8e6e3c3b16daf05a444ab1bfc9-1561729090-1800-AUE1iWLXMSE8xIZm7MADqaTqd57nlhyY6J8bE4eegqpBC%2FkWt9uXRwkm1s0D0XqAdxmoTSaAOugw7C9X3DI8%2BZqMYKekma3ZP5HwqvgsWUzJxULdSLEdkZbm4JR83z%2By8yDqd4ShGSqxiJhW1%2FreNlk%3D&jschl_vc=72c5e0d13e9770bf787993f6ea71d601&pass=1561729094.025-xgvJANyGWD&jschl_answer=41.4750327543 HTTP/1.1" 302 159
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:14 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:14 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.65 Safari/537.36
2019-06-28 13:38:14 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:18 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=d3aa95679f34fd7a9e1757768a3c678d0b70ffce-1561729094-1800-AWJRHP4jbjd7C2K8B72hCNFte7lcfiEuMvh6WZritAepxaNY7d7dcL5sPB8hjeUTg05ll1jZSXUN0AggsB12sqkZRe4Rl2VeWUNBiyfMg0pyQIT5DiUsuTWoFwqE9JJlHWpkwCGs6c9M1N6ifExbU74%3D&jschl_vc=7ccee86e1c104657b0bd90857222ea54&pass=1561729098.842-Cw8h77Bf2%2F&jschl_answer=15.7131187942 HTTP/1.1" 302 159
2019-06-28 13:38:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:18 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:18 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36
2019-06-28 13:38:20 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:20 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:24 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:24 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4d1130977c3acb5c903653d99ef3bd4ca2c32ce7-1561729100-1800-AWY%2BReBVzmDZVKYn%2BreCJeFAhthwJn%2BgH6GpHPM1Dq9OD%2Bc2P6NrupIXGCm3lu8E%2B5vUB3kyQrrMjHWWsKg6MD%2BvhJ9TejUO1LUdNeR4kq06WDeboQtKQo0ofSrO%2Fy6Hb8p79vDyrwjBoYIhwpRCmkE%3D&jschl_vc=a545f1e0a2dcff2788db5030b6d7245f&pass=1561729104.088-GgWP9yM7Cc&jschl_answer=29.2001813802 HTTP/1.1" 302 159
2019-06-28 13:38:24 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:24 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:24 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.110 Safari/537.36
2019-06-28 13:38:26 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:30 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:30 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=d55c25e7892b72ad5191c1f1c243f0d616e4c88c-1561729106-1800-AcETQF4r6yKt66kbWhAZdr%2FvEJNXhwozFrzH9ByTMns4gR%2FXl7jzzkCQKUuHNO4DIlQgGNynR%2FUVpUo2m2tKU5dvhLgk4GSWXtWqQOXysvnA%2BKJOtiL%2Bx3L6QvaY1ssIVuljuhEWem1AhfVNjOrrkJ8%3D&jschl_vc=d238b09f4858dfd558cac149d8d3839b&pass=1561729110.353-agWW84ZzYi&jschl_answer=51.8396777015 HTTP/1.1" 302 159
2019-06-28 13:38:30 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:30 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:30 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.11 (KHTML, like Gecko) Chrome/23.0.1271.97 Safari/537.11
2019-06-28 13:38:33 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:33 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:37 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:37 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=39571afb7f5d0198391f207b93b3d03fb6f1d586-1561729113-1800-AeihAC1sUVp3Jg9jzshPYFqd2GaW5GDGJitGpKvcmXil3k7WP%2BEjGRPKRr8kBvmVbH5Gp0ei8WlYAg2ws2KNkWYzmHHI2lx1lb5uy6JyI1fQud81kNsm7A65qBjvPX8w6Vn9HL%2FS27tbp5X0nC37wNY%3D&jschl_vc=b03ddfcc5cac5b4739601ff7af7b3af8&pass=1561729117.537-z7jQIRGMYI&jschl_answer=19.5060681524 HTTP/1.1" 302 159
2019-06-28 13:38:37 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:37 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:37 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36
2019-06-28 13:38:40 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:40 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:44 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=c72235c969a9d46eec52cea0999895a72fd2b5fe-1561729120-1800-AT9W1KPq8hNfprO8rHjj6EyT3Tv7NlytGjoxwjpG6FHX4rm7%2Frx9WmTIXxiNikRvGl8mqvLCTYJp53S4CREm1GnojU%2FgLyXu96rG59o2HQBxv5qlrLfaCSymnuqjvmiuwLLmKP2a6SkO66U0OMYgdGA%3D&jschl_vc=f94e26858d5f8852d8a93fae89e49e48&pass=1561729124.961-orha5yY778&jschl_answer=23.9667435944 HTTP/1.1" 302 159
2019-06-28 13:38:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:45 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:45 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.112 Safari/537.36
2019-06-28 13:38:48 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:48 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4f52f5b512279547b942ed06436a8838c16d20da-1561729128-1800-AXN8zhDFCYKWZN%2FdMP9waTzMsaUBL1qbrWFHBitTbt%2F1E2hcXQzCY%2B2%2F6Dmd4S%2B8ZxNxqbAwl2eOX%2FsMHZnbKeZTb5kHiB3a7fVg9U3w8%2BOM5mmLkqGbSOViwr2%2FsQeX67zv0CLy9hB9ozdsDU4CJTo%3D&jschl_vc=265ce4ffd8afa6382595ac56d81f2f8a&pass=1561729132.438-XgJMQPIWv5&jschl_answer=53.3341269374 HTTP/1.1" 302 159
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:52 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:52 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.139 Safari/537.36
2019-06-28 13:38:52 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:56 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:56 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=5fe6908bbfef3b5491a9546f1b8bcb5c22ce9784-1561729132-1800-AQyvkyYXi0rcZKVIVYF2xsW0SuRw51zqMGxvdVqtqGXnh6P0L2koAdHyYO6doHLpKKR%2F%2Fv%2BCekbgqDfuCGei4%2FZR1UjWC1uZO7flYvzkT9aDPxHoooH7wgK%2BP%2FDE8EIFTP%2FwNoWM8D%2FGxYfO48MWc5c%3D&jschl_vc=4d5f441870d98d2006691ba80dac9ead&pass=1561729136.748-FP%2FcNr96fn&jschl_answer=37.6343702531 HTTP/1.1" 302 159
2019-06-28 13:38:56 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:56 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:56 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.103 Safari/537.36
2019-06-28 13:38:59 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:59 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:03 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:03 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=9505af6aac3aa099774b95d6e04dce7371710f9b-1561729139-1800-AUYpQqAah9dlID8yIQCuM5noAgOpRIn7QhxvDceuDpFmIYInAP1Egn%2FdJhRSXZRa6MXHDDRnvDHUYNVKYLSTXR4tRf0y3pgdxFPJnSR%2BZqU2wNI8bawzVneav0XfJ40NXSo2kAZjerd2DLILX02fgho%3D&jschl_vc=d1b3192e45a8b003eb6b65522a611e9b&pass=1561729143.1-fS2viqMXIX&jschl_answer=32.1527426317 HTTP/1.1" 302 159
2019-06-28 13:39:03 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:03 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:03 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.143 Safari/537.36
2019-06-28 13:39:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:39:06 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:06 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:10 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:10 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=1d7df4f3a92e6bc3e9558f26f7ac6d32c1f8eaeb-1561729146-1800-AbU05c2P8jgZ5c0Ud4OJh7fVEthVja7alI7vajIRrTSm56HSN3TbdqhymVoYR9wzrxOhHXja%2ByRuc4gmK9CZf0Rsd668ZGTT%2FRz1H453KPIYEbgPTHMTv9BCRyRhPdvu%2F9EsGiWcXIugAADmbajIIAQ%3D&jschl_vc=3a7a50fc61033a18799a3f276a0aa801&pass=1561729150.373-zRm1Gu15ny&jschl_answer=58.0302679040 HTTP/1.1" 302 159
2019-06-28 13:39:10 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=82285f46479a81271b492bd5fb468a4a9e065132-1561729150-1800-Ac2POVqZe%2FP3TwSf1ZZKWomxDfc%2Fydcn6GPqnei2hmia5qZhOlgF2eNIW1chcUmaJYLz1jpzJDQMd0gY3Fnm68p2fDNb2Ed5LGVP5H9C%2F0hw2HKsBXbUsk44nK8UfMFjsK3iGOVXkgQxR9vBGlIyqDo%3D&jschl_vc=5d3a02b619edd84a133822a12cf55e81&pass=1561729154.464-quhg9mPxLx&jschl_answer=10.5693723306 HTTP/1.1" 302 159
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:14 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:14 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.94 Safari/537.36
2019-06-28 13:39:14 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:18 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=e3d9250d763a6a0053f7f0d601ab4bbe23c27ec9-1561729154-1800-AWU6C08GThQWcMR3gDvL90I6gIBqAVQlk98wdU6pUuiRwnQmZCk8Xu29Js0h2v8nK9nY%2BVc6UuSnbuTitwvD%2Bd1c9gU2nWfMRW%2BbrndZjNnUE6mZeF55MP5F45cNlvWKVv1R0zTW4HkpM7hZwSAu9Hs%3D&jschl_vc=cb2fc430b1d41bac9479ddc20d6195f9&pass=1561729158.747-%2F%2Fd%2B9ayaz6&jschl_answer=38.7679011102 HTTP/1.1" 302 159
2019-06-28 13:39:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:18 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:18 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.71 Safari/537.36
2019-06-28 13:39:22 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:22 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:26 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=88bb21e92ecbae758ab0c18379dc2745f88f48ae-1561729162-1800-Afl9P4Ih9mdOvlY2S%2BErgeWQlbyx5E94vTHheFsF%2FAl6kzw5LLZnv83%2Bfrtk2N49OwPJ3Dnsp0c5YQ1EpT0r6W%2FBxwnRX4JRQ9gNsKPoqEpLcmXclsvbCJCtIDBqLck%2Fow2wRdMj5VphPxJO8VJS9MI%3D&jschl_vc=742fb69892d3bf82b7f5168c485a1168&pass=1561729166.177-d8BYMTg3we&jschl_answer=41.1061949959 HTTP/1.1" 302 159
2019-06-28 13:39:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:26 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:26 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.91 Safari/537.36
2019-06-28 13:39:28 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:28 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:32 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:32 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=dae24463608a20fa5b7de7495e1e8b1dcbf3d8eb-1561729168-1800-Aal74RkXTv89dP26sNAqKDg0u5X0Zm4IIzUgoi%2BqhyiO7P0m%2BmveaYstJqNOwU3e20zlC9eoz24mSKsOq%2FyqCjd%2FgnGokq92bCRkqLfEw3XdRwvZSL4nLtxcVr3YvRyzenP8h134dErz8Ya0yfn9Dfk%3D&jschl_vc=617329c71f418a5c7528211dfea4c18a&pass=1561729172.585-QC6rev41wr&jschl_answer=18.5342281630 HTTP/1.1" 302 159
2019-06-28 13:39:32 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=c7fbe45ce276aa383ff4b0f30911944da0612ae4-1561729172-1800-AeYlPkX64mrsbkrCs6E53LajMiVWtPR4wVm5T1XXP0QYEhzaqNizNqvYkYgyZOcpX%2Falb3yP%2Ffyoghcdf97%2BAOWCNbJ83C5AjI2uYxxdtreRQnxBnHPBS8YvjI3Q3M4SN550hgH4bfVob59wBViQiOc%3D&jschl_vc=726483d06964629794b303f6d1450c62&pass=1561729176.69-qrWr8FCN5X&jschl_answer=4.4081463849 HTTP/1.1" 302 159
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:36 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:36 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.116 Safari/537.36
2019-06-28 13:39:36 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:40 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=37cf692b516d4a5f7432f01a5d315c0b66341758-1561729176-1800-AVgFQgc378RcDbwrW8akmVl53nitAUB30MZDqcfXSBVfOY3kQiM237dglhk9fxtrSFOf4NH0yPFQ7vtYq5pe2RylvTnCTEqN0DA0YkYjmaRMKBpoaq5l5OKivP5kvGqY3ISMMdSQGesmBwbXW7PIpqs%3D&jschl_vc=ae84e50399fcbe5f9c34bce2945754ca&pass=1561729180.963-gcl69Tz71M&jschl_answer=25.9572898431 HTTP/1.1" 302 159
2019-06-28 13:39:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:41 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:41 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.181 Safari/537.36
2019-06-28 13:39:43 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:44 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:48 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:48 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=72b327cdeaa46a4d13fc8bde8e5b82d612a17786-1561729184-1800-AWmvfWtMESH%2BxAkWI6r5i26sSvGDb1UaCxmLHIS75jn2oyCscTbnAwQktO%2Fb6k1l1TWI36qPetpOuzDDvB94q%2FFtbkc9goBjUrqj8Q%2BkFt0jTAUssie5hZmTgmcXlOZnlgb59qLxHoOGZ2KAl8Uyg%2Bs%3D&jschl_vc=ce4739e70cefee0cc5214fbe67d6530c&pass=1561729188.035-u8GzCbDiqB&jschl_answer=20.0457175425 HTTP/1.1" 302 159
2019-06-28 13:39:48 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:48 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:48 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36
2019-06-28 13:39:50 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:50 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:54 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:54 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=ca94dfd9b5e2b100975194437c943886976bf4e4-1561729190-1800-ATIrxX8li26q8zeCeV9kd3eC%2BXBAIkW0SMlTO%2BCigbO%2FwJUoym9YtNXlNo%2Fw0DFlikgMvlfBAhCpDFCw3G4XpyfTP6wu49rwHd6o5SKNac1eHO2O5JhjDaSPy9KXrnvUTCJ5o0wUZF%2BxIuGIL9To60c%3D&jschl_vc=74568c860606c75fe4f09992703163a9&pass=1561729194.366-BhRHSD9OFL&jschl_answer=37.3964025711 HTTP/1.1" 302 159
2019-06-28 13:39:54 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:54 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:54 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.110 Safari/537.36
2019-06-28 13:39:57 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:57 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:01 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:01 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=f04e1a951e62340cff3d28edfe122c0d40dc8b95-1561729197-1800-AUZwOGyVh9zxe298%2Bv5kTMOAoxHKN%2F%2FQBWleQmBPTViFcNhmxV9S4FXKg4afkmqF3a%2B3ScyGsgxoTULWdd%2Fe7X5LuZSYdqAUxH4M8OEEx%2Btlc3aMX%2BQwLEmeeBTMDOwJMBvFBj7MdPvMEfYzPpycLow%3D&jschl_vc=2dfa98ca32efaa162ba96d530dfeb67e&pass=1561729201.143-8ZKqFURBd8&jschl_answer=13.1052997179 HTTP/1.1" 302 159
2019-06-28 13:40:01 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:01 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:01 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.89 Safari/537.36
2019-06-28 13:40:02 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:02 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:06 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:06 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=2bcdf5c25f0ffb2dc90d39b60fd1b85299a24c55-1561729202-1800-ASVWmd0Kj0mxUtyujJf2Ay9ZnVa7lkDOCIjRfJZUjvmUi5Pya1E3FDCVyvzo%2F7q9NG1AtGUikbHFSv0Ob7IsZR3o05yd%2F5cEc%2FqpVw1vGlrnBXTiaYtomwEn0O%2FgludY5ZIOajqVqjBM5Cvr0UeBt9E%3D&jschl_vc=0287f028ff67aaaea71f01ab45cc52d4&pass=1561729206.393-WvhTQZkcI6&jschl_answer=16.8363210122 HTTP/1.1" 302 159
2019-06-28 13:40:06 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:06 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:40:06 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 5.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.90 Safari/537.36
2019-06-28 13:40:07 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:07 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:11 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=8694ecf7d810e6167627a4597f45630dd777ef31-1561729207-1800-AZfSVLqQU713%2FvO9tiVaCZ4bxwPqJotcYKCpSRE80ZDhABXgulLpD70i5qJTcZx5AzN7ssZpc9eIHECzzUklfnpE9mXEaBGcRwjj5lzkTnJNsWPWShSl6%2BYmMb99psYMCduyzcyh2j6kKu%2B5U6KeQjc%3D&jschl_vc=d6684ae94556f82529e8063c40f5de09&pass=1561729211.492-bqhhru0zXL&jschl_answer=13.2709801839 HTTP/1.1" 302 159
2019-06-28 13:40:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:11 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:11 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.96 Safari/537.36
2019-06-28 13:40:12 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:12 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:16 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:16 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=82890c8a8c20b58260b8b72199be47acd9bfdbed-1561729212-1800-AZS8MvT%2B5gE7Qc7DT9XJ8JNtwyS1GMbBapdhGKirW9yn0jbbFpG8lFjSsGIUwDhB5LaiNUeOTolFbta7MKQF3wvcdlFcHKSbc%2Fr624Zn4uwsQZPzVxV69FPyzoXyNUdKFmw5Q5%2FHCps0BaVk8jijz0Y%3D&jschl_vc=b46250cc74d9b0bf88bb2cba17d1799b&pass=1561729216.262-GPH78zpVCG&jschl_answer=20.3275264959 HTTP/1.1" 302 159
2019-06-28 13:40:16 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:16 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:16 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.22 (KHTML, like Gecko) Chrome/25.0.1364.152 Safari/537.22
2019-06-28 13:40:18 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:19 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:23 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=59f926244111f6bbc2f9bb1c41a762a05270bad0-1561729219-1800-AWsAd7AldQEb0SR0sN%2BNtv820gbpeNS1C%2F9I8nStRQGVB02TY5Ubt8C9WHIw34eCeAl%2BSlbWxfbfBKQSNx%2Fo7u7tqAhtoYYtwI0%2Bqaotl5Nlr1JoN3J3Ttmlw8kUtiTyGEkDoHskWtt%2B4vw5IzxxARw%3D&jschl_vc=34d2f47a8cc7e391334282e62c330abf&pass=1561729223.033-nd9lpv%2BqRP&jschl_answer=18.1314069441 HTTP/1.1" 302 159
2019-06-28 13:40:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:23 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:23 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2019-06-28 13:40:25 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:25 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:29 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=d79c79a0fc26283a61ad54760fd5abba45e65813-1561729225-1800-AQe%2F1OQpo%2BKizm2WETQbZcEY8uIumGkrUCqpWXdQH4umKPqHZRHaNePnf5bBej%2BByF7E1bYIjdCQRGEym2l4UybqsHaUijb4PmFvVSO0dCIRTVjuQJ0eoIbz%2BYmaztDoFSpkcLBvRCf4CELpCAfY11c%3D&jschl_vc=cbfc1e06e4da01421f1478c1ea4fe526&pass=1561729229.214-QyuBpV2sW8&jschl_answer=49.5715499069 HTTP/1.1" 302 159
2019-06-28 13:40:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:29 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:29 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.62 Safari/537.36
2019-06-28 13:40:32 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:32 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:36 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=646ec89dc3254d92e4f0b6720975b97234a51a49-1561729232-1800-AV6Uaf%2FK1xTet1oB7PN%2Bw%2FjsBJliJDF2QQk31EPkMXhEmYXvMPe%2FQief1O8bUauw8RAx2HTwEYxFKFSudEdqrEQ8YHQhZSFTN3s4Jch%2FxOnESqb9jwn5TZTWZww%2ByWRtcqqm19glGwIj2a6tsTrkohM%3D&jschl_vc=844e0c03165e7234f27a2a0eff42d709&pass=1561729236.658-qtLuMvQXVq&jschl_answer=31.3028518276 HTTP/1.1" 302 159
2019-06-28 13:40:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:36 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:36 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36
2019-06-28 13:40:38 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:38 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:42 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:42 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=0909e7dbe565e20779c295ff08f09ce33036585a-1561729238-1800-ARJ2t4KsqhLf7MB5Dw8DQWyRkTqM8TuJKDvnF7rpx0q9RiGlYFUBmAGxZWN8qBT98EbuUUceOhyreQ6rwK3Njdgzmts8crMScUbOko6gv6bb0lYJxYMtp5SGHQaSxabvyD5x8lpZH9q1s8FVxTaNx68%3D&jschl_vc=adcf3e02624085a0c79307555603c65e&pass=1561729242.77-kNe7%2BFKDDb&jschl_answer=17.7843064899 HTTP/1.1" 302 159
2019-06-28 13:40:42 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:42 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:42 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36
2019-06-28 13:40:44 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:44 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:48 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:49 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=f13321f481f41ec36dea9db894c42f204936a9cb-1561729244-1800-AenBAUhYSzjfRjXLbwv2t%2FbqJroRnVTRSmgbma0KH1xcaazvHhtLBxaEEzHuAZeD6AG%2BLecXg6SiVCR7quWQr1fRzEmKVpPg6NaC8LvqJ3hPierATrzPS8e0xtzL73QrzTzgFvj%2FGl0QDfIjNyxOng8%3D&jschl_vc=53b4b2f23bf6cc74e2274342f756cf54&pass=1561729248.931-SJ80wLJgnX&jschl_answer=37.3156887326 HTTP/1.1" 302 159
2019-06-28 13:40:49 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:49 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:49 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 5.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36
2019-06-28 13:40:51 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:55 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:55 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4c7ba593c84f8afa9abd1867eb98cc11357f5f54-1561729251-1800-AQjq4kbuYN%2Fo0yJbp0h%2FybS%2BzJ97KDyU4IRlqfXUaRDqlyDoMqAXO0t17kS4VvXcp%2Fk%2BHyesoHgvIPGeNhw9LP1zc%2FLDAf%2BhSGRePtUEicq8vBnnBJ6xeYbfjgk6%2FzW8k3zHKkxROjW8bzom%2BrLAMEg%3D&jschl_vc=6f56330ee9d0e2a02bee026b08da4b6d&pass=1561729255.706-EfAdnBeW0p&jschl_answer=60.0356755982 HTTP/1.1" 302 159
2019-06-28 13:40:55 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:55 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:55 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36
2019-06-28 13:40:58 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:58 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:02 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:02 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=73b98fda08e7e8e9d8a8926d9fbfbfd4f6c3d699-1561729258-1800-ASIr9D2jYRxIX%2BA6Q0TGc2TbqxsE%2FGJd10AemU9lxfs875MzO4p2%2FvuBrvxo76CKmpj%2FuIOgW9RBAodFPfgtMSUfXMlYXKVbVnJmWKI%2FJLW%2FB2FFVabLc77N7%2B94Cw%2FGiiGCn1q7UK01jYgYUor%2Fwak%3D&jschl_vc=1bc17789bd66580b30b820d06c2cc480&pass=1561729262.28-ZbvcxZUu46&jschl_answer=9.5416749038 HTTP/1.1" 302 159
2019-06-28 13:41:02 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:02 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:02 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36
2019-06-28 13:41:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:41:05 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:05 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:09 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=02852b17021b0517108ab07f6954dc9c1cc1302f-1561729265-1800-AYa7q%2FozsGs9sFfI0pAJMPak3OXlXn48cAe%2BGPLnoshr71Xt4fGRoijUWBITvnaCJ%2FLqMiwcvDMMoAkPQk2EsjP1WdywYVXOshi7bIsygKOf72GCm7uj9GeM63bYA8YmaOn5CumAU5fj1enUip%2FeST0%3D&jschl_vc=f8babecb55200d7ff7453be5c2aa7190&pass=1561729269.791-mnmBe8GFWO&jschl_answer=76.9595640044 HTTP/1.1" 302 159
2019-06-28 13:41:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:09 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:10 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.75 Safari/537.36
2019-06-28 13:41:11 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:15 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:15 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=59464d590d27d58164e5bee3f709f111f1b1b036-1561729271-1800-AftDsHCoT8caNMUDTGvRg8UScSYyi5%2FxCZ9cgHtwAlkAnDURn5C8j0px5SQ7V%2FlhgqlkDm1OeXlCvP57KGUVUHBPsMeClWiCA6yoPOZhk2T9qrTOClXUST4viipmfjlPbik%2F7M5bu%2F%2FPt2cQfRVOtNw%3D&jschl_vc=26280c6f1e795d1a9cd68d99dfaccb39&pass=1561729275.107-8o57iK%2BMXk&jschl_answer=31.0425280168 HTTP/1.1" 302 159
2019-06-28 13:41:15 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:15 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:15 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.99 Safari/537.36
2019-06-28 13:41:17 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:17 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:21 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=2000359e4ee2ca0069e4ea4c6713dc346738472f-1561729277-1800-AS0QXSdrossSz%2B2V9HQnrkJ2sUnxDClKkMrBFxFX4mpL7gcAIR9Vz5%2Bsc3%2BZWUq%2FEOVrd6Y%2FB6T8AFdLFj7T0ypke4FB0Uv9DPDEmt4N160ElzVMsahCo7axoPiiFbDWeHbav7AW%2FTI5GiU80gkRz%2Bs%3D&jschl_vc=f1e546368f79dca4346b6b29877b0c6a&pass=1561729281.186-agsB8l63Uq&jschl_answer=16.5196798413 HTTP/1.1" 302 159
2019-06-28 13:41:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:21 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:21 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.62 Safari/537.36
2019-06-28 13:41:23 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:27 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:27 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=025247b886b153e7a4f07e14461f49ee426492d5-1561729283-1800-AZ8FSdnbblwZROtv2%2BXW5ThVaPcHxdGkUzaHQIMiDHDgjs8h%2B7eq6eu9TWj2XHBl1TNt%2B7v2bkkXua1QYNJS9WJqLOpL2vlra85M6kdxCA2P0kXmt10KFC7r9RdPyHKhAf6Olm7%2Fo4w%2Fzfta1HfvTRs%3D&jschl_vc=899e17cb5d4143898412664f091ad16f&pass=1561729287.88-T%2BIxxUJKBa&jschl_answer=18.4756087604 HTTP/1.1" 302 159
2019-06-28 13:41:28 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:28 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:28 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 5.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.63 Safari/537.36
2019-06-28 13:41:30 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:30 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:34 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:34 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=a8bfda20cdf8e8f7fd2c95e81d81f8e3c05751ab-1561729290-1800-AfayeleOweHYaey52aZ0w18daK%2BhktIIsBCavnYp%2FLXm5iGpuO4Xs5mzukG7ULD68jcN5XvC39YpLN3srfw5CkmbXGa4a9N5IZfit%2F9igEBw09J1hSzzDq6ikRv99deUfOhqkva%2BiFe5fsl367xIF14%3D&jschl_vc=9932990675ce85df2f49517a21d91f1e&pass=1561729294.575-pEk%2BeGdOit&jschl_answer=27.3765760581 HTTP/1.1" 302 159
2019-06-28 13:41:34 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:34 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:34 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36
2019-06-28 13:41:36 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:40 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=2b42b688df31a4464e30058674d96086674022c7-1561729296-1800-ATSfn%2FBigdW77E0VhGg2EJ%2B8VtZE05y%2B3bsLTqMdhw47gr5WluOwCtAaoUWUoZMx6hFezE%2BQs9rD8Y%2B%2Bol2KidDHPL9F2zTOcsLj3jc08uhsg%2BT7eOber6KzQvq0Zpk0dpoHlnk8FqEFQ8YwUojd0ok%3D&jschl_vc=bcf871de13fe02801cf27d29cd5b8848&pass=1561729300.974-fY62gxCThz&jschl_answer=20.6013785563 HTTP/1.1" 302 159
2019-06-28 13:41:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:41 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:41 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.99 Safari/537.36
2019-06-28 13:41:41 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:45 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=3e57aec0cd1f1ddcb250663a6ec05c0deced50e6-1561729301-1800-AQqDS6i0lv%2BBYGR4%2B4nuj%2FGVk2SZ4mEfpRn0hbQQarDSoLzXwWViSzTFp%2F%2Bqx%2FuDpe73o54hz0wzSpw%2FBlrTrYYtO8pIw3yPOQha0kVOysxGKd%2FqMTWtdr9cBFSMVS97qLgH3CAYMDVKfdKjNEewVFI%3D&jschl_vc=30566b9f203f9a6c65eb49a5b7f54722&pass=1561729305.914-bGkdxvWn%2B4&jschl_answer=24.1839541908 HTTP/1.1" 302 159
2019-06-28 13:41:46 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:46 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:46 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.99 Safari/537.36
2019-06-28 13:41:47 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:47 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:51 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=66332a1704ddc03c2271dd78902b42b3857a3b3e-1561729307-1800-ARhOgilvkrAc9aGMwXw2dLHOgzadGtWh8a80zMmZgLkxBu2cq1HG1fpqhHiaDZY%2FtEyyxmMLLOKLg1sQ154pDvQSjz62fh46JQzAQwE3dJI7g0iAYbK49P%2BmfLhIJEWpkclp%2FQG9iBlA%2Fl7rylauJZ4%3D&jschl_vc=d7d423e24e2851817ee139456884186d&pass=1561729311.813-h6ZmIcCJi%2B&jschl_answer=53.7055097650 HTTP/1.1" 302 159
2019-06-28 13:41:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:55 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:55 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=b9c6787b1e0966b79b0332e73ce2ae5e164d9276-1561729311-1800-AaZJpX77%2FGKKimr7JjIPddIWwA21W5srkSwfQMJ6DE%2FZ9qOOEERhnGzV30mFF9jOeqo6Ihwd7gnU7berE5okJgxNGiFtqBKczKmHZ%2Fu84Hlbz0k5LR7dvjKyMcYfthu2nL3Gpr5UiWlh15pVSgodReQ%3D&jschl_vc=18db7eb797e7795bec40a1f4a3e86191&pass=1561729315.905-7HGwfAHbfD&jschl_answer=15.7170149449 HTTP/1.1" 302 159
2019-06-28 13:41:56 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:56 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:56 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.79 Safari/537.36
2019-06-28 13:41:56 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:56 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None

clemfromspace · 2019-06-29T11:05:18Z

@guillaumedsde Will need to investigate this further, but it might be related to your COOKIES_ENABLED=False in your settings.
For the middleware to work, you need to activate the cookies: https://github.com/clemfromspace/scrapy-cloudflare-middleware/blob/master/scrapy_cloudflare_middleware/middlewares.py#L45

guillaumedsde · 2019-07-01T13:37:39Z

Hi, with COOKIES_ENABLED=True the issue persists:

2019-07-01 13:28:51 [scrapy.utils.log] INFO: Scrapy 1.6.0 started (bot: crawler)
2019-07-01 13:28:51 [scrapy.utils.log] INFO: Versions: lxml 4.3.4.0, libxml2 2.9.9, cssselect 1.0.3, parsel 1.5.1, w3lib 1.20.0, Twisted 19.2.1, Python 3.7.3 (default, May 11 2019, 02:00:41) - [GCC 8.3.0], pyOpenSSL 19.0.0 (OpenSSL 1.1.1b  26 Feb 2019), cryptography 2.7, Platform Linux-5.1.15-arch1-1-ARCH-x86_64-with
2019-07-01 13:28:51 [scrapy.crawler] INFO: Overridden settings: {'AJAXCRAWL_ENABLED': True, 'AUTOTHROTTLE_ENABLED': True, 'AUTOTHROTTLE_MAX_DELAY': 10, 'AUTOTHROTTLE_TARGET_CONCURRENCY': 15.0, 'BOT_NAME': 'crawler', 'CONCURRENT_REQUESTS': 100, 'CONCURRENT_REQUESTS_PER_IP': 30, 'DEPTH_LIMIT': 2, 'DEPTH_PRIORITY': 1, 'DOWNLOAD_TIMEOUT': 20, 'LOG_FILE': 'logs/default/recursive_spider/29946c689c0411e9bb2954e1ad4c5f56.log', 'NEWSPIDER_MODULE': 'crawler.spiders', 'REACTOR_THREADPOOL_MAXSIZE': 30, 'REDIRECT_MAX_TIMES': 10, 'RETRY_ENABLED': False, 'SCHEDULER_DISK_QUEUE': 'scrapy.squeues.PickleFifoDiskQueue', 'SCHEDULER_MEMORY_QUEUE': 'scrapy.squeues.FifoMemoryQueue', 'SPIDER_MODULES': ['crawler.spiders'], 'TELNETCONSOLE_ENABLED': False}
2019-07-01 13:28:51 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.throttle.AutoThrottle']
2019-07-01 13:28:51 [recursive_spider] DEBUG: RecursiveSpider's start url was overridden with https://www.torrentday.com/
2019-07-01 13:28:52 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Android
2019-07-01 13:28:52 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:52 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:52 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV13, Brand: Sony, Model: BDV13
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV14, Brand: Sony, Model: BDV14
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: LG Web0S SmartTV, Brand: LG, Model: Web0S SmartTV
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV11, Brand: Sony, Model: BDV11
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: SMTBot
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: WebKit Nightly
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Robot
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Zune
2019-07-01 13:28:57 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy_cloudflare_middleware.middlewares.CloudFlareMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy_user_agents.middlewares.RandomUserAgentMiddleware',
 'scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2019-07-01 13:28:57 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawler.middlewares.StartRequestsMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware']
2019-07-01 13:28:57 [scrapy.middleware] INFO: Enabled item pipelines:
['crawler.pipelines.scrapy_mongodb.MongoDBPipeline']
2019-07-01 13:28:57 [scrapy.core.engine] INFO: Spider opened
2019-07-01 13:28:57 [scrapy-mongodb-pipeline] INFO: Connected to MongoDB mongodb://user:[email protected]:27017, using "scrapy"
2019-07-01 13:28:57 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-07-01 13:28:57 [recursive_spider] INFO: Spider opened: recursive_spider
2019-07-01 13:28:57 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.59 Safari/537.36
2019-07-01 13:28:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://www.torrentday.com/login.php> from <GET https://www.torrentday.com/>
2019-07-01 13:28:57 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
2019-07-01 13:29:04 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:04 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:08 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=defe609459a99d94b2b73ecc0cc9681c2b92eec4-1561987744-1800-ASeJ6sY5UrDWCJVHGDwv54soYNyci84VCA5XsvoG5UCNoDoRffjgqcKmlPeD0NXQPyZQLIpqPno7gUdYBn6QoM9WGuVD7oUzMhVyrn3fHTrqZROB%2B11S8zgzeEPh%2FFQZKGcppnHQre50DaaopVAYaxg%3D&jschl_vc=6b0e367810fd325219eb35428bd84cfe&pass=1561987748.932-jDOSdOsxGw&jschl_answer=31.6275217492 HTTP/1.1" 302 159
2019-07-01 13:29:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:09 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:09 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36
2019-07-01 13:29:11 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:15 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:15 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=11ae571e886b62bac46356fa56e35ce08f72affd-1561987751-1800-AZbcx%2FSfRhRzESpA8xPc5h3OawiOUHSii%2FY5van%2FNMeFfhJq5aWqvD%2BxpdJoRO%2BG9l6%2FU6ESli4OyiPi3woDcamXYGB8AqVC6bPgngiGXGH9R7HYCaOpBjxKQouIVoVH6xKrWvdflOw2qaEJ45ph%2FgA%3D&jschl_vc=e62cfd15f0322698e99f5aca3b221611&pass=1561987755.696-cOXdMYHJpC&jschl_answer=22.0756028387 HTTP/1.1" 302 159
2019-07-01 13:29:15 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:15 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:15 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36
2019-07-01 13:29:18 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:22 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=06a7e6490ffd6481e1d6bf3990c26fed4b723aa6-1561987758-1800-AXLkIwEwigFE7pSsx2%2Bt4Gc2srZgmjlKgL40%2Bmne79a%2B%2FD%2F%2FsMWqz83y1n%2BjI5M105skjKa3dHb0SsNQvCTO%2FLSnTuztEY8MxKvs21ehCeUJT2CshtP%2Fnbc6%2Fr6bPfaQ4tbtxEgDocESpqujdTEs2TQ%3D&jschl_vc=2c0312cbe6829342de05ef29db34dfc8&pass=1561987762.938-HKs9pWTVAg&jschl_answer=17.4684630839 HTTP/1.1" 302 159
2019-07-01 13:29:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:23 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:23 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
2019-07-01 13:29:25 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:25 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:29 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=260cde113faeb5e99f1bcef4100108e92741c026-1561987765-1800-AYDOFVB1larxHhFhYmuw3EWcUxiZe13u8Nn2iqmv9w4h%2B99qww3WOiXByyA88ffaIlkL9dcoa%2Bs2MzgljtZrhvmFMzaew%2BqYaCqzuEM9VvyMnOTMKrCTbCiSLXPv9lsjyBJLW9r59G1kqniFkQ2unlQ%3D&jschl_vc=7a0c06d4c9d7cb8d2947cbc1fa0dc642&pass=1561987769.675-U4EG9r5%2FRG&jschl_answer=96.8751686634 HTTP/1.1" 302 159
2019-07-01 13:29:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:29 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:29 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.116 Safari/537.36
2019-07-01 13:29:32 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:32 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:36 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=ae8b616be9fb44d972564794560367f32a72f1e8-1561987772-1800-AcfdiuaftuAr8G5RQpvxsgxrP61yd9s7NtBLNq9HnQza0EwJdD04e3uJveHl12AvqBQ9D0J%2FDLnZUxXQT%2BQzEqZqZWldAkgJdLt3%2FABzVo8GzYLNBJysuzqskpEzb773kxAYW5CtcdgU1%2BzfmhMOKtI%3D&jschl_vc=a4bf829fb98595d749698f21b71c5271&pass=1561987776.643-s6K8uIzFvH&jschl_answer=24.3652839584 HTTP/1.1" 302 159
2019-07-01 13:29:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:36 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:36 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.75 Safari/537.36
2019-07-01 13:29:37 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:37 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:41 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=7259f5338dc2dd8252234d8cc5a3cd9ad993cd5d-1561987777-1800-AbRRJMcE1GCRHeqUxZXivC7NgovldtEMjIS7NhBOvSNpIC4wBNdE3f5d%2B1N%2FFvjFmQCDUNfbU0DtZoEosodYK%2BjcjIkpXgBe%2B9bk7Bo%2BYHar4ul%2BwNxAyXm1cix7wdJUKHoO%2BmpCLb2j12oCEd1lnsQ%3D&jschl_vc=cb9752f8398cb38d3a1d65dc09167dba&pass=1561987781.623-XMmJRowbYz&jschl_answer=28.3313622992 HTTP/1.1" 302 159
2019-07-01 13:29:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:41 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:41 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.81 Safari/537.36
2019-07-01 13:29:42 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:42 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:46 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com

vgarleanu · 2019-07-24T21:18:02Z

Hi, I am experiencing the same exact issue with cookies enabled when trying to scrape a site behind cloudflare. Has anyone found a fix yet?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

cloudflare challenge 503 continue to occur after solving the first one #5

cloudflare challenge 503 continue to occur after solving the first one #5

partyspy commented Mar 28, 2019

guillaumedsde commented Jun 28, 2019

clemfromspace commented Jun 29, 2019

guillaumedsde commented Jul 1, 2019

vgarleanu commented Jul 24, 2019

cloudflare challenge 503 continue to occur after solving the first one #5

cloudflare challenge 503 continue to occur after solving the first one #5

Comments

partyspy commented Mar 28, 2019

guillaumedsde commented Jun 28, 2019

clemfromspace commented Jun 29, 2019

guillaumedsde commented Jul 1, 2019

vgarleanu commented Jul 24, 2019