New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature: Add some new crawlers for popular web pages #41

Open

sajithaliyanage opened this issue Oct 5, 2020 · 1 comment

Labels

Member

sajithaliyanage commented Oct 5, 2020

Add crawl spiders for the following or popular websites.

Youtube
Quora
Facebook
Reddit
GitHub

Currently implemented spiders can be found in - https://github.com/leopardslab/CrawlerX/tree/master/scrapy_app/scrapy_app/spiders

sajithaliyanage added the Hacktoberfest label

Contributor

ffalpha commented Feb 16, 2021

@sajithaliyanage Is this issue still opened? I like to work on this

This was referenced Apr 1, 2021

Add Reddit URL crawling spider #79

Merged

Adding github_trending spider to scrapy app #81

Merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment