niksAhlawat / scrapy_ Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

A simple minimalistic Web Scraping project Using Scrapy and storing the scrapped data to MongoDB Atlas by creating pipelines using pymongo.

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
queries		queries
scrapy_		scrapy_
README.md		README.md
example.json		example.json
scrapy.cfg		scrapy.cfg

Repository files navigation

scrapy_

Scrapy_ is a simple Web Scraping project using Scrapy as a tool.

We are also storing scrapped data into MongoDB Database hosted at MongoDB Atlas.

We have used pymongo for creating a pipeline between our project and MongoDB Database.

Feel free to contribute to this project to make it more optimised and efficient.

About

A simple minimalistic Web Scraping project Using Scrapy and storing the scrapped data to MongoDB Atlas by creating pipelines using pymongo.

python pymongo scrapy-spider mongodb-atlas webscraping-data

Report repository

Releases

No releases published

Packages

No packages published

Languages