Skip to content

A Web crawler sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing.

Notifications You must be signed in to change notification settings

DataCrusade1999/Spider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Spider

This is more of a Personal Project I've Scrapped all the movies on Yify which have the IMDB Rating >= 8 and put all those movies in Movies.txt file.

A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing.

If you want to run it yourself then clone the repo then cd Movies and find the file eightRated.py which should be in the spiders directory.

Working

Architecture Diagram For more info

About

A Web crawler sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages