GitHub - AnubhavUjjawal/distributed-web-crawler: This is a distributed web crawler made from scratch in python. It has not been fully completed till now.

AnubhavUjjawal / distributed-web-crawler Public

This is a distributed web crawler made from scratch in python. It has not been fully completed till now.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
.vscode		.vscode
__pycache__		__pycache__
.gitignore		.gitignore
crawler.pdf		crawler.pdf
crawler.py		crawler.py
frontier.py		frontier.py
init_test_workers.sh		init_test_workers.sh
plan.txt		plan.txt
requirements.txt		requirements.txt
stop_test_workers.sh		stop_test_workers.sh
tests.py		tests.py
to-do.txt		to-do.txt
urls.txt		urls.txt