-
install scrapy if required
-
go to amazon
-
scrapy crawl amazonURL -o items.json
-
json of all products inside shoesAsins is stored in items.json
To scrape up product ids, do scrapy crawl amazon
It stores all product ids inside amazonURLs file in base amazon folder