Scrapy Crawling - Scrapy

What is Scrapy Crawling?


To execute your spider, run below command within your first_scrapy directory

In the above code first is the name of the spider.

Once the spider crawls, below output will be displayed

In the above output, for each URL there is a log line which (referer: None) defines that the URLs are start URLs and they will not have referrers. Next, you can observe that two new files named Books.html and Resources.html are created in your first_scrapy directory.

All rights reserved © 2020 Wisdom IT Services India Pvt. Ltd Protection Status

Scrapy Topics