Section 2 - installSetupScrapy

01

choose to obey Robots.txt

In this section create the spider with this url 

https://books.toscrape.com/
placeholder image

02

Make a spider, in the spiders directory with the command, 

scrapy genspider bookspider https://books.toscrape.com/

provide name for spider alone with baseUrl

This is the page the spider will base it self in https://books.toscrape.com/

03

Run the scrapy shell or ipython shell 

scrapy shell

I can't get ipython to work, just use scrapy shell, you'll need to install ipython with,

see lesson 2 in the section

04

Run the fetch() command in one of the shells to get the response. supply this url or any base you want. 

https://books.toscrape.com/
fetch('https://books.toscrape.com/')
response