Changes

Moroccan Parliament Web Crawler (view source)

576 bytes added , 13:01, 14 October 2016

no edit summary

===~~Example~~ Web Driver Code===

#General Bill Download

#close browser

driver.quit()

===Web Crawler Code===

I used a python library called [https://scrapy.org/ Scrapy].

Once downloaded and installed properly, a new project is created by typing into the command line:

scrapy startproject projectname

This will create a project for you with all of the necessary components you need.

From this window, scrapy provides a helpful tool to test any web scraping lines of code you would like to try out.

Enter

scrapy shell 'webaddress'

From here, you can type selector statements and print them to see if your statements are getting the data you desire.

===Further Inquiries===

479

edits