A fun web scraper written in python to scrap car information from this URL:

http://www.cars-data.com/en/sport-cars.html

Main screen

This is how the main screen looks like:

I scrape all the other links from that page

And from each page, I scrape all car names and information.

Voila!

Then I make some cool graphs:

Code

Raw data

The scraped data is present in carInfo.csv

Scraping files

• The scraping and generating the csv is done through carinfo_scraper.ipynb script, which I have presented in the form of a Jupyter notebook.

• The main function gatherInfoFromURL is present in the gather_info.py file, which scraps the data off the web pages.

Plotting

• The plotting of various graphs is done on carinfo_plots.ipynb Jupyter notebook.

Good reads

• https://www.dataquest.io/blog/web-scraping-beautifulsoup/
• https://hackernoon.com/web-scraping-tutorial-with-python-tips-and-tricks-db070e70e071