Skip to content

Latest commit

 

History

History
57 lines (43 loc) · 3.07 KB

README.md

File metadata and controls

57 lines (43 loc) · 3.07 KB

Scraper School

This is the complete guide to know how to scrape almost any website

Prerequisites 💪

  1. Basic HTML
  2. Basic Python

Installation 🔨

Python 3.8

install python with pip

pip install scrapy
pip install pandas 
pip install pyquery
pip install selenium
pip install random_user_agent

Frameworks Documentation 📙

  1. Scrapy
  2. Requests
  3. Pyquery
  4. Selenium
  5. Pandas

Websites 🚀

  1. Quotes to Scrape
  2. Glassdoor
  3. Elmenus
  4. Indeed
  5. Canadapost
  6. Repocast
  7. Tadawul
  8. Poshmark
  9. Anmeld-haandvaerker
  10. Tripadvisor
  11. Seekingalpha
  12. Flexioffices
  13. Easydata
  14. Yahoo Finance
  15. Opendiary
  16. Google Maps

Useful Chrome Extensions 🔖

  1. Quick Javascript Switcher
  2. Json Formatter
  3. Web Scraper
  4. Data Scraper