Skip to content

sharad1126/WebScrapper

Repository files navigation

WebScrapper

Crawling webpages with selenium using Chrome driver/Firefox headless

If this helped you, consider Buy Me A Coffee

Installation

Assuming that you have Selenium, Chrome driver and Firefox headless installed:

git clone https://github.com/sharad1126/WebScrapper
cd WebScrapper
pip install -r requirements.txt

Usage

python final_crawl_selenium.py
#and then wait for 30-35 seconds. In the meantime, driver will also open chrome browser to run the webpage.

python webpage_screenshot.py
#Will save the screenshot at a specified place as per the code

Results

Screenshot

Screenshot

Author

Sharad Agarwal sharad.agarwal@cern.ch