Skip to content

Latest commit

 

History

History
6 lines (5 loc) · 230 Bytes

README.md

File metadata and controls

6 lines (5 loc) · 230 Bytes

site-pagesize-crawler

Crawls a URL following same-domain hyperlinks and saves path and page size in KB into a CSV file.

Usage

python crawl_webpage_sizes.py [http(s)://example.com]

Saves data into crawled_pages_sizes.csv