Zero dependency golang module and CLI to handle HTTP Archive (HAR) files.

A web-crawling automation bot built for TXB Stores to filter, pull, and file away CSVs into a shared network filesystem.

Tools I build mostly for security Research

Web scraping projects

This project was to perform descriptive data Analytics on Hotel Tulip Web Server Log File in order to find insightful information. Tasks were to perform 1. Data Manipulation of Web Log Data through ETL, 2. Descriptive Statistics of Web Traffic Analysis, Web Server Analysis, and Geographic Analysis. 3. Data Manipulation through Web Crawling , and…

Scrape product url, image link, name and price across multiple pages from glassesshop website with scraPy and store to a SQLite database.

Collect data on Vietnam's history in Wikipedia and DBPedia.

1101 Course IM2028 Python Final Project - Web Crawling of Lativ Website and Simply Data Analysis

Web Scraping and Automation using Python and tools such as Selenium, BeautifulSoup, and Chromium

Digikala Crawlerیک خزنده وب قدرتمند برای جمع‌آوری و تحلیل داده‌های دیجی‌کالا است. این ابزار به تجار و تحلیلگران بازار کمک می‌کند تا به بینش‌های دقیقی از رفتار بازار دست یابند، شامل استخراج داده‌های فروشندگان، محصولات و تحلیل قیمت. مناسب برای تقویت استراتژی‌های بازاریابی و فروش

This is an web based application developed in raw PHP for market analysis and prediction. It also used web crawling for comparing the price of various products with other websites products.

20170608 (남창현) 자주 쓰이는 한국어 낱말 찾기

A scalable frontier for web crawlers

This repository keeps code for my hackathon competition in creating ChatGPT integrated chatbot for selling laptop

[discontinued]

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

Converts a list of hyperlinks into their canonical forms

Code for the Medium article on scraping GDQ data.

Aranhas que buscam notícias