Download website to local directory (including all css, images, js, etc.)
-
Updated
Jun 3, 2024 - JavaScript
Download website to local directory (including all css, images, js, etc.)
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.
Kooboo is a Web Ecosystem designed to empower users in developing, distributing, and discovering websites and applications. For developers seeking a streamlined alternative to platforms like WordPress, Shopify, and Magento, Kooboo offers an intuitive development environment based on JavaScript
Plugin for website-scraper which returns html for dynamic websites using puppeteer
Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.
Wayback Machine Downloader. 🔥 Download your entire archived websites from the Internet Archive Wayback Machine.
Plugin for website-scraper which returns html for dynamic websites using PhantomJS.
Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.
Automatically curates and posts content to LinkedIn. It can optionally use web scraping to gather data, which is then fed to ChatGPT to craft engaging LinkedIn posts.
🕸 Generates and delivers RSS feeds via HTTP. Docker image available! Create your own feeds or get started quickly with the included configs.
A server to collect & archive websites that also supports video downloads
ScrapeGPT is a RAG-based Telegram bot designed to scrape and analyze websites, then answer questions based on the scraped content. The bot utilizes Retrieval Augmented Generation and webscraping to return natural language answers to the user's queries.
This repository includes simple traffic automation for blogger website that could be used by anybody by easily configuring and executing the PHP file. This automation can be used for website penetration testing and for various other ethical processes. The code uses many different types of user agents to make itself completely anonymous.
JSON collection of scraped file extensions, along with their description and type, from FileInfo.com
Scraper for https://marvelsnapzone.com to retrieve metadata of Marvel SNAP cards.
Download ALL the images (JPEG/GIF/PNG) from any Tumblr website! This project employs Python3 and BeautifulSoup4 to scrape a Tumblr site (with the url provided by the user) to download, page by page, all the images from the Tumblr site's posts. Ideal for archiving other peoples' Tumblrs <3
Plugin for website-scraper which allows to save resources to existing directory
Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites.Web scraping a web page involves fetching it and extracting from it.Web scraping automatically extracts data and presents it in a format you can easily make sense of.Use of APIs being probably the best way to extract data from a website. …
Add a description, image, and links to the website-scraper topic page so that developers can more easily learn about it.
To associate your repository with the website-scraper topic, visit your repo's landing page and select "manage topics."