Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

Apify SDK monorepo

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

This repo is a part of blog series on several web scraping projects where we will explore scraping techniques to crawl data from simple websites to websites using advanced protection.

Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extract all pages for the given keyword. You can specify more keywords on the input for one run.

Scrape Tripadvisor restaurant, hotels, and places.

基于Apify+node+react搭建的有点意思的爬虫平台

Apify API client for Python

Apify actor to scrape Youtube search results. You can set the maximum videos to scrape per page as well as the date from which to start scraping.

You can use this act to monitor any page's content and get a notification when content changes.

Crawlee One is a framework built on top of Crawlee and Apify for writing robust and highly configurable web scrapers.

No more dealing with Google API. Simple Node.js program to automate access to Google Sheets.

Apify actor for scraping events from Ticketmaster based on their categories

Scrape any Twitter user profile. Extract tweets, retweets, replies, favorites, and conversation threads with no Twitter API limits

Web application for recording, management and editing of inteligent RPA workflows using Playwright technology

Combines Apify's crawling system and article parsing with unfluff library.

Apify public actor for scraping Airbnb homes.

Experimental scraper in Rust suited for running locally or on the Apify platform. Inspired by Apify SDK.