Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Apify actor extracting data from Zalando

Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

Generic REST API for scraping websites. Drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

Apify SDK monorepo

Unofficial SDK for Apify service

Apify API client for Python

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

Ask questions related to langchain course brought by Activeloop.

Extracts various media files, such as images, videos, audio, and other related media elements, from multiple websites. It then provides the corresponding descriptions or the alt="" content. You may need to use proxies to run this actor for some websites with bot blocking features.

Example of Python Scrapy project. It scrapes book data from https://books.toscrape.com/.

Apify.com actor for scraping data from website https://www.arcgis.com/apps/opsdashboard/index.html#/5fe83e34abc14349b7d2fcd5c48c6c85

scrape news articles from investing.com as much as you want

This code runs puppeteer in a docker environment. After the docker build, a simple puppeteer script will visit a website, take a screenshot and save it.

Analyzes target website for anti-scraping protections and performance. Saves screenshots/HTML snapshots.

Apify integration for Zapier

An easy-to-use tool for making web service with API from your own Python functions.

Our project's mission is to build a resilient data warehouse solution, facilitating comprehensive analysis of customer feedback for each CIH Bank branch. In the ever-competitive banking landscape, harnessing customer sentiment is paramount for service improvement, elevated satisfaction, and data-informed decisions

Search organisations from Erasmus+ and European Solidarity Corps programmes. Define search criteria such as legal name, business name, hyperlink, PIC or an OID from: https://webgate.ec.europa.eu/erasmus-esc/index/organisations/search-for-an-organisation

Custom Zapier app for Apify integration