🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl, search and extract with a single API.
-
Updated
May 20, 2024 - TypeScript
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl, search and extract with a single API.
The fastest web crawler written in Rust. Maintained by @a11ywatch.
Clients to use with the hosted spider service - spider.cloud
Add a description, image, and links to the ai-scraping topic page so that developers can more easily learn about it.
To associate your repository with the ai-scraping topic, visit your repo's landing page and select "manage topics."