Astel

A simple, fast and reliable asyncronous web crawler for Python.

• Documentation: https://William-Fernandes252.github.io/astel
• GitHub: https://github.com/William-Fernandes252/astel
• PyPI: https://pypi.org/project/astel/
• Free software: MIT

Features

The main goal of astel is to offer a simpler, efficient and performant solution to programmatically look for links in webpages: no need to extend any class (composition over inheritance), no configuration and as few dependencies as possible.

This package relies on HTTPX to send all requests in asynchronous operations, thus maximizing the number of pages processed during each execution.

Credits

This package was created with Cookiecutter and the waynerv/cookiecutter-pypackage project template.