0.3.3 (TBC)

Features / Enhancement

0.3.2 (2020-08-05)

Features / Enhancement

Added .gitignore-style .crawlabignore file.

Bug Fixes

0.3.0 (2020-07-04)

Features / Enhancement

Kafka and ElasticSearch Integration (Python only).

0.2.0 (2020-06-01)

Features / Enhancement

MySQL and Postgres Integration.

Bug Fixes

0.1.7 (2020-03-31)

Features / Enhancement

Results De-duplication Support.

Bug Fixes

0.1.6 (2020-03-20)

Features / Enhancement

Bug Fixes

Compatibility issue with scrapy spider.

0.1.5 (2020-03-19)

Features / Enhancement

Bug Fixes

CLI unable to use on Windows of some versions.

0.1.4 (2020-03-18)

Features / Enhancement

Bug Fixes

CLI unable to use on Windows. #580

0.1.3 (2020-02-24)

Features / Enhancement

Bug Fixes

Import Spider Error.

0.1.2 (2020-02-21)

Features / Enhancement

Add More Scrapy Support.

0.1.1 (2020-02-18)

Features / Enhancement

Scrapy Settings Command Output Update.

Bug Fixes

0.1.0 (2020-02-16)

Features / Enhancement

Added Scrapy Settings for Scrapy Project.

Bug Fixes

0.0.9 (2020-02-10)

Features / Enhancement

Added Node.js SDK.

Bug Fixes

0.0.8 (2020-01-23)

Features / Enhancement

Bug Fixes

"crawlab spiders" error. Crawlab #458

0.0.7 (2020-01-13)

Features / Enhancement

Integration with Scrapy. Allow users to use crawlab.pipelines.CrawlabMongoPipeline to integrate Scrapy spiders with Crawlab.
Integration with General Python Spiders. Allow users to use crawlab.save_item method to integrate general Python spiders with Crawlab.

Bug Fixes

0.0.3 (2019-12-31)

Features / Enhancement

CLI. Allow users to interact with Crawlab server such as uploading spiders and viewing list of nodes, spiders and tasks.