Skip to content
This repository has been archived by the owner on Jun 10, 2024. It is now read-only.

v0.3.5
Compare
Choose a tag to compare
@binux binux released this 22 May 16:02
· 664 commits to master since this release
v0.3.5
708b004
  • New parameter: auto_recrawl - auto restart task every age.
  • New parameter: js_viewport_width/js_viewport_height to set viewport size for phantomjs engine.
  • New command line option to set different message queue backends with URI scheme.
  • New task level storage mechanism: self.save
  • New redis taskdb
  • New redis message queue.
  • New high level message queue interface kombu.
  • Fix bugs related to mongodb (keyword missing if not set).
  • Fix phantomjs not work in all mode.
  • Fix a potential deadlock in processor send_message.
  • Default log level of scheduler is changed to INFO
Assets 2