New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added: Enhanced spdier log/error handling #33

Open

starrify wants to merge 1 commit into scrapinghub:master from starrify:enhanced-error-logging

Member

starrify commented May 5, 2016

Collects not only spider exceptions, but also other kinds of errors that appear in logs. E.g.:

{
  "status": "ok",
  "errors": [
    "Ignoring response <404 https://www.linkedin.com/in/no_such_profile>: HTTP status code is not handled or not allowed"
  ],
  "items": []
}

Currently for reviewing purpose only. Please do not merge until there're unit tests added.


          Added: Enhanced spdier log/error handling

d084894

pawelmhm added the enhancement label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment