Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Suggestion towards overriding "Malicious Request Detected" #204

Open
ethanchewy opened this issue Jan 12, 2018 · 0 comments
Open

Suggestion towards overriding "Malicious Request Detected" #204

ethanchewy opened this issue Jan 12, 2018 · 0 comments

Comments

@ethanchewy
Copy link

I've tested this for some weeks and just t wanted to give some results.

Overall, it was pretty good at first, but Google soon capped it to around 80 search results per day.

I see the proxy built in function. Is there a better way to overcome this?

Perhaps using something like: https://github.com/taspinar/twitterscraper/blob/master/twitterscraper/query.py#L8
and using a fake user_agent?

Again, huge fan of the project but wish someone would update it to avoid all the inconveniences when it come with grabbing more than a 1,000 links per day.

@ethanchewy ethanchewy changed the title Querying Issue Suggestion towards overriding "Malicious Request Detected" Jan 12, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant