New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use function/Closure for deny, allow #9

Open

tranghaviet opened this issue Sep 9, 2019 · 1 comment

Labels

tranghaviet commented Sep 9, 2019

Is there any way to use Closure for deny, allow option? I think we should use a Closure/function for that so we can check using database ...etc.

See https://github.com/spatie/crawler#filtering-certain-urls

Collaborator

zstate commented Sep 9, 2019

Sounds like a good feature. Any help would be greatly appreciated.

zstate added the enhancement label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment