Option "do not scrape duplicates"

[maksbdev]

Often, when scraping several similar queries (or one query in nearby locations), duplicates may appear in search results, resulting in duplicate entries in the output file and requiring additional time to complete the task. Is it possible to implement a parameter that prevents scraping information about an organization if it has already been scraped earlier?

[gosom]

hi @maksbdev ,

this sounds like a good idea.

I will try to include in the next release.

thanks for your feedback

[ruanbsroche]

i have made one script in py to do this