Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

banned from javdb #266

Closed
Freakboo opened this issue Jun 21, 2021 · 7 comments
Closed

banned from javdb #266

Freakboo opened this issue Jun 21, 2021 · 7 comments
Labels
wont fix This will not be worked on

Comments

@Freakboo
Copy link

Scraped too much at once?
Have dissabled in settings to remove.

Write-Error: C:\Users\Navi\Documents\PowerShell\Modules\Javinizer\2.4.11\Public\Invoke-JVParallel.ps1:561
Line |
561 | Get-RunspaceData
| ~~~~~~~~~~~~~~~~
| [MMZ-006] [Get-JavdbUrl] Error occured on [GET] on URL [https://javdb.com/search?q=MMZ-006&f=all]: The
| owner of this website has banned your access based on your browser's behaving
IP: .My IP.

  • Module version used: 2.4.11
  • Operating System and PowerShell version: 10 x64, PS7 x64
@jvlflame jvlflame pinned this issue Jun 21, 2021
@jvlflame
Copy link
Collaborator

Yep, some other users have also noted this. The ban seems to be a persistent (permanent?) IP ban from javdb unfortunately.
I'll probably have to remove/disable this scraper in further versions.

@jvlflame
Copy link
Collaborator

jvlflame commented Jul 5, 2021

Heard from others that the unban was lifted after approximately 14 days. I'd caution anyone using this scraper to limit their sorting threads to ~1-2 at max.

@Borisbee1
Copy link

I was banned from javdb after I tried to scrape a single movie. Could this issue be resolved by providing a user agent?

@jvlflame
Copy link
Collaborator

@Borisbee1 I'm not sure.. it's pretty hard to test javdb requests if their bans keep coming. They seem to have a pretty hard stance on scrapers so at this point I'm thinking of dropping support.

@nsfw-local
Copy link

Please can you add the User-Agent when call to Javdb? Because Javdb has many results that other site doesn't have. :)

@gummykage
Copy link

I've tried setting the cookie, I've tried using VPN always get banned. Is there a way around this?

@nsfw-local
Copy link

@jvlflame You can use stash as reference.
https://github.com/stashapp/CommunityScrapers/blob/master/scrapers/javdb.yml

With cookie key: _jdb_session, remember_me_token and User-Agent used, I was not ban from javdb9.com

@seeyabye seeyabye added the wont fix This will not be worked on label May 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
wont fix This will not be worked on
Projects
None yet
Development

No branches or pull requests

6 participants