Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vkontakte-user scrapes get redirected to badbrowser.php #1031

Open
4b5urdX opened this issue Sep 23, 2023 · 1 comment
Open

vkontakte-user scrapes get redirected to badbrowser.php #1031

4b5urdX opened this issue Sep 23, 2023 · 1 comment
Labels
bug Something isn't working module:vkontakte

Comments

@4b5urdX
Copy link

4b5urdX commented Sep 23, 2023

Describe the bug

Scraping for a VKontakte User returns 0 results, while searched accounts do exist.

How to reproduce

snscrape vkontakte-user navalny

Expected behaviour

Get the desired data on the account.

Screenshots and recordings

No response

Operating system

Ubuntu 20.04

Python version: output of python3 --version

python 3.10.12

snscrape version: output of snscrape --version

snscrape 0.7.0.20230622

Scraper

vkontakte-user

How are you using snscrape?

CLI (snscrape ... as a command, e.g. in a terminal)

Backtrace

No response

Log output

2023-09-23 21:42:16.797 INFO snscrape.modules.vkontakte Retrieving initial data
2023-09-23 21:42:16.831 INFO snscrape.base Retrieving https://vk.com/navalny
2023-09-23 21:42:17.599 INFO snscrape.base Retrieved https://vk.com/navalny (redirected to https://vk.com/badbrowser.php): 200
2023-09-23 21:42:17.604 INFO snscrape.modules.vkontakte Wall has no posts
2023-09-23 21:42:17.604 INFO snscrape._cli Done, found 0 results

Dump of locals

No response

Additional context

If you open https://vk.com/badbrowser.php it states the browser in use is outdated. While visiting the site with my default browser it works fine, however snscrape requests always get redirected, which is probably why the 0 results bug occurs. So there seems to be problem with the request itself.

@4b5urdX 4b5urdX added the bug Something isn't working label Sep 23, 2023
@JustAnotherArchivist
Copy link
Owner

Thanks. This is likely user agent detection on VK's side.

Relatedly, the scraper was already broken before: #737

@JustAnotherArchivist JustAnotherArchivist changed the title Error for scraping vkontakte-user vkontakte-user scrapes get redirected to badbrowser.php Sep 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working module:vkontakte
Projects
None yet
Development

No branches or pull requests

2 participants