Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

强烈建议换底层，不需要对强反爬花太多精力 #373

Open
weibocy opened this issue May 5, 2024 · 4 comments
Open

强烈建议换底层，不需要对强反爬花太多精力 #373

weibocy opened this issue May 5, 2024 · 4 comments
Labels
enhancement New feature or request

Comments

@weibocy
Copy link

weibocy commented May 5, 2024 •
edited

建议换成这个底层，https://github.com/g1879/DrissionPage
对强反爬进行了处理，通过率极高。
@weibocy
Copy link
Author

weibocy commented May 5, 2024

如果DP这个项目不合适，也可以参考playwright过https://bot.sannysoft.com/
的具体方案参考这个插件，https://github.com/berstend/puppeteer-extra/tree/master/packages/puppeteer-extra-plugin-stealth#readme

@weibocy
Copy link
Author

weibocy commented May 5, 2024

我也可以参与开发，专做反爬这块

@NaiboWang
Copy link
Owner

非常好的建议，我很早之前就想换底层，但是苦于没有时间，现在做科研忙着博士毕业太忙了，将来如果有时间应该会做这件事情，但是短时间内确实没有精力，如果大家有兴趣可以一起参与进来。

@NaiboWang NaiboWang added the enhancement New feature or request label May 5, 2024
@touero
Copy link
Contributor

touero commented May 6, 2024 •
edited

drissionpage的底层是cdp(chrome devtools protocol)，与debug的chrome通讯传递json就能实现，在selenium中也有直接执行cdp的方式

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@NaiboWang @touero @weibocy