Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

只答疑软件功能和Bug相关的问题,政府军事等网站不予答疑,其他问题请加群 #100

Open
NaiboWang opened this issue Jun 28, 2023 · 12 comments

Comments

@NaiboWang
Copy link
Owner

NaiboWang commented Jun 28, 2023

政府军事等网站不予答疑,如https://zrzyt.hubei.gov.cn/fbjd/zhengce/zcjd/index.shtml
Issues是来提软件的bug和功能需求之类问题的,对于如何使用软件设计一个任务的类似的问题,比如如何设置xpath,如何针对某网站设计一个流程等不属于软件的Bug和功能上的问题,我这边没时间一一解答,请大家理解。对于此类问题,大家可以加Readme里写的QQ群问其他朋友。

@NaiboWang NaiboWang pinned this issue Jun 28, 2023
@NaiboWang NaiboWang changed the title 只答疑软件功能和Bug相关的问题,其他问题请加群 只答疑软件功能和Bug相关的问题,政府军事等网站不予答疑,其他问题请加群 Jun 28, 2023
@NaiboWang NaiboWang reopened this Jul 15, 2023
@burukanke
Copy link

开启爬取Cloudflare一类强反爬网站模式时,如果打开网页模块里输入的是多个链接, easyspider_executestage.py这个文件里的browser_t.execute_script('window.open("'+ links[0] +'","_blank");')这行会报js脚本执行出错,不开那种模式就正常循环开启多个链接,请问有解决方法吗?

@NaiboWang
Copy link
Owner Author

Cloudflare反爬功能会随着cloudflare经常更新反爬机制而失效,我一个人没有太多时间一直更新此功能,建议自行修改源码处理,参考undetected-chromedriver库。

@jiangsai0502
Copy link

目前Mac的Chrome发布到了117,从115开始ChromeDriver就与Chrome集成了,现在下载不到117的ChromeDriver,每次都闪退,有解法不

@NaiboWang
Copy link
Owner Author

目前Mac的Chrome发布到了117,从115开始ChromeDriver就与Chrome集成了,现在下载不到117的ChromeDriver,每次都闪退,有解法不

参考:

#181

@ahuyuhy
Copy link

ahuyuhy commented Oct 14, 2023

你好 这边咨询下 如果某网页比如循环下一页中 偶尔有时候会出现503等报错,当然多次刷新一般能打开 那么这种需要如何设计流程 或者判断 比如当出现特定信息时 重新刷新这个页面在爬取 或者找不到需要元素 有个重刷新机制 也就是问题不是需要时间来加载而是直接比如403 503等错误

@7-happy
Copy link

7-happy commented Nov 6, 2023

爬 来赞达 菲律宾站 页面弹窗遮挡住图形验证滑块 https://www.lazada.sg/?spm=a2o42.searchlist.header.dhome.2bc13737fneiHG
image

@strayly
Copy link

strayly commented Dec 11, 2023

按发布一条龙的步骤,从源码生成软件包是提示 如下错误,请问是什么原因?
Could not load key from "" Error: ENOENT: no such file or directory, open
at Object.openSync (node:fs:590:3)
at Object.readFileSync (node:fs:458:35)
at tryLoadKeyPair (D:\EasySpider\Extension\manifest_v3\node_modules\crx3\lib\keypair.js:68:19)
at createKeyPair (D:\EasySpider\Extension\manifest_v3\node_modules\crx3\lib\keypair.js:45:16)
at CRX3Stream.crxInit (D:\EasySpider\Extension\manifest_v3\node_modules\crx3\lib\crx3stream.js:126:19)
at CRX3Stream._write (D:\EasySpider\Extension\manifest_v3\node_modules\crx3\lib\crx3stream.js:86:9)
at doWrite (node:internal/streams/writable:410:12)
at clearBuffer (node:internal/streams/writable:571:7)
at CRX3Stream. (node:internal/streams/writable:263:7)
at Object.onceWrapper (node:events:627:28) {
errno: -4058,
syscall: 'open',
code: 'ENOENT'
}
No keyPath was specified. Private key will not be saved to a file.

@NaiboWang
Copy link
Owner Author

这不是错误。

@Pinkolinka11
Copy link

Ne Eriko to neni mozny!

@wangwangxingao
Copy link

点击 纯净版浏览器设计 没有反应

@wangnan789
Copy link

这个没必要拿来强调说明

@NaiboWang
Copy link
Owner Author

需要的,可以自己去看看多少人提了有关政府网站的issue。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants