Skip to content
#

webmagic

Here are 67 public repositories matching this topic...

Java 电商爬虫,动态代理请自行更换!爬取目标:京东、考拉、丝芙兰;使用工具:HtmlUnit(单线程,大部分网站通过代理可以获取,但是反爬多层JS的无法取到)、ChromeDriver(多进程,需要考虑销毁机制)等(其它的不咋好用)(此项目只为研究各个工具的优劣,并不支持商用)

  • Updated Sep 1, 2022
  • Java

Improve this page

Add a description, image, and links to the webmagic topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the webmagic topic, visit your repo's landing page and select "manage topics."

Learn more