自行编写的爬虫应当放在Spiders文件夹下，且继承于Mould.BaseSpider
在根目录使用命令启动爬虫
>>> python main.py MySpider -j
#启动MySpider爬虫, -j代表以阻塞主线程的方式启动
-
Notifications
You must be signed in to change notification settings - Fork 1
HorsesElectricStick/ChineseUniversityCrawler
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
这是一个基于webdriver的小型爬虫框架，用于爬取各个大学的考研拟录取公示名单，可自定义爬虫程序。为此主要实现了定时定频爬取，断点重爬，附件下载和管理。
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published