My Python Web Spider
On the Internet, Spider is one of the most interesting and useful technologies. It help us collect and analyse what we want. We need spider to be faster and smarter. My Python Web Spider now is Simple. But I will make it stronger little by little.
Regular Expression
match URL
match target data
Header
Cookies
Sessions
URL: baseURL + internal index
Status Report
Format output
Muli Threading
Reconnection