Skip to content

Contains scripts used to learn, test and explore web spiders or crawlers, which are tools used to index / explore various web sites and content.

Notifications You must be signed in to change notification settings

abhinuvpitale/Spiders

Repository files navigation

Spiders

Contains scripts used to learn, test and explore web spiders or crawlers, which are tools used to index / explore various web sites and content.

  1. goodreads_quotes_spider.py - Search for quotes using keywords. For eg. harry potter swear results in 'I solemnly swear I am upto no good.' Uses content hosted on goodreads.com

  2. verge_newsfeed_spider.py - Generates text news feed from the title page of The Verge Uses content hosted on theverge.com

  3. vtech_ece_proflist.py - Generates a List of professors and their reserach interests. Uses content hosted on ece.vt.edu

About

Contains scripts used to learn, test and explore web spiders or crawlers, which are tools used to index / explore various web sites and content.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •  

Languages