Skip to content
This repository has been archived by the owner on Mar 25, 2022. It is now read-only.

adiled/adene-bot

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit

.gitignore

.gitignore

 
 

README.md

README.md

 
 

backlog.json

backlog.json

 
 

index.js

index.js

 
 

indexer.js

indexer.js

 
 

logger.js

logger.js

 
 

message.txt

message.txt

 
 

package.json

package.json

 
 

scraper.js

scraper.js

 
 

store.js

store.js

 
 

Repository files navigation

Architecture Philosophy

This bot employs a 'Divide and Conquer' strategy.

What it doesn't do: Grab all the document numbers first and then scrape them

What it does: Grab a bunch of document numbers, suppose 100 from 5 pages. Scrape them, continue where left.

About

Energy Certificates Crawler and Scraper

Topics

nodejs-bot node-crawler

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages