Skip to content
This repository has been archived by the owner on Jun 10, 2024. It is now read-only.

fixed some typos #888

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

fixed some typos #888

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
8 changes: 4 additions & 4 deletions docs/Deployment-demo.pyspider.org.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -112,20 +112,20 @@ With the config, you can change the scale by `docker-compose scale phantomjs=2 p

#### load balance

phantomjs-lb, fetcher-lb, webui-lb are automaticlly configed haproxy, allow any number of upstreams.
phantomjs-lb, fetcher-lb, webui-lb are automaticlly configed haproxy, allowing any number of upstreams.

#### phantomjs

phantomjs have memory leak issue, memory limit applied, and it's recommended to restart it every hour.

#### fetcher

fetcher is implemented with aync IO, it supportes 100 concurrent connections. If the upstream queue are not choked, one fetcher should be enough.
fetcher is implemented with async IO, it supportes 100 concurrent connections. If the upstream queue is not choked, one fetcher should be enough.

#### processor

processor is CPU bound component, recommended number of instance is number of CPU cores + 1~2 or CPU cores * 10%~15% when you have more then 20 cores.
processor is a CPU bound component, recommended number of instances is number of CPU cores + 1~2 or CPU cores * 10%~15% when you have more then 20 cores.

#### result-worker

If you didn't override result-worker, it only write results into database, and should be very fast.
If you didn't override result-worker, it only writes results into database, and should be very fast.