Pacman-TikTok crawler

How to use

1. Install all Python dependencies
   • Run "pip install -r requirements.txt" in cmd
2. Install Node.js and run nodeJS setup script - this is optional, only if you want to obtain data about user's content
   • Download and install NodeJS from https://nodejs.org/en/
   • Restart your IDE or cmd, depends where from you run scripts
   • Run setup script located in: Pacman-TikTok/nodeJS/setup-nodeJS.py
   • After message: "Crawler is ready to use!" it is all ready.
3. Finally run PacMan-TikTok/FinalFiles/GetData/get_data_user.py
   • It will obtain all user data and store it in mongoDB.

About

Crawling top TikTok user data from several countries, including data like username, profile image, evolution of followers in time, video content and stats about it and much more. All of the data are stored in non-SQL db (MongoDB). These data are analyzed using matplotlib into graphs.

Directories description

• TestFiles (files which are in test stage and not complete)

• FinalFiles (files which are officially ready to use)

  • GetData (files for crawling data)
  • Data Analysis (files for analyzing crawled data)

• nodeJS (nodejs setup script and needed js libs)

DB test-client login

• E-mail: packman@thlingo.com
• Pass: MIB123456