iLearnDE

Hi, welcome to this amazing resources here. A stepwise collection of topics for learning DATA ENGINEERING. It is divided into three folders and three task-levels.

Prerequisites

To get most out of this course you just need to get an DE. Prior experience is not needed. All the materials of the course are freely available, so you can replicate them easily

Tools

For this course you'll need to have any of the following relational database management systems software installed on your computer.

• EXCEL (via Link)
• MSSQL (via Link)
• MYSQL (via Link)
• MONGODB (via Link)
• POSTGRESQL(via Link)
• AIRFLOW (via Link)
• KAFKA (via Link)
• POWERBI (via Link)
• PYSPARK (via Link)
• PYTHON (via Link)

Learning Format

• level 0: Data Pipeline & ETL
• level 1: Data Scheduling & ETL
• leek 2: Data Scraping & Cloud Integrations

Syllabus

Level 0: Data Pipeline & ETL

• ELT-PIPELINE-I-MSSQL-TO-MYSQL
• ELT-PIPELINE-II-MSSQL-TO-PSQL
• ELT-PIPELINE-III-MONGODB-TO-
• ELT-PIPELINE-IV-
• ELT-PIPELINE-V-

More details

Level 1: Data Scheduling & ETL

• ETL-SCHEDULING-DB-I
• ETL-SCHEDULING-DB-II
• ETL-SCHEDULING-DB-III
• ETL-SCHEDULING-DB-IV
• ETL-SCHEDULING-DB-V

More details

Level 2: Data Scraping & Cloud Integrations

• ETL-WEBSCRAPING-API-I
• ETL-WEBSCRAPING-API-II
• ETL-WEBSCRAPING-API-III
• ETL-WEBSCRAPING-API-IV
• ETL-WEBSCRAPING-API-V

More details

FAQ

When Asking for Help Online

The fatest way to get a self-explanatory answer might be to use CHAT-GPT3. Start using the tool using CHATGPT-3 channel.

• Follow these recommendations when asking for help from Stackeoverflow
• Follow these recommendations when asking for help from Reddit
• Follow these recommendations when asking for help from Twitter
• Follow these recommendations when asking for help from Online forumns

References

Documentations

• The EXCEL DOCS
• The MSSQL DOCS
• The MYSQL DOCS
• The POSTGRESQL DOCS
• The MONGODB DOCS
• The AIRLOW DOCS
• The KAFKA DOCS
• The POWERBI DOCS
• The PYTHON DOCS
• The PYSPARK DOCS

Books

• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)

Communities

• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)

Webistes

• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)

Persons

• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)
• xxxx (https://linkedin.com/in/xxxxx)
• Sejal Vaidya (https://linkedin.com/in/vaidyasejal)