This project implements a Lakehouse Medallion Architecture using modern Data Stack tools such as Fivetran, Snowflake and dbt. The ficticious organization is an e-commerce company.
-
Updated
Jan 24, 2024 - Python
This project implements a Lakehouse Medallion Architecture using modern Data Stack tools such as Fivetran, Snowflake and dbt. The ficticious organization is an e-commerce company.
Data Warehouse with ELT pipelines
In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our cloud provider.
Implemented enhanced analytics for trip transactions and ride-based data from SQL Server using Medallion Architecture with Azure Data Factory and Databricks.
Add a description, image, and links to the medallion-architecture topic page so that developers can more easily learn about it.
To associate your repository with the medallion-architecture topic, visit your repo's landing page and select "manage topics."