Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Apache Doris is an easy-to-use, high performance and unified analytics database.

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

The open source high performance ELT framework powered by Apache Arrow

Flink CDC is a streaming data integration tool

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

Efficient data transformation and modeling framework that is backwards compatible with dbt.

Dataform is a framework for managing SQL based data operations in BigQuery

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

Transform data together. Model, test and deploy as a team.

Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)

dbt + Metabase integration

One framework to develop, deploy and operate data workflows with Python and SQL.