Supercharge BigQuery with BigFunctions

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

🔥🔥🔥 Open Source Alternative to Hightouch, Census, and RudderStack. Leading Reverse ETL and Customer Data Platform (CDP) for Data Teams.

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

SageWorks: An easy to use Python API for creating and deploying AWS SageMaker Models

Apache Superset is a Data Visualization and Data Exploration Platform

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

This repository provides a central location for various datasets collected from online sources. Each dataset includes a brief description of its content, potential applications, and any interesting insights gleaned from a data science perspective.

DDE IO Utility Objects

Snowflake Snowpark Python API

An orchestration platform for the development, production, and observation of data assets.

Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

A Python package to load complex XML files into a relational database

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

🐚 Python-powered, cross-platform, Unix-gazing shell.

Infrastructure to allow data from the Analytical Platform to be accessed by other services

Always know what to expect from your data.

Fancy stream processing made operationally mundane