The dbsched bundle is preconfigured with the Pado scheduler to periodically execute jobs that dump database tables to CSV files from which it automatically extracts column information to generate the corresponding VersionedPortable classes. It then transforms the CSV records to objects using the generated classes before ingesting them into Hazel…

Archive of Python code snippets for data engineering & analytics processes

This project bundles all relevant technical specification for interfacing with the AddRadio network.

Data Ingestion, reading files, working with databases, troubleshooting data, calling APIs and schemas

Projects done to learn database projects

Efetuar o download de arquivos da web com Python. Inserir dados de um dataframe na cloud Azure com Azure SQL Database. Efetuar transformações nos dados com Azure Data Factory.

Performing DataBase Ingester

Minerva ETL data ingestion service

HTTP server that easily ingests data into a database

NLP enhancer plugin for Foundry-ES pipeline management system. The service that enhances elasticsearch functionality with NLP elements.

Ingest data fetched from Snowflake to ElasticSearch

FastAPI server to process client request both for injection and interference

The core ingestion API for KEAS

End-To-End-Solution-DataEngineering-FinalProject

smartive/proc-that forked to play with

Nucleus is a software platform used to create workflows for the Planetary Data (PDS).

Ingest data into Solr from a variety of sources

Lab n°2 of "Applications of Big-Data" @ Efrei Paris

Automating Ingestion Excel Files On To Azure Data Studio (SQL-Server)