-
🔭 I am Zhang Jie (张 杰), a Senior Software Engineer at Roku 💜 Big Data Platform team, where I provide data infrastructure and data solutions both in large scale 🔵 real time streaming processing and data lake batch processing.
-
🌱Tech Stack: Flink, Spark, Kafka, Kafka Connect, Presto, Iceberg, Hive, Hadoop, Airflow, Kubernetes, Docker, AWS Stack, DataDog, Jupyter Notebook, Superset, Looker.
Lead a Flink & Kubenetes powered real time streaming platform which provides capabilities to build Flink streaming applications and run them on Kubernetes clusters seamlessly. Onboarded other engineering teams and promoted best streaming practices.
Built and maintained a Spark & Hive & S3 & Airflow based data lake, architected and implemented distributed data ingestion and processing pipelines.