Flink Table Maintenance

[pvary]

Proposed Change

The main goal is to have a solution where Flink can execute the Maintenance Tasks as part of the streaming job. Especially Rewrite Data Files, Rewrite Manifest Files and Expire Snapshots.
The secondary goal is to provide building blocks for Flink batch jobs to execute the Maintenance Tasks independently, where the scheduling is done outside of Flink.

Proposal document

https://docs.google.com/document/d/16g3vR18mVBy8jbFaLjf2JwAANuYOmIwr15yDDxovdnA

Specifications

• Table
• View
• REST
• Puffin
• Encryption
• Other