You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
my situation is on-prem on top of that using k8s on top of that using trino or spark + iceberg + object storage
I just want to ask you guys how to back up your iceberg table in obs when one obs is down, what is your execution plan?
I am not sure this is a right skill.
Dual Object Storage with Two Iceberg Connectors:
Set up two separate object storage systems.
Configure two Iceberg connectors in your Trino Helm chart, each pointing to one of the object storage systems.
When querying data, create two Iceberg tables for each object storage system.
second,
Single Object Storage with One Iceberg Connector:
Set up a single object storage system.
Configure one Iceberg connector in your Trino Helm chart to connect to this object storage.
When querying data, you obtain metadata and data files (.json, .avro) from the Iceberg table.
Copy these files to another object storage system manually or through automated scripts.
if there is better architecture, Could you please tell me?
The text was updated successfully, but these errors were encountered:
Query engine
No response
Question
my situation is on-prem on top of that using k8s on top of that using trino or spark + iceberg + object storage
I just want to ask you guys how to back up your iceberg table in obs when one obs is down, what is your execution plan?
I am not sure this is a right skill.
Dual Object Storage with Two Iceberg Connectors:
Set up two separate object storage systems.
Configure two Iceberg connectors in your Trino Helm chart, each pointing to one of the object storage systems.
When querying data, create two Iceberg tables for each object storage system.
second,
Single Object Storage with One Iceberg Connector:
Set up a single object storage system.
Configure one Iceberg connector in your Trino Helm chart to connect to this object storage.
When querying data, you obtain metadata and data files (.json, .avro) from the Iceberg table.
Copy these files to another object storage system manually or through automated scripts.
if there is better architecture, Could you please tell me?
The text was updated successfully, but these errors were encountered: