We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug After a succesful run of volume and source freshness tests, tables in the form:
data_monitoring_metrics_tmp_<timestamp>
are left in Athena and s3. Moreover, while not present in Athena, is still possible to find files about other temporary tables in the form:
test_<hex_code>_elementary_volume_anomalies_<model_name>_<other_descs>
in the s3 bucket
To Reproduce Steps to reproduce the behavior:
dbt run --select elementary
dbt test
s3_data_dir
Expected behavior Temporary tables must be completely dropped after a run (metadata + parquet files in S3).
Environment (please complete the following information):
The text was updated successfully, but these errors were encountered:
Closing this issue to keep discussion in the main Elementary repo
elementary-data/elementary#1514
Sorry, something went wrong.
No branches or pull requests
Describe the bug
After a succesful run of volume and source freshness tests, tables in the form:
data_monitoring_metrics_tmp_<timestamp>
are left in Athena and s3.
Moreover, while not present in Athena, is still possible to find files about other temporary tables in the form:
test_<hex_code>_elementary_volume_anomalies_<model_name>_<other_descs>
in the s3 bucket
To Reproduce
Steps to reproduce the behavior:
dbt run --select elementary
dbt test
s3_data_dir
Expected behavior
Temporary tables must be completely dropped after a run (metadata + parquet files in S3).
Environment (please complete the following information):
The text was updated successfully, but these errors were encountered: