Create a Cloud Storage Operator that could return a list of objects in a folder #39290
Open
1 of 2 tasks
Labels
kind:documentation
provider:google
Google (including GCP) related issues
type:doc-only
Changelog: Doc Only
Description
Create a new operator inside of
airflow.providers.google.cloud.operators.gcs
that, given a pattern/preffix would return a listof files in said folder, similar to the client method:
Use case/motivation
No response
Related issues
I have a process that runs once a day that reads some *.csv files from storage and process them.
It would be nice to have an operator that would do exactly that, without needing to create custom code for it.
When I create the custom code, probably using the storage hook, I can try to paste it here, but I don't have time to create a PR.
Are you willing to submit a PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: