[Feature] Support custom GCS bucket subdirectories for Dataproc #521
Labels
pkg:dbt-bigquery
Issue affects dbt-bigquery
triage:product
In Product's queue
type:enhancement
New feature request
Is this your first time submitting a feature request?
Describe the feature
Currently, DBT-Bigquery writes Python model files for Dataproc to
gs://<gcs bucket>/<model file name>
, which can conflict if multiple users (e.g. dev users, CI runs, etc.) concurrently utilize the same GCS bucket.Instead, it'd be nice for a subdirectory to be optionally configured, to write to
gs://<gcs bucket>/<gcs subdirectory>/<model file name>
instead.Describe alternatives you've considered
N/A
Who will this benefit?
Users that want to share a single GCS bucket across multiple concurrent use cases (CI, dev, etc.)
Are you interested in contributing this feature?
Yes
Anything else?
No response
The text was updated successfully, but these errors were encountered: