You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Idea for the feature
It would be useful to customize this timeout and align it with actual timeout for processing.
Idea for follow up
Once we customize timeout - it will give us foundation to also customize temp table name and make it per run - at the moment it's always <original-table>_temp which will prevent e.g. concurrent runs targeting different partitions with insert_overwrite per partition strategy.
I think in order to get there though - it's essential to align timeouts.
Describe alternatives you've considered
No response
Who will this benefit?
People who run the same model many times, with high failures rate (since if query fails temp table won't be dropped).
Are you interested in contributing this feature?
Yup, I'll add PR shortly + I signed CLA
Anything else?
No response
The text was updated successfully, but these errors were encountered:
Is this your first time submitting a feature request?
Describe the feature
Current State
At the moment temp tables created in big query dbt models have arbitrary timeout set to 12h.
Code Reference
dbt-adapters/dbt-bigquery/src/dbt/adapters/bigquery/impl.py
Line 777 in 999dd7f
Idea for the feature
It would be useful to customize this timeout and align it with actual timeout for processing.
Idea for follow up
Once we customize timeout - it will give us foundation to also customize temp table name and make it per run - at the moment it's always
<original-table>_temp
which will prevent e.g. concurrent runs targeting different partitions withinsert_overwrite
per partition strategy.I think in order to get there though - it's essential to align timeouts.
Describe alternatives you've considered
No response
Who will this benefit?
People who run the same model many times, with high failures rate (since if query fails temp table won't be dropped).
Are you interested in contributing this feature?
Yup, I'll add PR shortly + I signed CLA
Anything else?
No response
The text was updated successfully, but these errors were encountered: