refactor: use query stream for automatic data update script#224

Merged

patrickhulce merged 8 commits intopatrickhulce:masterfrom Kporal:feat/use-query-stream

Aug 7, 2024

+97-46

Commits on Jul 31, 2024

feat: add OVERRIDE_LH_PROJECT variable to override observed domains project
Guillaume NICOLAS
committed

Commits on Aug 1, 2024

feat: run bigquery in a stream to handle large results
Guillaume NICOLAS
committed
fix: can't increment a constant
Guillaume NICOLAS
committed

Commits on Aug 2, 2024

feat: use pipes to handle streams
Guillaume NICOLAS
committed
fix: add table schema
Guillaume NICOLAS
committed

Commits on Aug 6, 2024

fix: remove cache for queries
Guillaume NICOLAS
committed

Commits on Aug 7, 2024