Implement user event import from Bigquery

[csutter]

Rewrite the existing Python Google Cloud function as a Ruby service class. This receives an event type and a date, and makes the necessary request to Discovery Engine to import BigQuery user event data.

• Add DiscoveryEngine::UserEvents::Import service to implement importing of user events from BigQuery along the lines of the original Python code
• Add GOOGLE_CLOUD_PROJECT_ID app configuration
• Add a rake task to call the service
• Ensure tests require Google API namespace for stubbing

see the vertex_events_push function on the infrastructure repo: https://github.com/alphagov/search-v2-infrastructure/blob/2991588b5dae11a20fc80432393fd134c7acb53c/terraform/environment/files/vertex_events_push/main.py

[jackbot]

Nice one. Code looks good to me. 👍

Is the idea that each day we'll run the rake task for the intraday events multiple times a day (using rake user_events:import_intraday_events) then once per day we'll import the previous day's events (using rake user_events:import_yesterdays_events)?

[csutter]

Is the idea that each day we'll run the rake task for the intraday events multiple times a day (using rake user_events:import_intraday_events) then once per day we'll import the previous day's events (using rake user_events:import_yesterdays_events)?

Spot on – I've already drafted scheduled tasks for this in integration: https://github.com/alphagov/govuk-helm-charts/pull/2803/files

And then there is a third Rake task for a specific date which is something that has occasionally come up as a manual task that needs doing (for example, if the import fails for some reason). This way someone can manually execute the Rake task in an environment.

[jackbot]

Lovely stuff