Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow Connector Sidecar container timeouts configuration changes #48855

Open
robertomczak opened this issue Dec 9, 2024 · 0 comments
Open

Allow Connector Sidecar container timeouts configuration changes #48855

robertomczak opened this issue Dec 9, 2024 · 0 comments

Comments

@robertomczak
Copy link
Contributor

robertomczak commented Dec 9, 2024

Helm Chart Version

1.2.0

What step the error happened?

None

Relevant information

The connector sidecar has settings that are not exposed to be configured via helm chart or in any other way.
Parameters that are impactful are SIDECAR_FILE_TIMEOUT_MINUTES and SIDECAR_FILE_TIMEOUT_WITHIN_SYNC_MINUTES
They can impact Airbyte operations during eg. schema discovery with large BigQuery project. (SIDECAR_FILE_TIMEOUT_MINUTES timeout after 9 minutes)

https://github.com/airbytehq/airbyte-platform/blob/4b2b2866ec263e64fefe9fcad59bb09b2ddfc954/airbyte-connector-sidecar/src/main/resources/application.yml#L55

Workaround that we're using now is to build docker image based on official docker image with adjusted env variables:

FROM airbyte/connector-sidecar:1.2.0

ENV SIDECAR_FILE_TIMEOUT_MINUTES=30
ENV SIDECAR_FILE_TIMEOUT_WITHIN_SYNC_MINUTES=60

Relevant log output

2024-12-09 17:09:31,833 [main]    INFO    i.a.c.ApplicationKt(main):12 - Sidecar start
2024-12-09 17:09:32,184 [main]    INFO    i.m.c.e.DefaultEnvironment(<init>):168 - Established active environments: [worker-v2, control-plane, oss, local-secrets]
2024-12-09 17:09:33,465 [pool-3-thread-1]    INFO    i.a.c.i.LineGobbler(voidCall):166 - 
2024-12-09 17:09:33,516 [pool-3-thread-1]    INFO    i.a.c.i.LineGobbler(voidCall):166 - ----- START DISCOVER -----
2024-12-09 17:09:33,516 [pool-3-thread-1]    INFO    i.a.c.i.LineGobbler(voidCall):166 - 
2024-12-09 17:18:33,478 [main]    WARN    i.a.c.ConnectorWatcher(waitForConnectorOutput):104 - Failed to find output files from connector within timeout of 9 minute(s). Is the connector still running?
2024-12-09 17:18:33,479 [main]    INFO    i.a.c.ConnectorWatcher(failWorkload):311 - Failing workload bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_aacd88ea-8b74-4156-aa8e-aa0b47d1c10f_0_discover.
2024-12-09 17:18:33,489 [main]    INFO    i.a.c.ConnectorWatcher(exitFileNotFound):229 - Deliberately exiting process with code 2.
Stream closed EOF for airbyte/bigquery-discover-aacd88ea-8b74-4156-aa8e-aa0b47d1c10f-0-tkqvu (connector-sidecar)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants