-
Notifications
You must be signed in to change notification settings - Fork 33
Open
Description
This issue tracks the implementation of a Sink that writes data to Google BigQuery.
The goal is to allow the SDK to persist decoded on-chain data directly into BigQuery tables for analysis, indexing, and integration with other Google Cloud tools.
✅ Tasks
- Implement
Sinkinterface for BigQuery - Support dynamic schema generation based on
table.Columns - Support
Flush()that inserts rows to BigQuery using streaming inserts - Handle dataset/table creation if they don’t exist
- Ensure batching is efficient and avoids quota limits
- Add configuration options:
projectIDdatasetIDtablePrefixortableName
- Add authentication support using Application Default Credentials or service account
- Write unit tests for the sink
- Write integration test using test project or emulator (if available)
- Add usage example in documentation
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels