-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Labels
area:storageStorages (local/s3/adls/gcs)Storages (local/s3/adls/gcs)enhancementNew feature or requestNew feature or request
Description
Summary
Compute exact Delta write metrics (, , etc.) for remote targets (S3/GCS/ADLS) by reading commit logs through object_store.
Context
Current Delta metrics for remote targets intentionally avoid fake values and leave most metrics nullable.
Scope
- Read the written Delta commit JSON () through object_store for remote targets.
- Count actions and sizes.
- Populate accepted output metrics consistently with local Delta.
Acceptance criteria
- Remote Delta reports no longer hardcode placeholder file counts.
- Exact metrics are populated when commit log is readable.
- Fallback remains nullable (not fake values) on partial failures.
Related: #159
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
area:storageStorages (local/s3/adls/gcs)Storages (local/s3/adls/gcs)enhancementNew feature or requestNew feature or request