Skip to content

Iceberg Glue catalog hardening: ownership checks, concurrency, DB lifecycle #178

@malon64

Description

@malon64

Summary

Harden AWS Glue catalog support for Iceberg beyond the initial MVP.

Context

Glue catalog support exists, and non-Iceberg table collisions are now rejected. Production usage still needs stronger guardrails.

Topics to cover

  • Table ownership / managed-by-Floe markers vs externally managed tables
  • Explicit takeover mode (opt-in only)
  • Concurrent updates / version conflicts / retry strategy
  • Database existence policy (create vs fail fast)
  • Better diagnostics for IAM/permissions failures

Acceptance criteria

  • Design/spec with clear safety defaults
  • Incremental implementation issues or PR plan

Related: #157

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:storageStorages (local/s3/adls/gcs)enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions