Track icegatetech/iceberg-rust fork dependencies

[frisbeeman]

Summary

IceGate depends on a fork of apache/iceberg-rust located at icegatetech/iceberg-rust. This issue tracks the fork usage and upstream integration plan.

Current State

• Upstream repo: apache/iceberg-rust
• Fork repo: icegatetech/iceberg-rust
• Fork branch: develop (contains our changes, continuously rebased on upstream main)
• Fork rev: f1ba3920de5fb7494ef3f83be495d2de43e230e9

Required Patches

The fork contains the following patches not yet available upstream:

1. DataFusion 51 + Arrow 57 compatibility - Upstream PR #1830 was closed; our fork maintains this upgrade
2. Memory catalog builder enhancements - Additional features for in-memory catalog testing

Upstream Integration Plan

• Monitor upstream for DataFusion 51 support (blocked on upstream release cycle)
• Contribute patches back where applicable
• Switch to upstream once DataFusion 51 is officially supported

Maintenance Strategy

• Branch: develop branch contains our changes
• Rebase frequency: Continuous sync with upstream main
• Responsible party: IceGate maintainers
• Regression testing: Run make ci after each rebase

Related

• See Cargo.toml lines 64-70 for dependency declarations
• See CONTRIBUTING.md section "Third-party fork: icegatetech/iceberg-rust"
• Upstream DataFusion 51 PR: test: upgrade DataFusion 51 and Arrow 57 apache/iceberg-rust#1830

[coderabbitai]

📝 CodeRabbit Plan Mode

Generate an implementation plan and prompts that you can use with your favorite coding agent.

• Create Plan

Examples

• Example 1
• Example 2

---

🔗 Similar Issues

Related Issues

• ☂️ [Ingest] Service Implementation #1
• Optimize Datasource Node for Iceberg Tables #10

👤 Suggested Assignees

• frisbeeman

---

🧪 Issue enrichment is currently in open beta.

You can configure auto-planning by selecting labels in the issue_enrichment configuration.

To disable automatic issue enrichment, add the following to your .coderabbit.yaml:

issue_enrichment:
  auto_enrich:
    enabled: false

💬 Have feedback or questions? Drop into our discord or schedule a call!