Skip to content

Add tabular interchange core - #45

Merged
timkpaine merged 1 commit into
mainfrom
feat/interchange-core
Jul 15, 2026
Merged

timkpaine merged 1 commit into
mainfrom
feat/interchange-core

Conversation

@timkpaine

@timkpaine timkpaine commented Jul 14, 2026 •

Copy link
Copy Markdown
Member
  • add Rust and Python Arrow interchange planning with exact, projection, compatible, and coerce schema policies
  • add Arrow IPC, Parquet, CSV, and JSONL codecs with bounded lazy streaming and cancellation
  • organize public documentation as tutorial, how-to, explanation, and API reference
  • build an abi3 Python extension and exercise the Rust core in project checks

Signed-off-by: Tim Paine <3105306+timkpaine@users.noreply.github.com>
@timkpaine
timkpaine force-pushed the feat/interchange-core branch from bc3c11c to 1e550b2 Compare July 14, 2026 23:37
@github-actions

Copy link
Copy Markdown
Contributor

Test Results

31 tests  +30   31 ✅ +30   0s ⏱️ ±0s
 1 suites ± 0    0 💤 ± 0 
 1 files   ± 0    0 ❌ ± 0 

Results for commit 1e550b2. ± Comparison against base commit b06643c.

This pull request removes 1 and adds 31 tests. Note that renamed tests count towards both.
fsspec_data.tests.test_all ‑ test_all
fsspec_data.tests.test_all ‑ test_arrow_codec_declares_capabilities
fsspec_data.tests.test_all ‑ test_arrow_codec_requires_schema_for_empty_stream
fsspec_data.tests.test_all ‑ test_arrow_ipc_round_trip_preserves_empty_stream_schema
fsspec_data.tests.test_all ‑ test_arrow_ipc_round_trip_preserves_schema_and_batch_boundaries
fsspec_data.tests.test_all ‑ test_coerce_applies_runtime_checked_cast
fsspec_data.tests.test_all ‑ test_coerce_checks_nullable_to_required_at_runtime
fsspec_data.tests.test_all ‑ test_coerce_rejects_unregistered_cast
fsspec_data.tests.test_all ‑ test_compatible_rejects_lossy_cast
fsspec_data.tests.test_all ‑ test_compatible_widens_type_and_nullability
fsspec_data.tests.test_all ‑ test_exact_rejects_nullability_widening
…

@codecov

codecov Bot commented Jul 14, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 97.89157% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 91.08%. Comparing base (b06643c) to head (1e550b2).

Files with missing lines Patch % Lines
fsspec_data/interchange.py 95.00% 4 Missing and 3 partials ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##             main      #45       +/-   ##
===========================================
+ Coverage   16.66%   91.08%   +74.41%     
===========================================
  Files           8        9        +1     
  Lines          30      359      +329     
  Branches        2       12       +10     
===========================================
+ Hits            5      327      +322     
- Misses         25       29        +4     
- Partials        0        3        +3     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@timkpaine
timkpaine merged commit 7f787e9 into main Jul 15, 2026
4 checks passed
@timkpaine
timkpaine deleted the feat/interchange-core branch July 15, 2026 02:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

1 participant