Skip to content

refactor: construct historical Iceberg fixtures in tests - #702

Open
alexanderbianchi wants to merge 1 commit into
codex/iceberg-runtime-metadatafrom
codex/iceberg-time-travel-regression
Open

refactor: construct historical Iceberg fixtures in tests#702
alexanderbianchi wants to merge 1 commit into
codex/iceberg-runtime-metadatafrom
codex/iceberg-time-travel-regression

Conversation

@alexanderbianchi

@alexanderbianchi alexanderbianchi commented Sep 5, 2026

Copy link
Copy Markdown
Collaborator

Stacked on #700, rebased onto iceberg-0.10 at 6507bf8 after #687 merged.

Strengthens #687's existing selected-snapshot test rather than adding a duplicate. A test-local helper uses native Iceberg builders to add snapshot 42 while leaving the original taxi snapshot current. The completed metadata and iceberg.snapshot_id = 42 are supplied through #700's generic harness inputs.

The test now passes with Exact(42) rows and Exact(4242) bytes, distinguishing the selected snapshot from the current snapshot's 175000 rows. The obsolete TODO has been removed; no production statistics changes are included.

The summary totals are deliberately synthetic. The manifest still describes the original taxi data, so this fixture tests statistics planning rather than executing a 42-row scan. This limitation is documented beside its construction.

Validation:

  • cargo test -p datafusion-distributed-iceberg --locked — 90 tests passed, including all 15 statistics tests and the doctest
  • cargo fmt --all -- --check
  • git diff --check

@alexanderbianchi
alexanderbianchi force-pushed the codex/iceberg-time-travel-regression branch from 8119b08 to ec92d04 Compare September 5, 2026 20:52
@alexanderbianchi alexanderbianchi changed the title refactor: support historical Iceberg snapshot fixtures refactor: construct historical Iceberg fixtures in tests Sep 5, 2026
@alexanderbianchi
alexanderbianchi force-pushed the codex/iceberg-runtime-metadata branch from 71a906b to 3445b6a Compare September 5, 2026 21:22
@alexanderbianchi
alexanderbianchi force-pushed the codex/iceberg-time-travel-regression branch 2 times, most recently from 93f3c00 to 99c8032 Compare September 5, 2026 22:57
@alexanderbianchi
alexanderbianchi force-pushed the codex/iceberg-time-travel-regression branch from 99c8032 to 6c531ec Compare September 6, 2026 00:18
@alexanderbianchi
alexanderbianchi force-pushed the codex/iceberg-runtime-metadata branch from 158065b to cdf47f7 Compare September 6, 2026 00:18
@alexanderbianchi
alexanderbianchi marked this pull request as ready for review September 7, 2026 14:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant