You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Spike: iceberg-rust against morca's catalog, summary keys and pinned reads #520
A Rust pipeline has to commit to and read morca's tables exactly as morca.tables does. Check whether the Rust Iceberg ecosystem can do that without any Mojo.
Questions
Catalog: morca's filesystem catalog commits by writing each metadata version under a unique name and listing the directory for a clash, on local disk and on S3. Can iceberg-rust (or a small Rust catalog on top of object_store) commit the same way, and can both sides commit to one table without corrupting it?
Summary properties: can a commit carry the orca.* snapshot summary keys, and can those be read back when walking snapshots newest first (find_commit)?
Pinned reads: can a scan be pinned to a snapshot id (use_snapshot)?
Writes: Parquet written by arrow-rs/parquet, with the partition spec and the schema evolution morca uses. Can the Mojo reader read it, and the other way round?
There's a written answer for each question, with a small Rust program that commits to a table the Mojo side then reads, and the reverse, on local disk and on MinIO.
Answered in spikes/iceberg-rust/README.md (PR #529): yes, iceberg-rust 0.11 with a small catalog commits to and reads morca's tables both ways, on disk and on MinIO, with no Mojo. The liblake fallback isn't needed. Gaps for #521: no overwrite/delete transaction in iceberg-rust 0.11 (replaces=), and arrow 58 vs 60 between iceberg and morca-worker.
Activity
winding-lines commentedon Nov 17, 2026
Tracked in #522.
Spike: iceberg-rust against morca's catalog, summary keys and pinned …
winding-lines commentedon Nov 17, 2026
Answered in spikes/iceberg-rust/README.md (PR #529): yes, iceberg-rust 0.11 with a small catalog commits to and reads morca's tables both ways, on disk and on MinIO, with no Mojo. The liblake fallback isn't needed. Gaps for #521: no overwrite/delete transaction in iceberg-rust 0.11 (replaces=), and arrow 58 vs 60 between iceberg and morca-worker.
morca-sdk: whole pipelines in Rust, with no Mojo toolchain (#521) (#533)