You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Filesystem catalog: don't rely on a directory listing being complete on local disk #531
morca's local-disk commit detects a clash by listing the metadata directory, and assumes the listing is complete. The spike's Rust catalog lost 10 commits in 40 rounds of 8 writers when it listed with object_store's local walk, and none with one plain readdir. morca (iceberg-mojo) lost none in 40 rounds, but nothing in POSIX guarantees a readdir sees an entry created concurrently. Consider an atomic claim instead: create the next metadata file with O_EXCL (or link(2)) and treat EEXIST as the clash.
Found in the iceberg-rust spike (#520, spikes/iceberg-rust/README.md, PR #529).
Activity