Skip to content

Commits on MinIO: 8 concurrent writers run out of commit retries #532

Open

Description

@winding-lines

In the spike's race test on MinIO, 8 Mojo writers to one table exhausted their commit retries 58 times in 160 writes. Nothing was lost, because the step's next attempt commits, but each one costs a whole step attempt. Look at the retry count and backoff (jitter) for object-store catalogs, and whether listing by key prefix (which the spike found reliable on MinIO) is what morca uses.

Found in the iceberg-rust spike (#520, spikes/iceberg-rust/README.md, PR #529).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions