Skip to content

stats sampling doesn't work properly in case of partition pruning #1032

Description

@phofl

The files used for sampling and the filtered files might get out of sync resulting in weird errors. see https://github.com/dask/dask-expr/pull/1029/files#r1568572292 for a crude fix that we should make better.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions