Skip to content

Send owners and metadata when refreshing a materialization - #2443

Open
shangyian wants to merge 1 commit into
mainfrom
fix-refresh-materialization-attribution
Open

Send owners and metadata when refreshing a materialization#2443
shangyian wants to merge 1 commit into
mainfrom
fix-refresh-materialization-attribution

Conversation

@shangyian

@shangyian shangyian commented Aug 21, 2026

Copy link
Copy Markdown
Collaborator

Summary

Refreshing a cube's materializations builds its payload by hand rather than going through DruidCubeMaterializationJob, and that payload doesn't include owners or custom metadata.

Test Plan

  • PR has an associated issue: #
  • make check passes
  • make test shows 100% unit test coverage

Deployment Plan

@netlify

netlify Bot commented Aug 21, 2026

Copy link
Copy Markdown

Deploy Preview for thriving-cassata-78ae72 canceled.

Name Link
🔨 Latest commit 9ca37d0
🔍 Latest deploy log https://app.netlify.com/projects/thriving-cassata-78ae72/deploys/6a88540202ccb100083e44e9

Refreshing a cube's materializations builds its payload by hand rather than
going through DruidCubeMaterializationJob, and that hand-built payload carried
none of the node's attribution: no owners, no custom metadata. The query
service uses those to work out who owns the resulting Maestro workflow and
which data project it belongs to, so a refresh arrived with nothing to
attribute the workflow to and failed. Because the refresh endpoint catches
per-materialization exceptions and moves on, the caller saw a 200 with an
empty list of URLs and no sign anything had gone wrong.

Both paths now build their owners through a shared principal_refs helper and
send the same custom metadata, so the attribution cannot drift between them.
@shangyian
shangyian force-pushed the fix-refresh-materialization-attribution branch from 083f0aa to 9ca37d0 Compare August 21, 2026 13:34
@shangyian
shangyian marked this pull request as ready for review August 21, 2026 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant