Skip to content

feat: allow pinning the pipeline role with spec.role - #283

Open
stigglor wants to merge 1 commit into
kaasops:mainfrom
stigglor:role-override
Open

feat: allow pinning the pipeline role with spec.role#283
stigglor wants to merge 1 commit into
kaasops:mainfrom
stigglor:role-override

Conversation

@stigglor

Copy link
Copy Markdown
Contributor

Adds an optional spec.role to VectorPipeline and ClusterVectorPipeline that picks
which Vector the pipeline goes to, instead of inferring it from the source types.

Inference classifies every source against two hardcoded lists, so a type on neither list
fails the pipeline, a type on both can never reach an aggregator, and #218 reports adding
an unused source purely to flip the result. Unset keeps the current behavior, and leaves
the config hash untouched so pipelines do not re-reconcile on upgrade.

An aggregator pipeline in a namespace may no longer use a source that reads the node
(kubernetes_logs, file, journald, docker_logs, host_metrics), which the shared
aggregator collects across namespaces. Mixing one of those with a network source already
routed to the aggregator, so such a pipeline goes invalid on upgrade. Move it to a
ClusterVectorPipeline, or leave the host sources on the agent.

Closes #218

Adds an optional `spec.role` to `VectorPipeline` and `ClusterVectorPipeline` that picks
which Vector the pipeline goes to, instead of inferring it from the source types.

Inference classifies every source against two hardcoded lists, so a type on neither list
fails the pipeline, a type on both can never reach an aggregator, and kaasops#218 reports adding
an unused source purely to flip the result. Unset keeps the current behavior, and leaves
the config hash untouched so pipelines do not re-reconcile on upgrade.

An aggregator pipeline in a namespace may no longer use a source that reads the node
(`kubernetes_logs`, `file`, `journald`, `docker_logs`, `host_metrics`), which the shared
aggregator collects across namespaces. Mixing one of those with a network source already
routed to the aggregator, so such a pipeline goes invalid on upgrade. Move it to a
ClusterVectorPipeline, or leave the host sources on the agent.

Closes kaasops#218
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add configurable for pipeline role selection

1 participant