From 97898c82b0f455b4066dd0dc2286208900787f30 Mon Sep 17 00:00:00 2001 From: Efra Espada Date: Thu, 19 Nov 2026 21:15:35 +0100 Subject: [PATCH 1/3] chore-980-make-the-bugbot-approval-receipt-producer-trust-boundary-explicit-and-reproducible: audit packaged producer trust assumptions (#980) --- docs/bugbot/quality-observability.mdx | 15 ++ docs/pull-requests/guarded-approval.mdx | 21 ++ package.json | 2 +- quality/bugbot/evidence/issue-980/README.md | 71 +++++++ .../bugbot/evidence/issue-980/attempt-1.jsonl | 1 + .../evidence/issue-980/attempt-1.log.gz | Bin 0 -> 244 bytes .../bugbot/evidence/issue-980/attempt-2.jsonl | 16 ++ .../evidence/issue-980/attempt-2.log.gz | Bin 0 -> 90 bytes .../evidence/issue-980/packaged-trust.cjs | 198 ++++++++++++++++++ .../issue-980/packaged-trust.test.cjs | 29 +++ .../bugbot/evidence/issue-980/summary.json | 183 ++++++++++++++++ specs/CATALOG.md | 8 +- specs/catalog.json | 9 +- specs/guarded-pull-request-approval.md | 33 +++ 14 files changed, 578 insertions(+), 8 deletions(-) create mode 100644 quality/bugbot/evidence/issue-980/README.md create mode 100644 quality/bugbot/evidence/issue-980/attempt-1.jsonl create mode 100644 quality/bugbot/evidence/issue-980/attempt-1.log.gz create mode 100644 quality/bugbot/evidence/issue-980/attempt-2.jsonl create mode 100644 quality/bugbot/evidence/issue-980/attempt-2.log.gz create mode 100644 quality/bugbot/evidence/issue-980/packaged-trust.cjs create mode 100644 quality/bugbot/evidence/issue-980/packaged-trust.test.cjs create mode 100644 quality/bugbot/evidence/issue-980/summary.json diff --git a/docs/bugbot/quality-observability.mdx b/docs/bugbot/quality-observability.mdx index c53b8c141..30ea58588 100644 --- a/docs/bugbot/quality-observability.mdx +++ b/docs/bugbot/quality-observability.mdx @@ -1049,3 +1049,18 @@ Future qualification plans also pin the actual prepared executable's digest and any launcher artifact. A version string alone cannot admit a model call. Record and check the runtime proof for every corpus invocation; frozen campaigns continue to replay through their own preregistration commits. + +## Producer identity and receipt truth + +A native receipt's matching run/App/SHA/artifact context is distinct from +independent evidence of the producer's executed code. The bounded #980 audit +runs the real packaged approval consumer with fabricated current receipts. Three +protected edits remain `protected-path` with no approval attempts while every +head read stays current; invalid run/SHA/App/policy/attempt and human/rollback +controls retain their existing decisions. Its positive cases use only a local +fake service, with no real GitHub write or qualification model call. + +Establish the reviewed producer revision and acceptable independent trust before +any future enforced adoption. An artifact match or passing fake receipt case +cannot qualify a model profile or authorize activation. No new attestation +system or production policy is enabled here. diff --git a/docs/pull-requests/guarded-approval.mdx b/docs/pull-requests/guarded-approval.mdx index 96ff0d712..dc267ab15 100644 --- a/docs/pull-requests/guarded-approval.mdx +++ b/docs/pull-requests/guarded-approval.mdx @@ -248,3 +248,24 @@ Without a job-local token, the historical PAT-only path remains available for credentials that support Checks; it cannot convert a denied read into approval. GitHub documents the fine-grained PAT limitation in [Managing personal access tokens](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/managing-your-personal-access-tokens#fine-grained-personal-access-tokens-limitations). + +## Receipt producer trust + +The receipt consumer authenticates the run, repository, attempt, SHA, App, +artifact and recorded custom check ID. A matching artifact is data provenance; +it does not independently establish which executable producer ran or whether a +fabricated clean result is truthful. The existing operator producer declaration +is a trust assumption, not an independent code attestation. + +The [#980 packaged audit](https://github.com/vypdev/copilot/issues/980) keeps the +head current and fabricates clean current receipts. Fixed exclusions still +return `protected-path` for bundle, workflow and `action.yml` edits, with zero +approval attempts; foreign and stale receipt contexts also withhold approval. +Human decisions and same-SHA policy/rollback fences remain in force. These are +local fake-provider observations, not live approvals or profile qualification. + +Before any future enforced profile, the operator must establish the exact +reviewed workflow/executable revision and acceptable producer trust outside +candidate-controlled artifact assertions. That prerequisite is not supplied by +this audit. A stronger attestation design would need its own SDD review; none is +automatically introduced or enabled. Production verification remains disabled. diff --git a/package.json b/package.json index 4c7247b20..2b6145953 100644 --- a/package.json +++ b/package.json @@ -69,7 +69,7 @@ "test": "jest", "test:watch": "jest --watch", "test:coverage": "jest --coverage --json --outputFile=coverage/setup-acceptance-jest.json && node scripts/validate-coverage-budgets.cjs && node scripts/validate-setup-assistant-acceptance.cjs coverage/setup-acceptance-jest.json && pnpm run test:extension", - "test:bugbot-shadow-verification": "node --test quality/bugbot/evidence/issue-950/shadow-verification/verification.test.cjs quality/bugbot/evidence/issue-950/normal-flow-shadow/config.test.cjs quality/bugbot/evidence/issue-950/normal-flow-shadow/paths.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/launch-full-review.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/review-runtime.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/score-review.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/plan.test.cjs quality/bugbot/evidence/issue-950/status-card-publication/publisher.test.cjs", + "test:bugbot-shadow-verification": "node --test quality/bugbot/evidence/issue-950/shadow-verification/verification.test.cjs quality/bugbot/evidence/issue-950/normal-flow-shadow/config.test.cjs quality/bugbot/evidence/issue-950/normal-flow-shadow/paths.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/launch-full-review.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/review-runtime.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/score-review.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/plan.test.cjs quality/bugbot/evidence/issue-950/status-card-publication/publisher.test.cjs quality/bugbot/evidence/issue-980/packaged-trust.test.cjs", "eval:bugbot": "jest src/tooling/__tests__/bugbot_quality_eval.test.ts src/tooling/__tests__/bugbot_benchmark.test.ts src/tooling/__tests__/bugbot_request_transform_evidence.test.ts --runInBand", "typecheck": "tsc --noEmit && pnpm run typecheck:extension", "metrics:architecture": "node scripts/collect-architecture-metrics.cjs", diff --git a/quality/bugbot/evidence/issue-980/README.md b/quality/bugbot/evidence/issue-980/README.md new file mode 100644 index 000000000..456c53ef4 --- /dev/null +++ b/quality/bugbot/evidence/issue-980/README.md @@ -0,0 +1,71 @@ +# Approval receipt producer trust — #980 + +The existing packaged approval consumer passes **14 controlled cases** against +only a loopback fake GitHub service. This audit changes no production approval +code or policy. The application baseline is ccefb27627cd627ccdb7d5666fd174c2ac1da07b; +its exact Action bundle and this driver's SHA-256 are in attempt-2.jsonl and +summary.json. Node v24.20.0 / macOS arm64 is the executed environment; no other +OS, model profile or installed default workflow is claimed. + +## Exact trust claim + +Authenticated run/repository/SHA/App/artifact/check identities bind a receipt to +its declared native context. They do not independently attest the executable +producer, its actual checkout, or the truth of a fabricated clean result. The +fixture deliberately supplies a syntactically clean current receipt. The custom +Review check may be in a different suite, as the existing contract permits; +its exact ID is bound through the authoritative run artifact. + +The guarded policy's fixed protected-path decision independently prevents +approval when build/**, the workflow or action.yml changes. All head readbacks +remain current, so the result does not depend on a later stale-head fence. +An operator-attested/configured producer is still a trust assumption. Before a +future enforced profile, maintainers must establish the exact reviewed workflow +and executable revision and an execution context whose producer trust is +acceptable independently of candidate-controlled artifact contents. This audit +supplies no new code attestation or externally enforced control. If that +prerequisite needs an architecture/policy change, review its SDD first. + +The current qualification campaigns are still unsuccessful. These fabricated +receipts are not model measurements, independent model oracles or authority to +activate any profile. Actual production verification remains disabled. + +## Executed matrix + +| Cases | Observed result | +| --- | --- | +| Changed build bundle, source workflow, action.yml | recommend / protected-path; zero approval attempts in every case | +| Foreign receipt run, foreign SHA, foreign App | pending / bugbot-missing; zero approval attempts | +| Foreign artifact run | blocked / evidence-unavailable; zero approval attempts | +| Prior policy/generation, prior attempt | pending / bugbot-missing at the same head; zero approval attempts | +| Ordinary current authorized producer data | One fake approval, observed back at the exact head | +| Rollback with stale same-head receipt | pending / bugbot-missing; zero approval attempts | +| Rollback with fresh current disabled-mode receipt | One fake approval with current policy identity | +| Existing human approval / changes requested | recommend / human-approved, or blocked / changes-requested; no competing approval | + +Every observed head remains fixed and every case publishes its assessment to +the fake service. Local fake assessment/approval POSTs are intentionally counted +in the ledger; they are not writes to a real evaluated PR. There are **zero real +GitHub write attempts, zero qualification model calls and no production-mode +change**. The authority stays disabled; a stale enforced receipt is only a +negative data fixture. No human decision or verified real review is modified. + +The first attempt could not bind localhost inside the sandbox and executed no +case. Its start ledger and error are retained. After permitting only this local +test execution, all 14 cases passed. The reusable Node test wrapper also passed. +Three existing consumer/domain/use-case Jest suites pass **236 tests**, retaining +the same-SHA policy, latest-attempt and rollback controls. Those existing counts +are not added again to the 14 packaged scenarios. + +Run: + +```bash +node quality/bugbot/evidence/issue-980/packaged-trust.cjs build/github_action/index.js /absolute/new-attempt.jsonl +node --test quality/bugbot/evidence/issue-980/packaged-trust.test.cjs +``` + +Each attempt requires a new ledger path and records the package/driver/runtime +identity before cases. The existing shadow-verification script includes the +wrapper for CI. The old #950 rollback script and its historical artifacts remain +unchanged. This result preserves the refuted broad approval-exploit claim as +refuted; it documents the narrower producer-trust limitation. diff --git a/quality/bugbot/evidence/issue-980/attempt-1.jsonl b/quality/bugbot/evidence/issue-980/attempt-1.jsonl new file mode 100644 index 000000000..4e92ef14a --- /dev/null +++ b/quality/bugbot/evidence/issue-980/attempt-1.jsonl @@ -0,0 +1 @@ +{"event":"start","at":"2026-11-19T19:47:11.588Z","node":"v24.20.0","platform":"darwin","architecture":"arm64","sourceBaseline":"ccefb27627cd627ccdb7d5666fd174c2ac1da07b","bundleSha256":"c5fe206b2027c951b4f22c64d210ea540b6777eee3c7cd754ba944a771f0f0e6","driverSha256":"ee5cf50d010603b2430151a3074aef95a9065bc66b83d72a2787acfb3bc36f0f","authority":{"mode":"disabled","generation":2,"policyDigest":"2222222222222222222222222222222222222222222222222222222222222222","workflowId":31,"sourceAppId":12},"fixturePolicy":"guarded","realGitHubWriteAttempts":0,"qualificationModelCalls":0} diff --git a/quality/bugbot/evidence/issue-980/attempt-1.log.gz b/quality/bugbot/evidence/issue-980/attempt-1.log.gz new file mode 100644 index 0000000000000000000000000000000000000000..3005d1d8a82f41526954499f7059366521f4a1d8 GIT binary patch literal 244 zcmV+m?LWlUJ?>?kKOJ;L+p`F@{xdIf?T}&l+Zz=HdUQ>Q$SuO z!4vW)awV9C{(e&28gc>Q#R%+Ysd|MoiVihl(yFbMR?YcQFe7(#6NY@@|KwHM>PDT& zzlZf&>CG|jIa(B{mh;)$gItr_;TziV2eK$VWj&d&TEJB@a@c;}c<=<7~{~X+CA~Q~UxG?JuQT0RRA|x^or) literal 0 HcmV?d00001 diff --git a/quality/bugbot/evidence/issue-980/attempt-2.jsonl b/quality/bugbot/evidence/issue-980/attempt-2.jsonl new file mode 100644 index 000000000..21019a642 --- /dev/null +++ b/quality/bugbot/evidence/issue-980/attempt-2.jsonl @@ -0,0 +1,16 @@ +{"event":"start","at":"2026-11-19T19:47:34.033Z","node":"v24.20.0","platform":"darwin","architecture":"arm64","sourceBaseline":"ccefb27627cd627ccdb7d5666fd174c2ac1da07b","bundleSha256":"c5fe206b2027c951b4f22c64d210ea540b6777eee3c7cd754ba944a771f0f0e6","driverSha256":"ee5cf50d010603b2430151a3074aef95a9065bc66b83d72a2787acfb3bc36f0f","authority":{"mode":"disabled","generation":2,"policyDigest":"2222222222222222222222222222222222222222222222222222222222222222","workflowId":31,"sourceAppId":12},"fixturePolicy":"guarded","realGitHubWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-bundle","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-workflow","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-action","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-receipt-run","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-artifact-run","expected":"blocked (evidence-unavailable)","decision":"blocked (evidence-unavailable)","publication":"published","status":1,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approval blocked\n**Status:** Approval evidence is unavailable; inspect the causal diagnostic in the observer Job Summary\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Fix the named prerequisite and rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: evidence\\-unavailable.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nImpact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).\nError code: provider.contract-invalid\nAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.\nRetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.\nRetryable: No\nReference: 9212911f-b75a-4ed4-bf0e-9064628fe28a\nPR #42: blocked (evidence-unavailable); assessment published.\nApproval evidence read failed (bugbot-artifacts, artifact-unavailable).\n::error::Impact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).%0AError code: provider.contract-invalid%0AAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.%0ARetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.%0ARetryable: No%0AReference: 9212911f-b75a-4ed4-bf0e-9064628fe28a\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-sha","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-app","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"prior-policy","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"prior-attempt","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"authorized-current","expected":"already-approved (approved)","decision":"already-approved (approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":1,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/pulls/42/reviews","body":{"event":"APPROVE","commit_id":"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa","body":"\nCopilot approved this revision (aaaaaaa) after its configured CI and coverage gates passed and Bugbot reported no blocking findings. GitHub still applies branch rules. Configure a separate human-review requirement if needed; a bot approval may count toward a generic approval minimum."}},{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approved by the bot\n**Status:** The bot approved this revision; GitHub still applies the configured branch rules\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** None; GitHub still applies its review rules.\n**Impact:** A native review exists for this revision; the PR was not merged.\n[Open approval](https://github.com/fixture/producer-trust/pull/42#pullrequestreview-301) · [See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: approved.\n\n
"}}],"pullReads":4,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: already-approved (approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"rollback-stale-same-sha","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"rollback-fresh-same-sha","expected":"already-approved (approved)","decision":"already-approved (approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":1,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/pulls/42/reviews","body":{"event":"APPROVE","commit_id":"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa","body":"\nCopilot approved this revision (aaaaaaa) after its configured CI and coverage gates passed and Bugbot reported no blocking findings. GitHub still applies branch rules. Configure a separate human-review requirement if needed; a bot approval may count toward a generic approval minimum."}},{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approved by the bot\n**Status:** The bot approved this revision; GitHub still applies the configured branch rules\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** None; GitHub still applies its review rules.\n**Impact:** A native review exists for this revision; the PR was not merged.\n[Open approval](https://github.com/fixture/producer-trust/pull/42#pullrequestreview-301) · [See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: approved.\n\n
"}}],"pullReads":4,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: already-approved (approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"human-approved","expected":"recommend (human-approved)","decision":"recommend (human-approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A human has already approved this revision\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: human\\-approved.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (human-approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"human-changes-requested","expected":"blocked (changes-requested)","decision":"blocked (changes-requested)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approval blocked\n**Status:** A human reviewer requested changes\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Fix the named prerequisite and rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: changes\\-requested.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: blocked (changes-requested); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"finish","passed":14,"cases":14,"actualProductionModeChanged":false,"realGitHubWriteAttempts":0,"qualificationModelCalls":0} diff --git a/quality/bugbot/evidence/issue-980/attempt-2.log.gz b/quality/bugbot/evidence/issue-980/attempt-2.log.gz new file mode 100644 index 0000000000000000000000000000000000000000..9d918b4789159126a121ef4363611533cf887773 GIT binary patch literal 90 zcmb2|=3oE;rvI!54fz@rcvvsoO)lBC=$PY9U*#hS2h2Vd8s5A6JwV(CGp}Bs|HK_=A^' } }; + if (scenario.foreignApp) check.app.id = 13; + const ciCheck = { id: 102, name: 'Fixture CI', app: { id: 12 }, head_sha: merge, status: 'completed', conclusion: 'success' }; + const run = { id: 82, name: 'Review', workflow_id: 31, check_suite_id: 51, head_sha: head, + status: 'completed', conclusion: 'success', run_attempt: 1, pull_requests: [{ number: pr }] }; + const ciRun = { id: 83, name: 'CI', head_sha: merge, status: 'completed', conclusion: 'success', run_attempt: 1 }; + const state = { pullHeads: [], mutations: [], comments: [], reviews: scenario.human ? [{ + id: 300, user: { id: 11 }, state: scenario.human, commit_id: head, submitted_at: '2026-11-19T10:00:00Z', + }] : [] }; + return { state, respond(url, method, body) { + const resource = decodeURIComponent(url.pathname); + const reply = (body, status = 200) => ({ body, status }); + if (method !== 'GET') { + state.mutations.push({ method, resource, body }); + if (method === 'POST' && resource === prefix + '/pulls/42/reviews') { + assert.equal(body.event, 'APPROVE'); assert.equal(body.commit_id, head); + const review = { id: 301, user: { id: 10 }, state: 'APPROVED', commit_id: head, submitted_at: '2026-11-19T11:00:00Z' }; + state.reviews.push(review); return reply(review, 201); + } + if (method === 'POST' && resource === prefix + '/issues/42/comments') { + const comment = { id: 501, user: { id: 10 }, body: body.body }; + state.comments.push(comment); return reply(comment, 201); + } + throw new Error('Unexpected mutation'); + } + if (resource === prefix + '/actions/variables/PR_APPROVAL_POLICY') return reply({ value: JSON.stringify(policy) }); + if (resource === prefix + '/pulls/42') { + state.pullHeads.push(pull.head.sha); return reply(pull); + } + if (resource === prefix + '/git/ref/heads/develop') return reply({ ref: 'refs/heads/develop', object: { type: 'commit', sha: base } }); + if (resource === prefix + '/git/commits/' + merge) return reply({ parents: [{ sha: base }, { sha: head }] }); + if (resource === prefix + '/pulls/42/files') return reply([{ filename: scenario.path ?? 'src/fixture.ts' }]); + if (resource === prefix + '/pulls/42/reviews') return reply(state.reviews); + if (resource === prefix + '/issues/42/comments') return reply(state.comments); + if (resource === prefix + '/commits/' + head + '/check-runs') return reply({ total_count: 1, check_runs: [check] }); + if (resource === prefix + '/commits/' + merge + '/check-runs') return reply({ total_count: 1, check_runs: [ciCheck] }); + if (resource === prefix + '/actions/runs') return reply({ total_count: 1, workflow_runs: [url.searchParams.get('head_sha') === head ? run : ciRun] }); + if (resource === prefix + '/actions/runs/82/artifacts') return reply({ total_count: 1, + artifacts: [{ id: 700, name: 'copilot-bugbot-verification-v1-82-1', + expired: false, size_in_bytes: 2000, workflow_run: { id: scenario.foreignArtifactRun ? 99 : 82, repository_id: repositoryId, + head_repository_id: repositoryId, head_sha: head } }] }); + if (resource === prefix + '/actions/artifacts/700/zip') return reply(receiptZip({ + version: 1, runId: 82, attempt: 1, + checkRunId: check.id, receipt: check.output.summary, + })); + if (resource === prefix + '/actions/runs/83/attempts/1/jobs') return reply({ total_count: 1, jobs: [{ check_run_url: 'https://api.github.com/repos/' + ownerRepo + '/check-runs/102' }] }); + if (resource === prefix + '/rules/branches/develop') return reply([{ type: 'pull_request', parameters: { dismiss_stale_reviews_on_push: true } }]); + if (resource === prefix + '/branches/develop/protection') return reply({ message: 'Not found' }, 404); + if (resource === '/user') return reply({ id: 10 }); + console.error('UNEXPECTED FIXTURE ROUTE', resource); + throw new Error('Unknown fixture read'); + } }; +} + +const cases = [ + { id: 'protected-bundle', path: 'build/github_action/index.js', decision: 'recommend (protected-path)' }, + { id: 'protected-workflow', path: '.github/workflows/copilot_pull_request.yml', decision: 'recommend (protected-path)' }, + { id: 'protected-action', path: 'action.yml', decision: 'recommend (protected-path)' }, + { id: 'foreign-receipt-run', receipt: { runId: 99 }, decision: 'pending (bugbot-missing)' }, + { id: 'foreign-artifact-run', foreignArtifactRun: true, decision: 'blocked (evidence-unavailable)', exit: 1 }, + { id: 'foreign-sha', receipt: { headSha: 'd'.repeat(40) }, decision: 'pending (bugbot-missing)' }, + { id: 'foreign-app', foreignApp: true, decision: 'pending (bugbot-missing)' }, + { id: 'prior-policy', receipt: { policyDigest: '1'.repeat(64), generation: 1 }, decision: 'pending (bugbot-missing)' }, + { id: 'prior-attempt', receipt: { attempt: 2 }, decision: 'pending (bugbot-missing)' }, + { id: 'authorized-current', decision: 'already-approved (approved)', approvals: 1 }, + { id: 'rollback-stale-same-sha', receipt: { mode: 'enforced', policyDigest: '1'.repeat(64), generation: 1 }, decision: 'pending (bugbot-missing)' }, + { id: 'rollback-fresh-same-sha', decision: 'already-approved (approved)', approvals: 1 }, + { id: 'human-approved', human: 'APPROVED', decision: 'recommend (human-approved)' }, + { id: 'human-changes-requested', human: 'CHANGES_REQUESTED', decision: 'blocked (changes-requested)' }, +]; + +async function main() { + const bundle = fs.realpathSync(process.argv[2]); + const output = path.resolve(process.argv[3]); + fs.writeFileSync(output, '', { flag: 'wx' }); + const record = row => fs.appendFileSync(output, JSON.stringify(row) + '\n'); + const root = fs.mkdtempSync(path.join(os.tmpdir(), 'copilot-packaged-producer-trust-')); + record({ event: 'start', at: new Date().toISOString(), node: process.version, platform: process.platform, + architecture: process.arch, sourceBaseline: 'ccefb27627cd627ccdb7d5666fd174c2ac1da07b', + bundleSha256: createHash('sha256').update(fs.readFileSync(bundle)).digest('hex'), + driverSha256: createHash('sha256').update(fs.readFileSync(__filename)).digest('hex'), + authority, fixturePolicy: 'guarded', realGitHubWriteAttempts: 0, qualificationModelCalls: 0 }); + try { + const event = path.join(root, 'event.json'); + fs.writeFileSync(event, JSON.stringify({ action: 'completed', repository: { id: repositoryId }, + workflow_run: { head_repository: { id: repositoryId }, pull_requests: [{ number: pr }] } })); + for (const scenario of cases) { + const fixtureCase = fixture(scenario), violations = []; + const summary = path.join(root, scenario.id + '.md'); + fs.writeFileSync(summary, ''); + const server = createServer(async (request, response) => { + try { + const parts = []; for await (const part of request) parts.push(part); + const text = Buffer.concat(parts).toString('utf8'); + const body = text ? JSON.parse(text) : undefined; + const { body: result, status } = fixtureCase.respond(new URL(request.url, 'http://127.0.0.1'), request.method, body); + response.writeHead(status, { 'content-type': Buffer.isBuffer(result) ? 'application/zip' : 'application/json' }) + .end(Buffer.isBuffer(result) ? result : JSON.stringify(result)); + } catch (error) { + violations.push({ method: request.method, url: request.url, message: error.message }); + response.writeHead(405).end(); + } + }); + server.listen(0, '127.0.0.1'); + await once(server, 'listening'); + let stdout = '', status; + try { + const run = spawn(process.execPath, ['-e', + 'const p=require(process.argv[1]);void p.runGitHubActionEntry(()=>p.runGitHubAction(JSON.parse(process.argv[2])));', + bundle, JSON.stringify(authority)], { + cwd: root, timeout: 30_000, + env: { PATH: process.env.PATH, JEST_WORKER_ID: '1', GITHUB_REPOSITORY: ownerRepo, + GITHUB_EVENT_NAME: 'workflow_run', GITHUB_EVENT_PATH: event, GITHUB_STEP_SUMMARY: summary, + GITHUB_API_URL: 'http://127.0.0.1:' + server.address().port, + INPUT_VARS_JSON: JSON.stringify({ 'INPUT_PR-APPROVAL-OBSERVER': 'true', 'INPUT_BUGBOT-SEVERITY': 'info', + 'INPUT_BUGBOT-VERIFICATION-MODE': 'disabled', INPUT_TOKEN: 'offline-fixture-token' }) }, + }); + for (const stream of [run.stdout, run.stderr]) stream.on('data', data => { stdout += data; }); + [status] = await once(run, 'close'); + } finally { server.close(); } + const approvals = fixtureCase.state.mutations.filter(row => row.resource.endsWith('/reviews')).length; + const observed = /PR #42: ([a-z-]+ \([a-z-]+\)); assessment ([a-z-]+)\./u.exec(stdout); + const result = { event: 'case', id: scenario.id, expected: scenario.decision, decision: observed?.[1], + publication: observed?.[2], status, fakeApprovalWriteAttempts: approvals, + fakeMutations: fixtureCase.state.mutations, pullReads: fixtureCase.state.pullHeads.length, + currentHeadOnEveryRead: fixtureCase.state.pullHeads.every(value => value === head), + violations, stdout, realGitHubWriteAttempts: 0, evaluatedPrWriteAttempts: 0, qualificationModelCalls: 0 }; + record(result); + assert.deepEqual(violations, [], stdout); + assert.equal(result.decision, scenario.decision, stdout); + assert.equal(approvals, scenario.approvals ?? 0, stdout); + assert.equal(status, scenario.exit ?? 0, stdout); + assert.equal(result.currentHeadOnEveryRead, true); + assert(fixtureCase.state.pullHeads.length >= 2, 'no stale-head fence is used to stop these decisions'); + } + record({ event: 'finish', passed: cases.length, cases: cases.length, + actualProductionModeChanged: false, realGitHubWriteAttempts: 0, qualificationModelCalls: 0 }); + console.log(JSON.stringify({ passed: cases.length, output })); + } finally { fs.rmSync(root, { recursive: true, force: true }); } +} + +main().catch(error => { console.error(error); process.exitCode = 1; }); + diff --git a/quality/bugbot/evidence/issue-980/packaged-trust.test.cjs b/quality/bugbot/evidence/issue-980/packaged-trust.test.cjs new file mode 100644 index 000000000..f50ed37d4 --- /dev/null +++ b/quality/bugbot/evidence/issue-980/packaged-trust.test.cjs @@ -0,0 +1,29 @@ +'use strict'; + +const assert = require('node:assert/strict'); +const { execFileSync } = require('node:child_process'); +const fs = require('node:fs'); +const path = require('node:path'); +const { tmpdir } = require('node:os'); +const { test } = require('node:test'); + +test('packaged approval consumer preserves all fourteen producer-trust boundaries', t => { + const directory = fs.mkdtempSync(path.join(tmpdir(), 'packaged-trust-control-')); + t.after(() => fs.rmSync(directory, { recursive: true, force: true })); + const output = path.join(directory, 'attempt.jsonl'); + try { + execFileSync(process.execPath, [path.join(__dirname, 'packaged-trust.cjs'), + path.resolve(__dirname, '../../../../build/github_action/index.js'), output], { encoding: 'utf8' }); + } catch (error) { + if (fs.existsSync(output)) process.stderr.write(fs.readFileSync(output)); + throw error; + } + const rows = fs.readFileSync(output, 'utf8').trim().split('\n').map(JSON.parse); + assert.equal(rows.at(-1).passed, 14); + assert.equal(rows.at(-1).realGitHubWriteAttempts, 0); + for (const row of rows.filter(row => row.id?.startsWith('protected-'))) { + assert.equal(row.decision, 'recommend (protected-path)'); + assert.equal(row.fakeApprovalWriteAttempts, 0); + assert.equal(row.currentHeadOnEveryRead, true); + } +}); diff --git a/quality/bugbot/evidence/issue-980/summary.json b/quality/bugbot/evidence/issue-980/summary.json new file mode 100644 index 000000000..ac00b8719 --- /dev/null +++ b/quality/bugbot/evidence/issue-980/summary.json @@ -0,0 +1,183 @@ +{ + "sourceBaseline": "ccefb27627cd627ccdb7d5666fd174c2ac1da07b", + "bundleSha256": "c5fe206b2027c951b4f22c64d210ea540b6777eee3c7cd754ba944a771f0f0e6", + "driverSha256": "ee5cf50d010603b2430151a3074aef95a9065bc66b83d72a2787acfb3bc36f0f", + "node": "v24.20.0", + "platform": "darwin", + "architecture": "arm64", + "caseCount": 14, + "scope": "offline packaged approval consumer; fabricated receipts and localhost-only fake provider", + "results": [ + { + "id": "protected-bundle", + "decision": "recommend (protected-path)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "protected-workflow", + "decision": "recommend (protected-path)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "protected-action", + "decision": "recommend (protected-path)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "foreign-receipt-run", + "decision": "pending (bugbot-missing)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "foreign-artifact-run", + "decision": "blocked (evidence-unavailable)", + "publication": "published", + "status": 1, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "foreign-sha", + "decision": "pending (bugbot-missing)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "foreign-app", + "decision": "pending (bugbot-missing)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "prior-policy", + "decision": "pending (bugbot-missing)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "prior-attempt", + "decision": "pending (bugbot-missing)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "authorized-current", + "decision": "already-approved (approved)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 1, + "pullReads": 4, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "rollback-stale-same-sha", + "decision": "pending (bugbot-missing)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "rollback-fresh-same-sha", + "decision": "already-approved (approved)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 1, + "pullReads": 4, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "human-approved", + "decision": "recommend (human-approved)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + }, + { + "id": "human-changes-requested", + "decision": "blocked (changes-requested)", + "publication": "published", + "status": 0, + "fakeApprovalWriteAttempts": 0, + "pullReads": 2, + "currentHeadOnEveryRead": true, + "realGitHubWriteAttempts": 0, + "evaluatedPrWriteAttempts": 0, + "qualificationModelCalls": 0 + } + ], + "actualProductionModeChanged": false, + "independentProducerCodeAttestation": "not established", + "futureEnforcedPrerequisite": "operator must establish trusted workflow/executable revision and any required independent producer evidence; run/artifact matching alone is insufficient" +} diff --git a/specs/CATALOG.md b/specs/CATALOG.md index ab1f8e793..422ecfbe8 100644 --- a/specs/CATALOG.md +++ b/specs/CATALOG.md @@ -30,7 +30,7 @@ debt or convert unknown historic intent into a design decision. | `cli-and-single-actions` | As-built baseline | Expose bounded local commands and workflow-dispatched operations through the shared application core | [CLI and single-action execution](./cli-and-single-action-execution.md) | 51 paths · 2026-10-28 | | `configurable-issue-workflows` | Implemented | Select canonical issue workflows and explicit consumer field mappings; preserve forms, compare setup/doctor schemas, and report actionable fail-closed admission without state writes | [Configurable issue workflows and fail-closed admission](./configurable-issue-workflows-and-admission.md) | 119 paths · 2026-10-27 | | `repository-agent-collaboration` | Implemented | Generate safe repository-local profiles, guidance, and a skill for agents contributing through configured issues, Action-managed branches, pull requests, and deployment boundaries | [Repository agent collaboration contract](./repository-agent-collaboration-contract.md) | 47 paths · 2026-10-17 | -| `guarded-pull-request-approval` | Proposed | Provide revision-bound native bot approvals using validated explicit issue references, evidence gates, safe setup defaults and explainable recovery | [Guarded pull-request approval and setup readiness](./guarded-pull-request-approval.md) + 2 companion | 107 paths · 2026-11-19 | +| `guarded-pull-request-approval` | Proposed | Provide revision-bound native bot approvals using validated explicit issue references, evidence gates, safe setup defaults and explainable recovery | [Guarded pull-request approval and setup readiness](./guarded-pull-request-approval.md) + 2 companion | 110 paths · 2026-11-19 | | `github-browser-extension` | Proposed | Complete proposed desktop product: 150 required functions, local center, Action integration, shared setup and 803 product cases. H1 establishes builds; H2 implements shared runtime/session/settings/GET services and exact native-browser harnesses. Full product/core acceptance and signed delivery remain separate gates. | [Complete GitHub productivity extension and integrated Copilot setup](./github-browser-extension.md) + 13 companion | 932 paths · 2026-11-08 | ## Evidence map @@ -262,9 +262,9 @@ debt or convert unknown historic intent into a design decision. - Specifications: [`specs/guarded-pull-request-approval.md`](./guarded-pull-request-approval.md) · [`specs/guarded-pull-request-approval-setup-and-doctor.md`](./guarded-pull-request-approval-setup-and-doctor.md) · [`specs/guarded-pull-request-approval-status.md`](./guarded-pull-request-approval-status.md) - Workflows: [`.github/workflows/ci_check.yml`](../.github/workflows/ci_check.yml) · [`.github/workflows/copilot_pull_request_approval.yml`](../.github/workflows/copilot_pull_request_approval.yml) · [`setup/workflows/copilot_pull_request.yml`](../setup/workflows/copilot_pull_request.yml) · [`setup/workflows/copilot_pull_request_review_state.yml`](../setup/workflows/copilot_pull_request_review_state.yml) · [`setup/workflows/copilot_pull_request_approval.yml`](../setup/workflows/copilot_pull_request_approval.yml) - Entrypoints: [`src/actions/github_action.ts`](../src/actions/github_action.ts) · [`src/actions/pull_request_approval_action.ts`](../src/actions/pull_request_approval_action.ts) · [`src/cli/commands/setup.ts`](../src/cli/commands/setup.ts) · [`src/cli/commands/doctor.ts`](../src/cli/commands/doctor.ts) · [`src/infrastructure/composition/pull_request_status_composition_root.ts`](../src/infrastructure/composition/pull_request_status_composition_root.ts) -- Core code: [`src/domain/setup.ts`](../src/domain/setup.ts) · [`src/domain/pull_request_approval.ts`](../src/domain/pull_request_approval.ts) · [`src/domain/pull_request_approval_policy.ts`](../src/domain/pull_request_approval_policy.ts) · [`src/domain/setup_approval_workflow.ts`](../src/domain/setup_approval_workflow.ts) · [`src/domain/setup_workflow_catalog.ts`](../src/domain/setup_workflow_catalog.ts) · [`src/application/policies/bot_pull_request_analysis_policy.ts`](../src/application/policies/bot_pull_request_analysis_policy.ts) · [`src/application/policies/bugbot_review_presentation_policy.ts`](../src/application/policies/bugbot_review_presentation_policy.ts) · [`src/application/policies/pull_request_approval_presentation_policy.ts`](../src/application/policies/pull_request_approval_presentation_policy.ts) · [`src/application/policies/pull_request_readiness_policy.ts`](../src/application/policies/pull_request_readiness_policy.ts) · [`src/application/policies/status_command_policy.ts`](../src/application/policies/status_command_policy.ts) · [`src/application/policies/approval_doctor_message_catalog.ts`](../src/application/policies/approval_doctor_message_catalog.ts) · [`src/application/policies/setup_approval_doctor_policy.ts`](../src/application/policies/setup_approval_doctor_policy.ts) · [`src/application/policies/setup_configuration_defaults.ts`](../src/application/policies/setup_configuration_defaults.ts) · [`src/application/policies/setup_configuration_plan.ts`](../src/application/policies/setup_configuration_plan.ts) · [`src/application/policies/setup_configuration_validation.ts`](../src/application/policies/setup_configuration_validation.ts) · [`src/application/policies/setup_questionnaire_policy.ts`](../src/application/policies/setup_questionnaire_policy.ts) · [`src/application/usecases/pull_request_approval/observe_pull_request_approval_use_case.ts`](../src/application/usecases/pull_request_approval/observe_pull_request_approval_use_case.ts) · [`src/application/usecases/read_copilot_status_workflow.ts`](../src/application/usecases/read_copilot_status_workflow.ts) · [`src/application/usecases/setup/doctor_use_case.ts`](../src/application/usecases/setup/doctor_use_case.ts) · [`src/application/usecases/setup/setup_wizard_use_case.ts`](../src/application/usecases/setup/setup_wizard_use_case.ts) · [`src/application/usecases/steps/commit/bugbot/synchronize_bugbot_review_presentation_use_case.ts`](../src/application/usecases/steps/commit/bugbot/synchronize_bugbot_review_presentation_use_case.ts) · [`src/data/repository/pull_request/pull_request_review_comment_command_repository.ts`](../src/data/repository/pull_request/pull_request_review_comment_command_repository.ts) · [`src/data/repository/pull_request/pull_request_approval_repository.ts`](../src/data/repository/pull_request/pull_request_approval_repository.ts) · [`src/data/repository/pull_request/approval_coverage_artifact.ts`](../src/data/repository/pull_request/approval_coverage_artifact.ts) · [`src/infrastructure/setup_approval_readiness_adapter.ts`](../src/infrastructure/setup_approval_readiness_adapter.ts) · [`src/utils/setup_files.ts`](../src/utils/setup_files.ts) · [`src/application/policies/setup_token_permission_policy.ts`](../src/application/policies/setup_token_permission_policy.ts) · [`web/src/i18n/permissions/en.ts`](../web/src/i18n/permissions/en.ts) · [`web/src/i18n/permissions/es.ts`](../web/src/i18n/permissions/es.ts) · [`web/src/i18n/permissions/fr.ts`](../web/src/i18n/permissions/fr.ts) · [`web/src/i18n/permissions/pt.ts`](../web/src/i18n/permissions/pt.ts) · [`src/application/ports/pull_request_status_read_ports.ts`](../src/application/ports/pull_request_status_read_ports.ts) · [`src/application/policies/publication_message_catalog.ts`](../src/application/policies/publication_message_catalog.ts) · [`src/domain/copilot_command.ts`](../src/domain/copilot_command.ts) · [`src/data/repository/pull_request/pull_request_status_query_repository.ts`](../src/data/repository/pull_request/pull_request_status_query_repository.ts) · [`src/infrastructure/composition/pull_request_status_composition_root.ts`](../src/infrastructure/composition/pull_request_status_composition_root.ts) · [`src/domain/action_input_source.ts`](../src/domain/action_input_source.ts) · [`src/domain/input_values_policy.ts`](../src/domain/input_values_policy.ts) · [`src/infrastructure/github_action_input.ts`](../src/infrastructure/github_action_input.ts) · [`src/application/usecases/read_pull_request_status_readiness_workflow.ts`](../src/application/usecases/read_pull_request_status_readiness_workflow.ts) · [`src/application/policies/pull_request_readiness_status_policy.ts`](../src/application/policies/pull_request_readiness_status_policy.ts) · [`src/data/repository/pull_request/current_base_revision_query.ts`](../src/data/repository/pull_request/current_base_revision_query.ts) · [`src/domain/approval_evidence_diagnostic.ts`](../src/domain/approval_evidence_diagnostic.ts) · [`src/application/errors/approval_evidence_error.ts`](../src/application/errors/approval_evidence_error.ts) · [`src/data/repository/pull_request/approval_evidence_read.ts`](../src/data/repository/pull_request/approval_evidence_read.ts) · [`src/domain/pull_request_closing_reference.ts`](../src/domain/pull_request_closing_reference.ts) · [`src/data/repository/pull_request/approval_bugbot_verification.ts`](../src/data/repository/pull_request/approval_bugbot_verification.ts) · [`src/application/policies/bugbot_verification_receipt_policy.ts`](../src/application/policies/bugbot_verification_receipt_policy.ts) · [`src/domain/bugbot/verification_receipt.ts`](../src/domain/bugbot/verification_receipt.ts) · [`src/domain/bugbot/verification_artifact.ts`](../src/domain/bugbot/verification_artifact.ts) · [`src/data/repository/pull_request/approval_bugbot_artifact.ts`](../src/data/repository/pull_request/approval_bugbot_artifact.ts) · [`src/data/repository/github/read_single_json_artifact.ts`](../src/data/repository/github/read_single_json_artifact.ts) · [`src/infrastructure/github/github_bugbot_verification_artifact.ts`](../src/infrastructure/github/github_bugbot_verification_artifact.ts) -- Tests: [`src/application/policies/__tests__/setup_questionnaire_policy.test.ts`](../src/application/policies/__tests__/setup_questionnaire_policy.test.ts) · [`src/application/policies/__tests__/bot_pull_request_analysis_policy.test.ts`](../src/application/policies/__tests__/bot_pull_request_analysis_policy.test.ts) · [`src/application/policies/__tests__/pull_request_approval_presentation_policy.test.ts`](../src/application/policies/__tests__/pull_request_approval_presentation_policy.test.ts) · [`src/application/policies/__tests__/pull_request_readiness_policy.test.ts`](../src/application/policies/__tests__/pull_request_readiness_policy.test.ts) · [`src/application/usecases/__tests__/read_copilot_status_workflow.test.ts`](../src/application/usecases/__tests__/read_copilot_status_workflow.test.ts) · [`src/application/policies/__tests__/setup_approval_doctor_policy.test.ts`](../src/application/policies/__tests__/setup_approval_doctor_policy.test.ts) · [`src/application/usecases/pull_request_approval/__tests__/observe_pull_request_approval_use_case.test.ts`](../src/application/usecases/pull_request_approval/__tests__/observe_pull_request_approval_use_case.test.ts) · [`src/application/usecases/setup/__tests__/doctor_use_case.test.ts`](../src/application/usecases/setup/__tests__/doctor_use_case.test.ts) · [`src/application/usecases/setup/__tests__/setup_wizard_use_case.test.ts`](../src/application/usecases/setup/__tests__/setup_wizard_use_case.test.ts) · [`src/application/usecases/steps/commit/bugbot/__tests__/synchronize_bugbot_review_presentation_use_case.test.ts`](../src/application/usecases/steps/commit/bugbot/__tests__/synchronize_bugbot_review_presentation_use_case.test.ts) · [`src/domain/__tests__/pull_request_approval.test.ts`](../src/domain/__tests__/pull_request_approval.test.ts) · [`src/domain/__tests__/setup_approval_workflow.test.ts`](../src/domain/__tests__/setup_approval_workflow.test.ts) · [`src/actions/__tests__/pull_request_approval_action.test.ts`](../src/actions/__tests__/pull_request_approval_action.test.ts) · [`src/actions/__tests__/pull_request_approval_logging.test.ts`](../src/actions/__tests__/pull_request_approval_logging.test.ts) · [`src/data/repository/pull_request/__tests__/approval_coverage_artifact.test.ts`](../src/data/repository/pull_request/__tests__/approval_coverage_artifact.test.ts) · [`src/data/repository/pull_request/__tests__/pull_request_approval_repository.test.ts`](../src/data/repository/pull_request/__tests__/pull_request_approval_repository.test.ts) · [`quality/bugbot/evidence/issue-950/cursor-rollback-shadow/packaged-rollback.cjs`](../quality/bugbot/evidence/issue-950/cursor-rollback-shadow/packaged-rollback.cjs) · [`src/data/repository/pull_request/__tests__/pull_request_review_comment_command_repository.test.ts`](../src/data/repository/pull_request/__tests__/pull_request_review_comment_command_repository.test.ts) · [`src/infrastructure/__tests__/setup_approval_readiness_adapter.test.ts`](../src/infrastructure/__tests__/setup_approval_readiness_adapter.test.ts) · [`src/utils/__tests__/setup_files.test.ts`](../src/utils/__tests__/setup_files.test.ts) · [`src/tooling/__tests__/validate_workflow_contract.test.ts`](../src/tooling/__tests__/validate_workflow_contract.test.ts) · [`src/application/policies/__tests__/setup_token_permission_policy.test.ts`](../src/application/policies/__tests__/setup_token_permission_policy.test.ts) · [`src/application/usecases/__tests__/pull_request_readiness_workflow.test.ts`](../src/application/usecases/__tests__/pull_request_readiness_workflow.test.ts) · [`src/application/policies/__tests__/pull_request_readiness_presentation.test.ts`](../src/application/policies/__tests__/pull_request_readiness_presentation.test.ts) · [`src/application/usecases/__tests__/pull_request_readiness_security_integration.test.ts`](../src/application/usecases/__tests__/pull_request_readiness_security_integration.test.ts) · [`src/data/repository/pull_request/__tests__/pull_request_status_query_repository.test.ts`](../src/data/repository/pull_request/__tests__/pull_request_status_query_repository.test.ts) · [`src/infrastructure/composition/__tests__/pull_request_status_composition_root.test.ts`](../src/infrastructure/composition/__tests__/pull_request_status_composition_root.test.ts) · [`src/infrastructure/composition/__tests__/main_run_route_composition_root.test.ts`](../src/infrastructure/composition/__tests__/main_run_route_composition_root.test.ts) · [`src/application/policies/__tests__/setup_approval_operator_permissions.test.ts`](../src/application/policies/__tests__/setup_approval_operator_permissions.test.ts) · [`src/application/usecases/setup/__tests__/audit_configured_setup_pat_use_case.test.ts`](../src/application/usecases/setup/__tests__/audit_configured_setup_pat_use_case.test.ts) · [`src/data/repository/pull_request/__tests__/approval_evidence_read.test.ts`](../src/data/repository/pull_request/__tests__/approval_evidence_read.test.ts) · [`src/domain/__tests__/pull_request_closing_reference.test.ts`](../src/domain/__tests__/pull_request_closing_reference.test.ts) · [`src/application/policies/__tests__/pull_request_description_content_policy.test.ts`](../src/application/policies/__tests__/pull_request_description_content_policy.test.ts) · [`src/application/usecases/steps/pull_request/__tests__/update_pull_request_description_use_case.test.ts`](../src/application/usecases/steps/pull_request/__tests__/update_pull_request_description_use_case.test.ts) · [`src/infrastructure/github/__tests__/github_bugbot_verification_artifact.test.ts`](../src/infrastructure/github/__tests__/github_bugbot_verification_artifact.test.ts) -- User documentation: [`docs/authentication.mdx`](../docs/authentication.mdx) · [`docs/configuration.mdx`](../docs/configuration.mdx) · [`docs/configuration-checklist.mdx`](../docs/configuration-checklist.mdx) · [`docs/pull-requests/capabilities.mdx`](../docs/pull-requests/capabilities.mdx) · [`docs/pull-requests/guarded-approval.mdx`](../docs/pull-requests/guarded-approval.mdx) · [`docs/pull-requests/workflow-setup.mdx`](../docs/pull-requests/workflow-setup.mdx) · [`docs/issues/comment-commands.mdx`](../docs/issues/comment-commands.mdx) · [`docs/bugbot/configuration.mdx`](../docs/bugbot/configuration.mdx) · [`docs/development/architecture.mdx`](../docs/development/architecture.mdx) +- Core code: [`src/domain/setup.ts`](../src/domain/setup.ts) · [`src/domain/pull_request_approval.ts`](../src/domain/pull_request_approval.ts) · [`src/domain/pull_request_approval_policy.ts`](../src/domain/pull_request_approval_policy.ts) · [`src/domain/setup_approval_workflow.ts`](../src/domain/setup_approval_workflow.ts) · [`src/domain/setup_workflow_catalog.ts`](../src/domain/setup_workflow_catalog.ts) · [`src/application/policies/bot_pull_request_analysis_policy.ts`](../src/application/policies/bot_pull_request_analysis_policy.ts) · [`src/application/policies/bugbot_review_presentation_policy.ts`](../src/application/policies/bugbot_review_presentation_policy.ts) · [`src/application/policies/pull_request_approval_presentation_policy.ts`](../src/application/policies/pull_request_approval_presentation_policy.ts) · [`src/application/policies/pull_request_readiness_policy.ts`](../src/application/policies/pull_request_readiness_policy.ts) · [`src/application/policies/status_command_policy.ts`](../src/application/policies/status_command_policy.ts) · [`src/application/policies/approval_doctor_message_catalog.ts`](../src/application/policies/approval_doctor_message_catalog.ts) · [`src/application/policies/setup_approval_doctor_policy.ts`](../src/application/policies/setup_approval_doctor_policy.ts) · [`src/application/policies/setup_configuration_defaults.ts`](../src/application/policies/setup_configuration_defaults.ts) · [`src/application/policies/setup_configuration_plan.ts`](../src/application/policies/setup_configuration_plan.ts) · [`src/application/policies/setup_configuration_validation.ts`](../src/application/policies/setup_configuration_validation.ts) · [`src/application/policies/setup_questionnaire_policy.ts`](../src/application/policies/setup_questionnaire_policy.ts) · [`src/application/usecases/pull_request_approval/observe_pull_request_approval_use_case.ts`](../src/application/usecases/pull_request_approval/observe_pull_request_approval_use_case.ts) · [`src/application/usecases/read_copilot_status_workflow.ts`](../src/application/usecases/read_copilot_status_workflow.ts) · [`src/application/usecases/setup/doctor_use_case.ts`](../src/application/usecases/setup/doctor_use_case.ts) · [`src/application/usecases/setup/setup_wizard_use_case.ts`](../src/application/usecases/setup/setup_wizard_use_case.ts) · [`src/application/usecases/steps/commit/bugbot/synchronize_bugbot_review_presentation_use_case.ts`](../src/application/usecases/steps/commit/bugbot/synchronize_bugbot_review_presentation_use_case.ts) · [`src/data/repository/pull_request/pull_request_review_comment_command_repository.ts`](../src/data/repository/pull_request/pull_request_review_comment_command_repository.ts) · [`src/data/repository/pull_request/pull_request_approval_repository.ts`](../src/data/repository/pull_request/pull_request_approval_repository.ts) · [`src/data/repository/pull_request/approval_coverage_artifact.ts`](../src/data/repository/pull_request/approval_coverage_artifact.ts) · [`src/infrastructure/setup_approval_readiness_adapter.ts`](../src/infrastructure/setup_approval_readiness_adapter.ts) · [`src/utils/setup_files.ts`](../src/utils/setup_files.ts) · [`src/application/policies/setup_token_permission_policy.ts`](../src/application/policies/setup_token_permission_policy.ts) · [`web/src/i18n/permissions/en.ts`](../web/src/i18n/permissions/en.ts) · [`web/src/i18n/permissions/es.ts`](../web/src/i18n/permissions/es.ts) · [`web/src/i18n/permissions/fr.ts`](../web/src/i18n/permissions/fr.ts) · [`web/src/i18n/permissions/pt.ts`](../web/src/i18n/permissions/pt.ts) · [`src/application/ports/pull_request_status_read_ports.ts`](../src/application/ports/pull_request_status_read_ports.ts) · [`src/application/policies/publication_message_catalog.ts`](../src/application/policies/publication_message_catalog.ts) · [`src/domain/copilot_command.ts`](../src/domain/copilot_command.ts) · [`src/data/repository/pull_request/pull_request_status_query_repository.ts`](../src/data/repository/pull_request/pull_request_status_query_repository.ts) · [`src/infrastructure/composition/pull_request_status_composition_root.ts`](../src/infrastructure/composition/pull_request_status_composition_root.ts) · [`src/domain/action_input_source.ts`](../src/domain/action_input_source.ts) · [`src/domain/input_values_policy.ts`](../src/domain/input_values_policy.ts) · [`src/infrastructure/github_action_input.ts`](../src/infrastructure/github_action_input.ts) · [`src/application/usecases/read_pull_request_status_readiness_workflow.ts`](../src/application/usecases/read_pull_request_status_readiness_workflow.ts) · [`src/application/policies/pull_request_readiness_status_policy.ts`](../src/application/policies/pull_request_readiness_status_policy.ts) · [`src/data/repository/pull_request/current_base_revision_query.ts`](../src/data/repository/pull_request/current_base_revision_query.ts) · [`src/domain/approval_evidence_diagnostic.ts`](../src/domain/approval_evidence_diagnostic.ts) · [`src/application/errors/approval_evidence_error.ts`](../src/application/errors/approval_evidence_error.ts) · [`src/data/repository/pull_request/approval_evidence_read.ts`](../src/data/repository/pull_request/approval_evidence_read.ts) · [`src/domain/pull_request_closing_reference.ts`](../src/domain/pull_request_closing_reference.ts) · [`src/data/repository/pull_request/approval_bugbot_verification.ts`](../src/data/repository/pull_request/approval_bugbot_verification.ts) · [`src/application/policies/bugbot_verification_receipt_policy.ts`](../src/application/policies/bugbot_verification_receipt_policy.ts) · [`src/domain/bugbot/verification_receipt.ts`](../src/domain/bugbot/verification_receipt.ts) · [`src/domain/bugbot/verification_artifact.ts`](../src/domain/bugbot/verification_artifact.ts) · [`src/data/repository/pull_request/approval_bugbot_artifact.ts`](../src/data/repository/pull_request/approval_bugbot_artifact.ts) · [`src/data/repository/github/read_single_json_artifact.ts`](../src/data/repository/github/read_single_json_artifact.ts) · [`src/infrastructure/github/github_bugbot_verification_artifact.ts`](../src/infrastructure/github/github_bugbot_verification_artifact.ts) · [`quality/bugbot/evidence/issue-980/packaged-trust.cjs`](../quality/bugbot/evidence/issue-980/packaged-trust.cjs) +- Tests: [`src/application/policies/__tests__/setup_questionnaire_policy.test.ts`](../src/application/policies/__tests__/setup_questionnaire_policy.test.ts) · [`src/application/policies/__tests__/bot_pull_request_analysis_policy.test.ts`](../src/application/policies/__tests__/bot_pull_request_analysis_policy.test.ts) · [`src/application/policies/__tests__/pull_request_approval_presentation_policy.test.ts`](../src/application/policies/__tests__/pull_request_approval_presentation_policy.test.ts) · [`src/application/policies/__tests__/pull_request_readiness_policy.test.ts`](../src/application/policies/__tests__/pull_request_readiness_policy.test.ts) · [`src/application/usecases/__tests__/read_copilot_status_workflow.test.ts`](../src/application/usecases/__tests__/read_copilot_status_workflow.test.ts) · [`src/application/policies/__tests__/setup_approval_doctor_policy.test.ts`](../src/application/policies/__tests__/setup_approval_doctor_policy.test.ts) · [`src/application/usecases/pull_request_approval/__tests__/observe_pull_request_approval_use_case.test.ts`](../src/application/usecases/pull_request_approval/__tests__/observe_pull_request_approval_use_case.test.ts) · [`src/application/usecases/setup/__tests__/doctor_use_case.test.ts`](../src/application/usecases/setup/__tests__/doctor_use_case.test.ts) · [`src/application/usecases/setup/__tests__/setup_wizard_use_case.test.ts`](../src/application/usecases/setup/__tests__/setup_wizard_use_case.test.ts) · [`src/application/usecases/steps/commit/bugbot/__tests__/synchronize_bugbot_review_presentation_use_case.test.ts`](../src/application/usecases/steps/commit/bugbot/__tests__/synchronize_bugbot_review_presentation_use_case.test.ts) · [`src/domain/__tests__/pull_request_approval.test.ts`](../src/domain/__tests__/pull_request_approval.test.ts) · [`src/domain/__tests__/setup_approval_workflow.test.ts`](../src/domain/__tests__/setup_approval_workflow.test.ts) · [`src/actions/__tests__/pull_request_approval_action.test.ts`](../src/actions/__tests__/pull_request_approval_action.test.ts) · [`src/actions/__tests__/pull_request_approval_logging.test.ts`](../src/actions/__tests__/pull_request_approval_logging.test.ts) · [`src/data/repository/pull_request/__tests__/approval_coverage_artifact.test.ts`](../src/data/repository/pull_request/__tests__/approval_coverage_artifact.test.ts) · [`src/data/repository/pull_request/__tests__/pull_request_approval_repository.test.ts`](../src/data/repository/pull_request/__tests__/pull_request_approval_repository.test.ts) · [`quality/bugbot/evidence/issue-950/cursor-rollback-shadow/packaged-rollback.cjs`](../quality/bugbot/evidence/issue-950/cursor-rollback-shadow/packaged-rollback.cjs) · [`src/data/repository/pull_request/__tests__/pull_request_review_comment_command_repository.test.ts`](../src/data/repository/pull_request/__tests__/pull_request_review_comment_command_repository.test.ts) · [`src/infrastructure/__tests__/setup_approval_readiness_adapter.test.ts`](../src/infrastructure/__tests__/setup_approval_readiness_adapter.test.ts) · [`src/utils/__tests__/setup_files.test.ts`](../src/utils/__tests__/setup_files.test.ts) · [`src/tooling/__tests__/validate_workflow_contract.test.ts`](../src/tooling/__tests__/validate_workflow_contract.test.ts) · [`src/application/policies/__tests__/setup_token_permission_policy.test.ts`](../src/application/policies/__tests__/setup_token_permission_policy.test.ts) · [`src/application/usecases/__tests__/pull_request_readiness_workflow.test.ts`](../src/application/usecases/__tests__/pull_request_readiness_workflow.test.ts) · [`src/application/policies/__tests__/pull_request_readiness_presentation.test.ts`](../src/application/policies/__tests__/pull_request_readiness_presentation.test.ts) · [`src/application/usecases/__tests__/pull_request_readiness_security_integration.test.ts`](../src/application/usecases/__tests__/pull_request_readiness_security_integration.test.ts) · [`src/data/repository/pull_request/__tests__/pull_request_status_query_repository.test.ts`](../src/data/repository/pull_request/__tests__/pull_request_status_query_repository.test.ts) · [`src/infrastructure/composition/__tests__/pull_request_status_composition_root.test.ts`](../src/infrastructure/composition/__tests__/pull_request_status_composition_root.test.ts) · [`src/infrastructure/composition/__tests__/main_run_route_composition_root.test.ts`](../src/infrastructure/composition/__tests__/main_run_route_composition_root.test.ts) · [`src/application/policies/__tests__/setup_approval_operator_permissions.test.ts`](../src/application/policies/__tests__/setup_approval_operator_permissions.test.ts) · [`src/application/usecases/setup/__tests__/audit_configured_setup_pat_use_case.test.ts`](../src/application/usecases/setup/__tests__/audit_configured_setup_pat_use_case.test.ts) · [`src/data/repository/pull_request/__tests__/approval_evidence_read.test.ts`](../src/data/repository/pull_request/__tests__/approval_evidence_read.test.ts) · [`src/domain/__tests__/pull_request_closing_reference.test.ts`](../src/domain/__tests__/pull_request_closing_reference.test.ts) · [`src/application/policies/__tests__/pull_request_description_content_policy.test.ts`](../src/application/policies/__tests__/pull_request_description_content_policy.test.ts) · [`src/application/usecases/steps/pull_request/__tests__/update_pull_request_description_use_case.test.ts`](../src/application/usecases/steps/pull_request/__tests__/update_pull_request_description_use_case.test.ts) · [`src/infrastructure/github/__tests__/github_bugbot_verification_artifact.test.ts`](../src/infrastructure/github/__tests__/github_bugbot_verification_artifact.test.ts) · [`quality/bugbot/evidence/issue-980/packaged-trust.test.cjs`](../quality/bugbot/evidence/issue-980/packaged-trust.test.cjs) +- User documentation: [`docs/authentication.mdx`](../docs/authentication.mdx) · [`docs/configuration.mdx`](../docs/configuration.mdx) · [`docs/configuration-checklist.mdx`](../docs/configuration-checklist.mdx) · [`docs/pull-requests/capabilities.mdx`](../docs/pull-requests/capabilities.mdx) · [`docs/pull-requests/guarded-approval.mdx`](../docs/pull-requests/guarded-approval.mdx) · [`docs/pull-requests/workflow-setup.mdx`](../docs/pull-requests/workflow-setup.mdx) · [`docs/issues/comment-commands.mdx`](../docs/issues/comment-commands.mdx) · [`docs/bugbot/configuration.mdx`](../docs/bugbot/configuration.mdx) · [`docs/development/architecture.mdx`](../docs/development/architecture.mdx) · [`quality/bugbot/evidence/issue-980/README.md`](../quality/bugbot/evidence/issue-980/README.md) ### `github-browser-extension` — Complete GitHub productivity extension and integrated Copilot setup diff --git a/specs/catalog.json b/specs/catalog.json index 328a4386d..d43cb7712 100644 --- a/specs/catalog.json +++ b/specs/catalog.json @@ -3391,7 +3391,8 @@ "src/domain/bugbot/verification_artifact.ts", "src/data/repository/pull_request/approval_bugbot_artifact.ts", "src/data/repository/github/read_single_json_artifact.ts", - "src/infrastructure/github/github_bugbot_verification_artifact.ts" + "src/infrastructure/github/github_bugbot_verification_artifact.ts", + "quality/bugbot/evidence/issue-980/packaged-trust.cjs" ], "tests": [ "src/application/policies/__tests__/setup_questionnaire_policy.test.ts", @@ -3428,7 +3429,8 @@ "src/domain/__tests__/pull_request_closing_reference.test.ts", "src/application/policies/__tests__/pull_request_description_content_policy.test.ts", "src/application/usecases/steps/pull_request/__tests__/update_pull_request_description_use_case.test.ts", - "src/infrastructure/github/__tests__/github_bugbot_verification_artifact.test.ts" + "src/infrastructure/github/__tests__/github_bugbot_verification_artifact.test.ts", + "quality/bugbot/evidence/issue-980/packaged-trust.test.cjs" ], "documentation": [ "docs/authentication.mdx", @@ -3439,7 +3441,8 @@ "docs/pull-requests/workflow-setup.mdx", "docs/issues/comment-commands.mdx", "docs/bugbot/configuration.mdx", - "docs/development/architecture.mdx" + "docs/development/architecture.mdx", + "quality/bugbot/evidence/issue-980/README.md" ] }, { diff --git a/specs/guarded-pull-request-approval.md b/specs/guarded-pull-request-approval.md index 0f3afe2ce..19b993138 100644 --- a/specs/guarded-pull-request-approval.md +++ b/specs/guarded-pull-request-approval.md @@ -615,3 +615,36 @@ subsequent-attempt and rollback consumer tests must also pass. ### Review-head attribution for a synthetic-merge execution A trusted Bugbot workflow execution on the verified synthetic merge retains that execution SHA in native artifact metadata. Its custom Review check and identical receipt are tied to the actual reviewed PR head, not to the merge commit. The consumer validates both identities in their respective roles. The merge's exact current base/head parents must already be proven; stale or foreign parents cannot authorize it. `PullRequestApprovalRepository` has positive and negative regressions for a genuine merge-run artifact with respectively a head check and an incorrect merge check. This adds no configuration and preserves all current-policy, latest-attempt and rollback fences. + +### Producer-trust audit clarification (#980) + +The receipt-attribution amendment authenticates data/native context, not the +producer's executable code independently of its assertions. A matching run, +artifact, App, SHA and custom check ID does not establish the actual checkout or +truth of a fabricated clean result. A configured operator producer declaration +remains a trust prerequisite. Before a future enforced profile, the maintainer +must establish the exact reviewed workflow/executable revision and acceptable +producer execution trust; independent evidence beyond candidate-controlled +contents may be required. This audit does not supply that unavailable evidence, +add a new attestation service/schema, or change existing approval policy. + +The existing fixed exclusions remain material: a fabricated clean current +receipt cannot authorize approval for edits to build/**, the source workflow or +action.yml. Test with a current head on every read to distinguish protected-path +from a later stale-head fence. Preserve the authenticated-data, same-SHA policy, +latest-attempt, rollback, human-review and last-verified boundaries. The earlier +broad action-edit approval route remains refuted, not a proven exploit. + +The bounded incremental budget is **14 packaged scenarios in one Node test +wrapper**: three protected edits; foreign receipt run/artifact run/SHA/App; prior +policy and attempt; ordinary authorized current data; stale/fresh rollback data; +and human approval/changes-requested. Existing consumer/domain/use-case tests +are retained rather than counted again. Every packaged case keeps the head fixed +and records all local fake mutations. Protected and invalid cases have no +approval POST; the two positive data cases have one each, only to localhost. +There is no real GitHub write, credential, model call or production-mode change. +Run the packaged wrapper through the shadow-verification script, the existing +consumer suites, docs/spec gates and current-head native review. Register the +audit/fixtures in the capability catalog and preserve unsuccessful attempts. +The implemented source contract remains unchanged; a stronger architecture or +public policy needs its official SDD review before implementation. From 79396c2eb04d10324b00f93c1fa11c16e7069cf0 Mon Sep 17 00:00:00 2001 From: Efra Espada Date: Thu, 19 Nov 2026 21:30:04 +0100 Subject: [PATCH 2/3] chore-980-make-the-bugbot-approval-receipt-producer-trust-boundary-explicit-and-reproducible: validate final audit driver formatting and evidence (#980) --- quality/bugbot/evidence/issue-980/README.md | 4 +++- .../bugbot/evidence/issue-980/attempt-3.jsonl | 16 ++++++++++++++++ .../bugbot/evidence/issue-980/attempt-3.log.gz | Bin 0 -> 90 bytes .../evidence/issue-980/packaged-trust.cjs | 1 - quality/bugbot/evidence/issue-980/summary.json | 9 +++++++-- 5 files changed, 26 insertions(+), 4 deletions(-) create mode 100644 quality/bugbot/evidence/issue-980/attempt-3.jsonl create mode 100644 quality/bugbot/evidence/issue-980/attempt-3.log.gz diff --git a/quality/bugbot/evidence/issue-980/README.md b/quality/bugbot/evidence/issue-980/README.md index 456c53ef4..496e00018 100644 --- a/quality/bugbot/evidence/issue-980/README.md +++ b/quality/bugbot/evidence/issue-980/README.md @@ -3,7 +3,7 @@ The existing packaged approval consumer passes **14 controlled cases** against only a loopback fake GitHub service. This audit changes no production approval code or policy. The application baseline is ccefb27627cd627ccdb7d5666fd174c2ac1da07b; -its exact Action bundle and this driver's SHA-256 are in attempt-2.jsonl and +its exact Action bundle and this driver's SHA-256 are in attempt-3.jsonl and summary.json. Node v24.20.0 / macOS arm64 is the executed environment; no other OS, model profile or installed default workflow is claimed. @@ -69,3 +69,5 @@ identity before cases. The existing shadow-verification script includes the wrapper for CI. The old #950 rollback script and its historical artifacts remain unchanged. This result preserves the refuted broad approval-exploit claim as refuted; it documents the narrower producer-trust limitation. + +The source diff check identified an extra blank line at the driver EOF. Its removal changes no case or decision. The exact final driver was rerun: all 14 cases pass in `attempt-3.jsonl`; the previous ledgers/logs and original driver remain in history. The initial mandatory hook passed all 943 suites / 18,695 tests, build and lint before this formatting correction. diff --git a/quality/bugbot/evidence/issue-980/attempt-3.jsonl b/quality/bugbot/evidence/issue-980/attempt-3.jsonl new file mode 100644 index 000000000..8c2285553 --- /dev/null +++ b/quality/bugbot/evidence/issue-980/attempt-3.jsonl @@ -0,0 +1,16 @@ +{"event":"start","at":"2026-11-19T20:28:02.398Z","node":"v24.20.0","platform":"darwin","architecture":"arm64","sourceBaseline":"ccefb27627cd627ccdb7d5666fd174c2ac1da07b","bundleSha256":"c5fe206b2027c951b4f22c64d210ea540b6777eee3c7cd754ba944a771f0f0e6","driverSha256":"d043b0121a14e2ad7c982d84e945bc8664f4205f84ea7af583cdd65500e15ed8","authority":{"mode":"disabled","generation":2,"policyDigest":"2222222222222222222222222222222222222222222222222222222222222222","workflowId":31,"sourceAppId":12},"fixturePolicy":"guarded","realGitHubWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-bundle","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-workflow","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-action","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-receipt-run","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-artifact-run","expected":"blocked (evidence-unavailable)","decision":"blocked (evidence-unavailable)","publication":"published","status":1,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approval blocked\n**Status:** Approval evidence is unavailable; inspect the causal diagnostic in the observer Job Summary\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Fix the named prerequisite and rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: evidence\\-unavailable.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nImpact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).\nError code: provider.contract-invalid\nAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.\nRetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.\nRetryable: No\nReference: 3e33a9f4-eb10-4534-b64e-d5f946e8b56e\nPR #42: blocked (evidence-unavailable); assessment published.\nApproval evidence read failed (bugbot-artifacts, artifact-unavailable).\n::error::Impact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).%0AError code: provider.contract-invalid%0AAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.%0ARetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.%0ARetryable: No%0AReference: 3e33a9f4-eb10-4534-b64e-d5f946e8b56e\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-sha","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-app","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"prior-policy","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"prior-attempt","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"authorized-current","expected":"already-approved (approved)","decision":"already-approved (approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":1,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/pulls/42/reviews","body":{"event":"APPROVE","commit_id":"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa","body":"\nCopilot approved this revision (aaaaaaa) after its configured CI and coverage gates passed and Bugbot reported no blocking findings. GitHub still applies branch rules. Configure a separate human-review requirement if needed; a bot approval may count toward a generic approval minimum."}},{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approved by the bot\n**Status:** The bot approved this revision; GitHub still applies the configured branch rules\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** None; GitHub still applies its review rules.\n**Impact:** A native review exists for this revision; the PR was not merged.\n[Open approval](https://github.com/fixture/producer-trust/pull/42#pullrequestreview-301) · [See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: approved.\n\n
"}}],"pullReads":4,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: already-approved (approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"rollback-stale-same-sha","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"rollback-fresh-same-sha","expected":"already-approved (approved)","decision":"already-approved (approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":1,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/pulls/42/reviews","body":{"event":"APPROVE","commit_id":"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa","body":"\nCopilot approved this revision (aaaaaaa) after its configured CI and coverage gates passed and Bugbot reported no blocking findings. GitHub still applies branch rules. Configure a separate human-review requirement if needed; a bot approval may count toward a generic approval minimum."}},{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approved by the bot\n**Status:** The bot approved this revision; GitHub still applies the configured branch rules\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** None; GitHub still applies its review rules.\n**Impact:** A native review exists for this revision; the PR was not merged.\n[Open approval](https://github.com/fixture/producer-trust/pull/42#pullrequestreview-301) · [See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: approved.\n\n
"}}],"pullReads":4,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: already-approved (approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"human-approved","expected":"recommend (human-approved)","decision":"recommend (human-approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A human has already approved this revision\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: human\\-approved.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (human-approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"human-changes-requested","expected":"blocked (changes-requested)","decision":"blocked (changes-requested)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approval blocked\n**Status:** A human reviewer requested changes\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Fix the named prerequisite and rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: changes\\-requested.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: blocked (changes-requested); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"finish","passed":14,"cases":14,"actualProductionModeChanged":false,"realGitHubWriteAttempts":0,"qualificationModelCalls":0} diff --git a/quality/bugbot/evidence/issue-980/attempt-3.log.gz b/quality/bugbot/evidence/issue-980/attempt-3.log.gz new file mode 100644 index 0000000000000000000000000000000000000000..6fe938f9246e183948ed03f0903b1d939d224217 GIT binary patch literal 90 zcmb2|=3oE;rvI!54fz@rcvvsoO)lBC=%V9JU*#hS2h2Vd8s5A6JwV(CGfzFTmfIa@A^ { console.error(error); process.exitCode = 1; }); - diff --git a/quality/bugbot/evidence/issue-980/summary.json b/quality/bugbot/evidence/issue-980/summary.json index ac00b8719..a78a992f3 100644 --- a/quality/bugbot/evidence/issue-980/summary.json +++ b/quality/bugbot/evidence/issue-980/summary.json @@ -1,7 +1,7 @@ { "sourceBaseline": "ccefb27627cd627ccdb7d5666fd174c2ac1da07b", "bundleSha256": "c5fe206b2027c951b4f22c64d210ea540b6777eee3c7cd754ba944a771f0f0e6", - "driverSha256": "ee5cf50d010603b2430151a3074aef95a9065bc66b83d72a2787acfb3bc36f0f", + "driverSha256": "d043b0121a14e2ad7c982d84e945bc8664f4205f84ea7af583cdd65500e15ed8", "node": "v24.20.0", "platform": "darwin", "architecture": "arm64", @@ -179,5 +179,10 @@ ], "actualProductionModeChanged": false, "independentProducerCodeAttestation": "not established", - "futureEnforcedPrerequisite": "operator must establish trusted workflow/executable revision and any required independent producer evidence; run/artifact matching alone is insufficient" + "futureEnforcedPrerequisite": "operator must establish trusted workflow/executable revision and any required independent producer evidence; run/artifact matching alone is insufficient", + "latestAttempt": "attempt-3.jsonl", + "priorAttempts": [ + "attempt-1.jsonl", + "attempt-2.jsonl" + ] } From 6efac73417df179a3153b526ae6df9b0b53c976b Mon Sep 17 00:00:00 2001 From: Efra Espada Date: Thu, 19 Nov 2026 22:07:33 +0100 Subject: [PATCH 3/3] chore-980-make-the-bugbot-approval-receipt-producer-trust-boundary-explicit-and-reproducible: assert assessment publication separately from blocked evidence (#980) --- quality/bugbot/evidence/issue-980/README.md | 22 +++++++++++++++++- .../bugbot/evidence/issue-980/attempt-4.jsonl | 16 +++++++++++++ .../evidence/issue-980/attempt-4.log.gz | Bin 0 -> 90 bytes .../new-publication-countercontrol.jsonl | 6 +++++ .../new-publication-countercontrol.log.gz | Bin 0 -> 679 bytes .../old-publication-countercontrol.jsonl | 16 +++++++++++++ .../old-publication-countercontrol.log.gz | Bin 0 -> 102 bytes .../evidence/issue-980/packaged-trust.cjs | 11 ++++++++- ...publication-countercontrol-derivation.json | 10 ++++++++ .../issue-980/publication-shadow-pass.log.gz | Bin 0 -> 4357 bytes .../publication-shadow-sandbox-failure.log.gz | Bin 0 -> 5660 bytes .../bugbot/evidence/issue-980/summary.json | 11 +++++---- 12 files changed, 86 insertions(+), 6 deletions(-) create mode 100644 quality/bugbot/evidence/issue-980/attempt-4.jsonl create mode 100644 quality/bugbot/evidence/issue-980/attempt-4.log.gz create mode 100644 quality/bugbot/evidence/issue-980/new-publication-countercontrol.jsonl create mode 100644 quality/bugbot/evidence/issue-980/new-publication-countercontrol.log.gz create mode 100644 quality/bugbot/evidence/issue-980/old-publication-countercontrol.jsonl create mode 100644 quality/bugbot/evidence/issue-980/old-publication-countercontrol.log.gz create mode 100644 quality/bugbot/evidence/issue-980/publication-countercontrol-derivation.json create mode 100644 quality/bugbot/evidence/issue-980/publication-shadow-pass.log.gz create mode 100644 quality/bugbot/evidence/issue-980/publication-shadow-sandbox-failure.log.gz diff --git a/quality/bugbot/evidence/issue-980/README.md b/quality/bugbot/evidence/issue-980/README.md index 496e00018..d1fb91dbc 100644 --- a/quality/bugbot/evidence/issue-980/README.md +++ b/quality/bugbot/evidence/issue-980/README.md @@ -3,7 +3,7 @@ The existing packaged approval consumer passes **14 controlled cases** against only a loopback fake GitHub service. This audit changes no production approval code or policy. The application baseline is ccefb27627cd627ccdb7d5666fd174c2ac1da07b; -its exact Action bundle and this driver's SHA-256 are in attempt-3.jsonl and +its exact Action bundle and this driver's SHA-256 are in attempt-4.jsonl and summary.json. Node v24.20.0 / macOS arm64 is the executed environment; no other OS, model profile or installed default workflow is claimed. @@ -71,3 +71,23 @@ unchanged. This result preserves the refuted broad approval-exploit claim as refuted; it documents the narrower producer-trust limitation. The source diff check identified an extra blank line at the driver EOF. Its removal changes no case or decision. The exact final driver was rerun: all 14 cases pass in `attempt-3.jsonl`; the previous ledgers/logs and original driver remain in history. The initial mandatory hook passed all 943 suites / 18,695 tests, build and lint before this formatting correction. + + +## Assessment publication counter-control + +Native review of 79396c2 correctly found that blocked evidence and failed +assessment publication both exit 1. The audit now independently asserts +`publication: published` for every case and exactly one received fake assessment +POST carrying the canonical marker. All fourteen cases pass again in attempt 4 +with the final driver hash. The source approval implementation is unchanged. + +The causal control makes only the local foreign-artifact-run assessment POST +return 403. An isolated audit copy with only the new publication assertions +removed falsely reports 14 passed while its recorded assessment is failed. The +corrected driver rejects those same inputs at that case and records no passing +finish. Both exact ledgers and raw compressed outputs are retained, together +with source hashes and a deterministic derivation recipe. That expected rejection +is not a new positive scenario or a model qualification measurement. Fake write +attempts remain counted; real GitHub/evaluated-PR writes and model calls stay zero. + +All 141 shadow controls pass with the publication assertions. The earlier sandbox run passed 140 and could not bind loopback for the packaged wrapper (EPERM); its exact raw output is retained, followed by the permitted localhost-only full pass. diff --git a/quality/bugbot/evidence/issue-980/attempt-4.jsonl b/quality/bugbot/evidence/issue-980/attempt-4.jsonl new file mode 100644 index 000000000..ab510747d --- /dev/null +++ b/quality/bugbot/evidence/issue-980/attempt-4.jsonl @@ -0,0 +1,16 @@ +{"event":"start","at":"2026-11-19T20:59:19.739Z","node":"v24.20.0","platform":"darwin","architecture":"arm64","sourceBaseline":"ccefb27627cd627ccdb7d5666fd174c2ac1da07b","bundleSha256":"c5fe206b2027c951b4f22c64d210ea540b6777eee3c7cd754ba944a771f0f0e6","driverSha256":"0dbef389c51fb188f6c17da2464bb7b4fa304debc529e932b2d3c8d891e68750","authority":{"mode":"disabled","generation":2,"policyDigest":"2222222222222222222222222222222222222222222222222222222222222222","workflowId":31,"sourceAppId":12},"fixturePolicy":"guarded","realGitHubWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-bundle","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-workflow","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-action","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-receipt-run","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-artifact-run","expected":"blocked (evidence-unavailable)","decision":"blocked (evidence-unavailable)","publication":"published","status":1,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approval blocked\n**Status:** Approval evidence is unavailable; inspect the causal diagnostic in the observer Job Summary\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Fix the named prerequisite and rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: evidence\\-unavailable.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nImpact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).\nError code: provider.contract-invalid\nAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.\nRetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.\nRetryable: No\nReference: 12c3f588-5685-47d5-820e-6834db211400\nPR #42: blocked (evidence-unavailable); assessment published.\nApproval evidence read failed (bugbot-artifacts, artifact-unavailable).\n::error::Impact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).%0AError code: provider.contract-invalid%0AAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.%0ARetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.%0ARetryable: No%0AReference: 12c3f588-5685-47d5-820e-6834db211400\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-sha","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-app","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"prior-policy","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"prior-attempt","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"authorized-current","expected":"already-approved (approved)","decision":"already-approved (approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":1,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/pulls/42/reviews","body":{"event":"APPROVE","commit_id":"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa","body":"\nCopilot approved this revision (aaaaaaa) after its configured CI and coverage gates passed and Bugbot reported no blocking findings. GitHub still applies branch rules. Configure a separate human-review requirement if needed; a bot approval may count toward a generic approval minimum."}},{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approved by the bot\n**Status:** The bot approved this revision; GitHub still applies the configured branch rules\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** None; GitHub still applies its review rules.\n**Impact:** A native review exists for this revision; the PR was not merged.\n[Open approval](https://github.com/fixture/producer-trust/pull/42#pullrequestreview-301) · [See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: approved.\n\n
"}}],"pullReads":4,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: already-approved (approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"rollback-stale-same-sha","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"rollback-fresh-same-sha","expected":"already-approved (approved)","decision":"already-approved (approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":1,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/pulls/42/reviews","body":{"event":"APPROVE","commit_id":"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa","body":"\nCopilot approved this revision (aaaaaaa) after its configured CI and coverage gates passed and Bugbot reported no blocking findings. GitHub still applies branch rules. Configure a separate human-review requirement if needed; a bot approval may count toward a generic approval minimum."}},{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approved by the bot\n**Status:** The bot approved this revision; GitHub still applies the configured branch rules\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** None; GitHub still applies its review rules.\n**Impact:** A native review exists for this revision; the PR was not merged.\n[Open approval](https://github.com/fixture/producer-trust/pull/42#pullrequestreview-301) · [See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: approved.\n\n
"}}],"pullReads":4,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: already-approved (approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"human-approved","expected":"recommend (human-approved)","decision":"recommend (human-approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A human has already approved this revision\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: human\\-approved.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (human-approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"human-changes-requested","expected":"blocked (changes-requested)","decision":"blocked (changes-requested)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approval blocked\n**Status:** A human reviewer requested changes\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Fix the named prerequisite and rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: changes\\-requested.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: blocked (changes-requested); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"finish","passed":14,"cases":14,"actualProductionModeChanged":false,"realGitHubWriteAttempts":0,"qualificationModelCalls":0} diff --git a/quality/bugbot/evidence/issue-980/attempt-4.log.gz b/quality/bugbot/evidence/issue-980/attempt-4.log.gz new file mode 100644 index 0000000000000000000000000000000000000000..386f3e8f36e9452d4e311e56affe9c08c0d0a4fb GIT binary patch literal 90 zcmb2|=3oE;rvI!54fz@rcvvsoO)lBCh_kt9wp-`HhTJEQllEA@uT2Tcw$ae3Q_0=H t#`WZl=XwPzk>cG^r?~7wjq+cgVLFnOU>_U$-sk@X#y9s1U%CTL1ON|0B-H=_ literal 0 HcmV?d00001 diff --git a/quality/bugbot/evidence/issue-980/new-publication-countercontrol.jsonl b/quality/bugbot/evidence/issue-980/new-publication-countercontrol.jsonl new file mode 100644 index 000000000..91af0f3d5 --- /dev/null +++ b/quality/bugbot/evidence/issue-980/new-publication-countercontrol.jsonl @@ -0,0 +1,6 @@ +{"event":"start","at":"2026-11-19T20:59:29.964Z","node":"v24.20.0","platform":"darwin","architecture":"arm64","sourceBaseline":"ccefb27627cd627ccdb7d5666fd174c2ac1da07b","bundleSha256":"c5fe206b2027c951b4f22c64d210ea540b6777eee3c7cd754ba944a771f0f0e6","driverSha256":"0dbef389c51fb188f6c17da2464bb7b4fa304debc529e932b2d3c8d891e68750","authority":{"mode":"disabled","generation":2,"policyDigest":"2222222222222222222222222222222222222222222222222222222222222222","workflowId":31,"sourceAppId":12},"fixturePolicy":"guarded","realGitHubWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-bundle","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-workflow","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-action","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-receipt-run","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-artifact-run","expected":"blocked (evidence-unavailable)","decision":"blocked (evidence-unavailable)","publication":"failed","status":1,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approval blocked\n**Status:** Approval evidence is unavailable; inspect the causal diagnostic in the observer Job Summary\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Fix the named prerequisite and rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: evidence\\-unavailable.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nImpact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).\nError code: provider.contract-invalid\nAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.\nRetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.\nRetryable: No\nReference: 49713f41-169a-47fb-8a9d-e11850c05455\nPR #42: blocked (evidence-unavailable); assessment failed.\nApproval evidence read failed (bugbot-artifacts, artifact-unavailable).\n::error::Impact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).%0AError code: provider.contract-invalid%0AAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.%0ARetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.%0ARetryable: No%0AReference: 49713f41-169a-47fb-8a9d-e11850c05455\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} diff --git a/quality/bugbot/evidence/issue-980/new-publication-countercontrol.log.gz b/quality/bugbot/evidence/issue-980/new-publication-countercontrol.log.gz new file mode 100644 index 0000000000000000000000000000000000000000..1bd11d0facd1d26534c77f2acca4fe9f68ee6e4b GIT binary patch literal 679 zcmV;Y0$BYYiwFP!00002|K(IoZxb;Pz3;CW38ADS&PPdT|kxq5T?`s$qo zDU~szR%t6`u(om@g>`qijVN;1qAxD%M(HeJ(KIpaR0X(m2E9hmp{)$~kfB7_VRY7^ zkx;hlGGw6$*3z2^`o~AndbLxoQe}lF!{R_m2ZIuLHjRx#9ej@5>pX!uQ!F&omvHG* zgF1ui;v^y}LxIMWz|x$&L5Qu-t|n#?iDGudR(aEvysFVWaF3W8nu0@k8Di|_ws{kx z`=ogM0BV<#^J{`hp^fwgK_tDwS^+ZeL`xGaPa;%Ltrzr|;~t2veZx#;)YTTMj@YN z2+KQ{GI4_IRT@xk=kPXlx6q+(D$IO~JL2P6P-~HOxi4*CSVrFS=iG5G`TZ(f2o2AtKN9p(j!x$#bM8vUS<7k1TJ(x9 N#aCob(l~Jj001*qSttMi literal 0 HcmV?d00001 diff --git a/quality/bugbot/evidence/issue-980/old-publication-countercontrol.jsonl b/quality/bugbot/evidence/issue-980/old-publication-countercontrol.jsonl new file mode 100644 index 000000000..e12004dbc --- /dev/null +++ b/quality/bugbot/evidence/issue-980/old-publication-countercontrol.jsonl @@ -0,0 +1,16 @@ +{"event":"start","at":"2026-11-19T20:59:25.390Z","node":"v24.20.0","platform":"darwin","architecture":"arm64","sourceBaseline":"ccefb27627cd627ccdb7d5666fd174c2ac1da07b","bundleSha256":"c5fe206b2027c951b4f22c64d210ea540b6777eee3c7cd754ba944a771f0f0e6","driverSha256":"9705d1469cca92574e423b451bbab4357100865d1dc3d716df7cdd3491185cc0","authority":{"mode":"disabled","generation":2,"policyDigest":"2222222222222222222222222222222222222222222222222222222222222222","workflowId":31,"sourceAppId":12},"fixturePolicy":"guarded","realGitHubWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-bundle","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-workflow","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"protected-action","expected":"recommend (protected-path)","decision":"recommend (protected-path)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A protected workflow, policy, or trust\\-boundary file changed\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: protected\\-path.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (protected-path); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-receipt-run","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-artifact-run","expected":"blocked (evidence-unavailable)","decision":"blocked (evidence-unavailable)","publication":"failed","status":1,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approval blocked\n**Status:** Approval evidence is unavailable; inspect the causal diagnostic in the observer Job Summary\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Fix the named prerequisite and rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: evidence\\-unavailable.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nImpact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).\nError code: provider.contract-invalid\nAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.\nRetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.\nRetryable: No\nReference: 44a29328-19f3-4622-aac1-57c9e94bfb38\nPR #42: blocked (evidence-unavailable); assessment failed.\nApproval evidence read failed (bugbot-artifacts, artifact-unavailable).\n::error::Impact: Approval evidence could not be verified: bugbot-artifacts (artifact-unavailable).%0AError code: provider.contract-invalid%0AAction: Inspect actions-read access for the runtime credential and the named evidence response. Correct authorization, missing-resource or schema errors before rerunning; retry transient failures only after provider recovery or rate-limit reset.%0ARetained state: No approval is authorized by this failed read. Existing PRs, reviews and completed external effects were preserved.%0ARetryable: No%0AReference: 44a29328-19f3-4622-aac1-57c9e94bfb38\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-sha","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"foreign-app","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"prior-policy","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"prior-attempt","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"authorized-current","expected":"already-approved (approved)","decision":"already-approved (approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":1,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/pulls/42/reviews","body":{"event":"APPROVE","commit_id":"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa","body":"\nCopilot approved this revision (aaaaaaa) after its configured CI and coverage gates passed and Bugbot reported no blocking findings. GitHub still applies branch rules. Configure a separate human-review requirement if needed; a bot approval may count toward a generic approval minimum."}},{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approved by the bot\n**Status:** The bot approved this revision; GitHub still applies the configured branch rules\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** None; GitHub still applies its review rules.\n**Impact:** A native review exists for this revision; the PR was not merged.\n[Open approval](https://github.com/fixture/producer-trust/pull/42#pullrequestreview-301) · [See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: approved.\n\n
"}}],"pullReads":4,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: already-approved (approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"rollback-stale-same-sha","expected":"pending (bugbot-missing)","decision":"pending (bugbot-missing)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Waiting for evidence\n**Status:** Waiting for a complete Bugbot review of this head\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot unverified.\n**Action required:** Wait for the pending producer or rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: bugbot\\-missing.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: pending (bugbot-missing); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"rollback-fresh-same-sha","expected":"already-approved (approved)","decision":"already-approved (approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":1,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/pulls/42/reviews","body":{"event":"APPROVE","commit_id":"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa","body":"\nCopilot approved this revision (aaaaaaa) after its configured CI and coverage gates passed and Bugbot reported no blocking findings. GitHub still applies branch rules. Configure a separate human-review requirement if needed; a bot approval may count toward a generic approval minimum."}},{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approved by the bot\n**Status:** The bot approved this revision; GitHub still applies the configured branch rules\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** None; GitHub still applies its review rules.\n**Impact:** A native review exists for this revision; the PR was not merged.\n[Open approval](https://github.com/fixture/producer-trust/pull/42#pullrequestreview-301) · [See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: approved.\n\n
"}}],"pullReads":4,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: already-approved (approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"human-approved","expected":"recommend (human-approved)","decision":"recommend (human-approved)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Human review needed\n**Status:** A human has already approved this revision\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Ask a human reviewer to decide.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: human\\-approved.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: recommend (human-approved); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"case","id":"human-changes-requested","expected":"blocked (changes-requested)","decision":"blocked (changes-requested)","publication":"published","status":0,"fakeApprovalWriteAttempts":0,"fakeMutations":[{"method":"POST","resource":"/repos/fixture/producer-trust/issues/42/comments","body":{"body":"\n### Copilot approval · Approval blocked\n**Status:** A human reviewer requested changes\\.\n**Completed:** 1/1 observed checks succeeded; Bugbot complete.\n**Action required:** Fix the named prerequisite and rerun the observer.\n**Impact:** No new approval is confirmed for this revision.\n[See checks](https://github.com/fixture/producer-trust/pull/42/checks)\n
\nTechnical evidence\n\nRevision: `aaaaaaaaaaaa`; base: `bbbbbbbbbbbb`; reason: changes\\-requested.\n\n
"}}],"pullReads":2,"currentHeadOnEveryRead":true,"violations":[],"stdout":"::add-mask::offline-fixture-token\nPR #42: blocked (changes-requested); assessment published.\n","realGitHubWriteAttempts":0,"evaluatedPrWriteAttempts":0,"qualificationModelCalls":0} +{"event":"finish","passed":14,"cases":14,"actualProductionModeChanged":false,"realGitHubWriteAttempts":0,"qualificationModelCalls":0} diff --git a/quality/bugbot/evidence/issue-980/old-publication-countercontrol.log.gz b/quality/bugbot/evidence/issue-980/old-publication-countercontrol.log.gz new file mode 100644 index 0000000000000000000000000000000000000000..9c92d165278ef434f9bd18ae5206be827b83aff7 GIT binary patch literal 102 zcmb2|=3oE;rvI!54fz@rcvvsoO)lBCsI$3B+9kV1bo!+UqX#|6b_+hojsHt&MZ z?2B%G-c@^C)3@(p@MU@|99I$R)+Vzice=e F=>Y$IDK`KB literal 0 HcmV?d00001 diff --git a/quality/bugbot/evidence/issue-980/packaged-trust.cjs b/quality/bugbot/evidence/issue-980/packaged-trust.cjs index 940b3f4c8..01c383141 100644 --- a/quality/bugbot/evidence/issue-980/packaged-trust.cjs +++ b/quality/bugbot/evidence/issue-980/packaged-trust.cjs @@ -73,6 +73,7 @@ function fixture(scenario) { state.reviews.push(review); return reply(review, 201); } if (method === 'POST' && resource === prefix + '/issues/42/comments') { + if (scenario.refuseAssessment) return reply({ message: 'Fixture assessment publication refused' }, 403); const comment = { id: 501, user: { id: 10 }, body: body.body }; state.comments.push(comment); return reply(comment, 201); } @@ -125,6 +126,8 @@ const cases = [ ]; async function main() { + assert(process.argv.length === 4 || process.argv.length === 5 && process.argv[4] === '--refuse-blocked-assessment', + 'expected bundle, new ledger and optional fixture counter-control flag'); const bundle = fs.realpathSync(process.argv[2]); const output = path.resolve(process.argv[3]); fs.writeFileSync(output, '', { flag: 'wx' }); @@ -140,7 +143,8 @@ async function main() { fs.writeFileSync(event, JSON.stringify({ action: 'completed', repository: { id: repositoryId }, workflow_run: { head_repository: { id: repositoryId }, pull_requests: [{ number: pr }] } })); for (const scenario of cases) { - const fixtureCase = fixture(scenario), violations = []; + const fixtureCase = fixture({ ...scenario, refuseAssessment: process.argv[4] === '--refuse-blocked-assessment' + && scenario.id === 'foreign-artifact-run' }), violations = []; const summary = path.join(root, scenario.id + '.md'); fs.writeFileSync(summary, ''); const server = createServer(async (request, response) => { @@ -183,6 +187,11 @@ async function main() { record(result); assert.deepEqual(violations, [], stdout); assert.equal(result.decision, scenario.decision, stdout); + assert.equal(result.publication, 'published', stdout); + assert.equal(fixtureCase.state.mutations.filter(row => row.method === 'POST' + && row.resource === '/repos/' + ownerRepo + '/issues/42/comments' + && row.body?.body?.includes('')).length, 1, + 'the fake provider must receive the assessment publication'); assert.equal(approvals, scenario.approvals ?? 0, stdout); assert.equal(status, scenario.exit ?? 0, stdout); assert.equal(result.currentHeadOnEveryRead, true); diff --git a/quality/bugbot/evidence/issue-980/publication-countercontrol-derivation.json b/quality/bugbot/evidence/issue-980/publication-countercontrol-derivation.json new file mode 100644 index 000000000..7badf5963 --- /dev/null +++ b/quality/bugbot/evidence/issue-980/publication-countercontrol-derivation.json @@ -0,0 +1,10 @@ +{ + "currentDriverSha256": "0dbef389c51fb188f6c17da2464bb7b4fa304debc529e932b2d3c8d891e68750", + "countercontrolDriverSha256": "9705d1469cca92574e423b451bbab4357100865d1dc3d716df7cdd3491185cc0", + "recipe": "Copy current driver outside the checkout. Remove exactly the contiguous block starting assert.equal(result.publication and ending immediately before assert.equal(approvals. Retain all case definitions and local --refuse-blocked-assessment flag. Run both copies against the same pinned bundle with new output ledgers.", + "causalInput": "Only the local fake assessment POST for foreign-artifact-run returns 403. Both have the same blocked decision and exit 1.", + "oldOutcome": "false pass: finish.passed14 while foreign-artifact-run publication failed", + "newOutcome": "expected assertion failure: failed differs from published; no passing finish", + "realGitHubWriteAttempts": 0, + "qualificationModelCalls": 0 +} diff --git a/quality/bugbot/evidence/issue-980/publication-shadow-pass.log.gz b/quality/bugbot/evidence/issue-980/publication-shadow-pass.log.gz new file mode 100644 index 0000000000000000000000000000000000000000..db5cc99945c7a9344c8c2aeb1d52efd4da0e710d GIT binary patch literal 4357 zcmV+g5&G^QiwFP!00002|Fv7ovg0^%-Pc!eXE~z8;``ByiE*?&(%`GG>oG#PJ>zM`G>=DI;eTC&!Sat`&T)2$F31`r-tCuICZaLmY?R!=pNpml<4<$ z6@B4An%{)>?0gw4xLSl@8$PTwhH6!TesjSTr3mG0qQEJJhNAD6!0Px!8U`&LQj>HV|}b9a&7 zDn&PHlHa+Ku@_(E7(I)5(fdYB?S5Piy>m4Gt-e_LLNw)iWTJVs2^23M! z{qMgAhh8-=IuOAH4|KyRz;4Gy2PXt##2JIxg;>6!R=Eb;mjk97CGs&N2GwWbJ%U~G}Y8l$#+-b-{;PqDATQ{H8 zGMn{Mq;z;L;m}ehzjSKryMxZH3*?YPh(Sqr^YM?3T4IXI3mpG&3SOfFn+F z3ItZbYJUh`5#KE$Aj+dK&7&&Ko+q2~622+xFe@tf=XsJlis%cTG&Nus7l_~_E3p3O zDY3`~k5YC;i zaaY!HSR(qL>0eu`_VTlAmRTHnxgRH`jz|RBR8gkS1PPQj*`0<5+VUg~(>nE0{b||^ z4U*HUE6YP*UtE;W(`8GKB{%yPJe4v&$>T6fqNk#Xb6KxM%Q}E6Wt~5NFV1dIfyhhh zEZYdnB>%E>s8n3&~t@*TBe5bCQXVcEV4X_sz*BYxf@5r*DmNNuwTR6m+58! zVz>qu^cTI)rINA=D-fEzc9OO1R{~({0)(FA2^;|b12qztQ6MT!!MtMv^q9vNT6q+P z4Afy6#oi7UEq`hGYNU1R;O#621Ong#b^otUI+CDWOu@jPC-@L{B=SSi3Tl;B(Uyd~ zNYQf0;eplbD*}EDR>t`+|GAIKU{nD0>kr#EK>E@gj5GIG(zlBp;5LM&Cq0f(o3gm_ zZ1e5nMGr3xs7ZtsM_3c68-s`?`7;&|PiyoP`xBy^X?&WePY}C>{0_W6%s`Ev;XwpD zT47`2JVye>fPwE9i-zoEgvJR9OznZnw+nrf;)MZTHXT2^%c44r)3n$?{=233h>M}Q z5*(Icl;vJ&{EnEouk$3ns-F>XE5+LDgGMSjT0yjaHr`-|YjiJ(1Uw zBoC7)_TuX~dOWByny6XMv()pHbA#B9j#B||-rv%|KO^g7B+B)B$!|PfewQ{RRW6_&_ z)(l8BA!=OvQO;b-^*J|7a%^5fh7Q!wU->)T0A%Kl6)PfnS?v*hVf##c>@A#%f|k>( zZNJn^;7;$;Y6nSeKN3+RH5M9UlTYv-&FFZ+*-e(bsQ}&J8Q3gYzZVA=C6e;YjiX(GT6` znkE?CX%82mtE)pgjPOSTK zWzYKT1TPJvsNT{51(sNjUM12yje=pWEEBIN0v0;jvHdaGaT$X_&0QmnG9tXjGP6=< zFEm%K!Xz)f@fyBHXA)N)OB{N22+jiTQ9;ugu667ttP0992Lht)T(obZEB*p|y; zv%qLTp3T9VTCksHQd+OOvpWj9BO0ZayVoR&!XnPRihw|;p&uWE0igp199qD(xP!bZ zyzy?xLp%CN0qIse$yp$#+Wp~58Mw^qc%)%=Q5PZb)Wc`WHP-nqtk>)y-4sqJpnz&d zZVR&vzhoEENYF|f>^Ww4B|1>J%^PdEI1}zUYb@jg7RQq<&Ub_}?arP9uFEh^E6Rxa zLl3cAMR+Fp+D^19b)+t+BZ+OjA>}yv2^d7!M<8ISUXD{=?G)d5FlL z0k=_gl#ybfbsTs=)&O4F%UKatAU9j1e{TnCc~b{aUu-dDJ#25+|Ct!ur8NSld?2vx z*pOI@_0T*?c|Sf)QKd4kN^Q|~b5+6%H3kOj1CB?bArPJ>;39~P0kTQ$&F2uBBLO&J z7{Md5rtfd3p`26(S=RD~rJ??KqlH^Ez6(mTcLsYh;`+JGcN*q$oq{bme!1jFb@iaw zi0x@DjuMzndsq=J(e}q!4?wlNby-%Bn10sf*CI0c5IT>o1McEkO|jpS}-G zzi2`fCyIx#cBax&n0HMFo33EgY3x$GB0x>|4nzsdxX$ke?e~wG1cARruTBf3JBrkx z79xNrCN?uocR2u^F;J3}dO=Ct<%sXPO!9|QeNWmT2rq4JBO1<%Hp2jC;+!@~pE*_S zB#txlF~fjJ0OF%SrWV`YUZfluF1rB{;ypLAOcH-*@fGo4a63D*b9O4qhR0UmBzc*7 z*z7d%WFK{qzsG8*fA8g3WpDT{HDf1m z=BuB*9EkUt82*U2t~X-bvNTmtI)#hsEycc5(G7x5^4NW55``-5-?aH|C8kE*RiPN* z7e)C^ZKg8D$i9Bf%K8UQX90V4+#6}m8*2#LRJ-vqpaB%W_7AhaLWObimlaeAU5fFC zVJ4>UzR6MTdOwYfT%%|OCvXUANJ=k|evPn;r1?yzFL(0th)$9GBe1Vnoc!F#2|lzZ zFpNnJH-5%C*m@q8rJv5ALatRBB?p38(MgQANN=K?bd5-3fb<&fCZ)0%U3FY0(aqs0 zA3tuHr%l)m)VB7(dFr_FCEB@OMxry0VI8PyfvgFXFXv7^p&mHYR!adq`bAI&Od8}K;j!I4)d8Y;|O}7Wsd$dxc zUz*Li@q=y>jUTfI9tIfI&eQf8R0V+NBi?MR4`)%4UsVC-JAKQAiZB6cJ|ODbY{L{n8@A%0 z33vH%OL_Qc*J$w-tzAWT)rrNWP=I!e&w`L0%ZYi!L8IY?PT$K!6&L&K{;PSGrBzT^yqw zD{`;rVd_Aa6#ON+%P9m- z#ovt05tip}0O7UYO=nSvRyx{_LA?&u>o4Y6@I(}4f&k`1<)yCttgtyzcn)^U}=9*?@2(#teT~XoC({tuZi!KYz zx=q3Ld<1^pi%GUO;k<1Koj{a(7F*MzAsf+4!z>MHbT^HM;Kn+FuP-^;X(D8j)U>a6 zndpQ)j7o5-wZ4e9)!RKDGn3;r+X?qbt5l2LHcd07_a@}lOZ-UG) zht^%w-s&3ugW1K^Onb~SOzSqv$<5=%&G6I7pcBzFdT@D~N?1=e!=u~YW*-qPH*zhl z5${I-blIN|sI$Z?#b#J*&rO<1+H{bsioLBLczA1-XWGSp7`ce)#om*1=D1xH8!k*E z|850m#p+Hjm==uJ`xcy{REXVZh3>z*VPh~Z`b+@{{E)4Sie(sl(gF0$x;j!mW|N2k+Brj}D zoI8g?L4(|)DGy&BA=znGdF>LTh=0h#!#RF-^#QiPbGwD9AN@r?@31t`i;k(YlWx9% zPfQu=KwG^&P^@9=!clo87n^VsLF8aJNym|h@Z%jLF|It;YRN4hRFYq}?xZ!{1Dls& z<|Da~dVRA!(6jk{ev;`6|H|A-z)-xzM8`AA>yDV2*svt!_MF0npJzfi&o#QVgCzF2 zS36zlCq5RZM6(uK{z(SbIoPg&c&|GWv;MT!vOlX~*-`5K!ho8Ao|=I*dOU;N&>iOw zEAirv88|Ty0QNUd?})A;c$~ri?Tnh%eq=BM{?$@!bt~F{01p~RbKq#9gQkprnYBVZ z1Jj(qHZTx|kf4wxFf>2;Sk3Kkl0rU?Z>qOju#lCOH##obitzWuvTwl$qRrb%;HY@*i(E*(oCulLtGXL;@$ZWh9^QnJIZ?0n$vdDkCx@BTk%%OzO#J z?DMPJwh&jVylKm-89omj&vm?j4Wb{`n{l^khGoC!MRUEp5?#41b3T+!%~ow!UhzS! zhC^!xFLw>EmRagP`Ha;~A=q+BV%T3tUX{b`N{L&EtFjPvE>>mVk7Aic?&<*zEBk{( za-96<{&&c#o9=*VY%2&OxlXS*T(b%AI5%}^R8I7Z%zBxxKzFq992IJ5&sUw7s3sD2O~J35n(%YyeRXb>28^H*~jF#j_+sLypx^yS>!{{hP_~8y=lg}VEeL%FnC_2 zqGKErkXqO53jSR{uI~j-=tV&go=!H!C0oRPjNM7&I6j@^l3eD^iC_h#*;;yx(I;G4gC|^y%XfC(lW8{J5i8@UUEA5%3&928aPpULSHP# zR$?(^$8qX}f$N`8`nKY`o-Lvd93 zHUC@=cQOC&c$%n5v?l8#Y3G;tv*{3`=0o3%T~5IhAYnLBl4UbC+B*Av*|v(a9Z*$Z zy^6h$-O&VieajB0F)C{*ewLtiaeZ%2N4=;f4xsD;l3D-XjAv z%%Tj1*mB7S!psTcIU2`ayle7JOSA6T^N`Ok6S`50_hG*Wj6! z_yoiLwuJ_y|q=b^5 zTE1BaaJ!>j2MNT+dsZ$ujUEfCl%_O}QNM*2=RA!f!)}K?P;TE;l;6N1{P^^?GXU9F z4HlFkHwUQ=kEho%<2>w!G6x}={DImK9%3j}10wZ+2wrF*+zB0gS=OLt-AHXhZO+(* zIpgHi)-?V;v36YrEFw2^{LJc9oYtQA^<|Mv)N`Tq2W;Ryt<;ZkW2;Ae;B~nrz&C}> zMN`SLh28AS-JZnhTBj9VDa*Essgo3iuD%~wbo4;zh^g`JAiJIdq(>Dp94M+2eU2Kh zEM&t~7JJkiJ*sF`m$WBL_0q`V{*q6bTIXm=hS4{W(X*zmZsl*v8rUprR?LXxg>h!} z=D994@x3*3$_u^du5=C74219WoTgg~D*h3NJtAYIem3n1o>8k#&e%^aayMKz3eA&PZofrwmdnn{}9}*L9Dw;U043w74U-6Cc z5fTRkp(2>d`T{|(bO4K_zc(Y|Mo_+iM>#yH_ck%Mu zx6hwF|KjD_7q7o%+pamtCIM!$2tGMyfF^{&r|hNt^F?#uW&P>b7vKEj#p{2T&(tIK z925IAVrQ@Gb{tl)B>qr?&m8uhk#H7_q5-FKm2&<-rO;hbEX zj;lJ%V~brJR4)hr*)%t5uB7({g032Un5uiE;67fM%q1A;3vtMP5=l?;20nKyh2j%M z*GPwFy8l31Gq$X5hB6mQ8`Tra>4v6JZbCi2$VsBmj;)%}xzDX^`fRFZ!}c7W->|$? zOm09r?Ea+U2ruL@6ExF`i?|njn4m=G8Klng(%0 z{S-H$LfH~X-_ePywPe#~nh)lb7!w9`I7oZOnL52Ke<9E%8CWhR9N33LbhcF1BjG`f z036Dl+6uBO&vVfZeU%C}9!Wyf6e4OFio-ufh%;x zkpMefD^pRVNu76mdI}BFO}?apU#3Kzzhqt`qmV|*S+u%JIxL~36Q=%=BIRY=jMJ7v zFko`BX(*!|zD%prC#};o^p=IGlV;v*v4*k;c#;&sI^w((Bgix|Wj~-yKh!A7a%iWwcF6!N_Zx$42%Zb0jS(I`tenDV*8qeJg0Y ztL#cxt(;Ekk=8b)wQ{dT7{pGH1P{tAN@+<*y|ux{0Grk@;m6S3s{XT4tih9EY;GwE7 zLNq1KGOOb_^}6m4RxyI@=2f#BA>WYC9GMV4+)2tfQ14v&ps@xLQqx=_A!41OlVyq3 zSvWc~vE2-4`$chNqvq%X<3(gvFo^AW;M%b!;d~7g^!~i!*DB9`QvmdYA+Hn_4VqhB1Ix=Q55A zZk4qR83A}wNs4ZE0D>EGLXYlWM6ql6|8X%vh3*a&$*mp2(i!h-k|;<;!F21$OpCak z3kH$|_6ftsDLO*YPHf8?I>tyGH+1dOmycDVQq}!rlxEaFvzDW>nMC*LXIj?No=#hq z&337zncbLNSO?qDE-ykPr3Cnp1|Oh8ZSvy^V)$DUBW}E7pT74?>D8vP?h%ob7fk@Q z@M0g*5Sf?Z zwCH|piP0E}wV|{Hw#Jda%vREoj2oc9wJl9H8>kL9Zay86bTEQAV#agsgWRsUR&}O6 zj3s_kZt*(ul%7;{WvgG_BB3-48;H1TGb8OS`D-oAK*F{QHoaNE-PPKC0t zT1pFC{L_~utwLabdQ;EY-mm-JW*&W!=Qp^#y<>s;Sma(CS?NfqD|9pQI47 z)1p+Ht=3}}NIYp8ALUeKA+-b8FiQ24D!_c%AJg&42lVuaqNNGQXlT`Hy2;Yd&Nugo zjxPsD%2$CAsNb6l36#8{Z^x;4x7#o(@lffOMK)EP`1;&9Qi)KzF5mQoyK=ZDKJxHh zVU1msVZnR^8R=v-O8urdvMxbYM~8C4O%5H(U2p`sbZp& z8)`~OAxZ8Q26RIA4qH9WNG%LQl)xipK{`_nVuEtKjZZ1dD&}fF#I+b&Df~xlErWn=gNb{kUe|b^# z^F1lml#^4|rw1)fvKjk%&D2)9Yd%@JH3!+6eEkBYjYG%tGs5ucf<<92!_RpQ|HA0} zR<(T8L{#b4iq4#N@T2ypk+JX{aEb@$1f{TwtcIcU>INGQH9s z7ME4+T74*$cS6U4m{crv{=ne5Tpnl@HJs$YyGwl!(U{|SQe-;M!TwmtDMMn~P?<0_ z5>FReWPDO0HvJWP%fPf7Sv&T7@<@P(D2!i>b#0RlpPEAVDaZWMfy~NCb5vQ1Ql>SM zbImUWU|)0PW+UCf+D5Wqm|CwyC}5esA6r_QY+gtnB3qvqUp!m-QLOXfP#OecIbw@C zJ@Rsn>gL!fQX+_bf+kyZa_qDPSc2@{jgtA%-{=h*%>pgw=t|w|majMvS*92T5ZDlH zyw-SQW2IXx!t@0Zgk>iTMIyqFCrTnv*t&qM*{wVTrhT33lR}jb(!LUB&S?v&)>rET zJsa*u=z{KW`O)l269Gf!;vJoRHCAyXX^D1AQm#)bjQd$O#O|3wm$+BtTSp8+l9qvF&digEZY#kkqQhKUqpzU5i#AAiIsNI?kP-!$Z+9=U6SoGBEWCbOi%p z@Cous0z>sy&17zSk+i32Xm=K;Sx!bVdGL44Ffy;Q$P>IZRtCyZvzOnz{PwH0)sU9k zqOcgI@%+R=LF#x<82$l%T~O3_PLE{MeknzKfjve{{{SC)tAzSLu?4-qxUR*p_5;^n z``#x;fcnYn`guj1r?Y<<2Ep3%r(e!r#Ie6l%wyemcl4icN+if{kdS;=5)~r6Hc4;{k%QZq{t+(TD!Fr@{e0P!pHGKq4jc zqK$%ulSxOieFs$q2oggo**#| zxvi>)oTKiM7KbG3eqf(yzRzI(`}r4Nx}Uv4mX+xgkHyrDh$MyiI=-N@;+H;kp@kUy8h7vtu80>ftt zr24b9dwwQg&NPQFU(uoWbGmwf?|ws^{}(f_W-{JVONAIGym~xHG&C%XirFnDGzd}a zYw)5|FLRnaR?1gxV%JHKmo>Eh`~NWYs(=@I@>4&`wz4Zfw5a^?jru@<#ng}VxelhJ zzUnW_ww*o=P0{GT7P^t}_RurBCzCpH=0f)qxiFF_Nf*sv{p5*!xtR|i{KNAxW(_~%mG zDQo%U@fX2Y?`;}-`}c8?@+!${2MRWB-m0_Y6>+H>hlXD9Znc%Ew_oMItgh?)@b;Jd zCQPFA=j-q$0B~Ivzl1LS*|n=TchoQCE2mAhEWUnr^?kU~$r+MCmS;URu4W>|ZnH9*qvmp3B6xUF+r6*5>=ywzq{XQ99L>|LQ7-*jh+hCMtYNsp)Y1{m;M zwKAN4po;$XfYS9dwm5M>%~%tyvpf17(BIefvmTSapti7{Ij0A2_f2!zuYEr`wvZWj z*P^87t-97G|GxHuELr<^m+a{K#D8zFA3<+o4VL3B#tnV_jEc%XHO)XbCELe@?Ri&| z`GZu7)6S~?PXudbJQJLh!!c`Abn1z^3$|uIsAufy({pzAVZr}n{jsq>N%;GrKmGJh z;`hl2jc`nMnJGxn3(fwn}3@?$rN^&SmHLp$>H>GT^M85%