Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions docs/bugbot/quality-observability.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -1049,3 +1049,19 @@ Future qualification plans also pin the actual prepared executable's digest
and any launcher artifact. A version string alone cannot admit a model call.
Record and check the runtime proof for every corpus invocation; frozen
campaigns continue to replay through their own preregistration commits.

## Corpus revision 2

The #971 audit found malformed complete-workflow context in the frozen
`actions-readonly-metadata` input. The repository's `corpus.v2.json` supplies a
complete read-only metadata job for that case. All 174 IDs/order and labels stay
unchanged; `corpus.v1.json` and every historical score and prediction retain
their original bytes. The derivation and historical hashes are recorded under
`quality/bugbot/evidence/issue-985` with six deterministic controls.

This is a new input identity for independent review. It neither changes the
current CLI/driver default nor retrospectively rescales a completed campaign.
Before #974 measures anything, merge the prerequisites and reviewed correction,
then commit exact drivers/preregistration that select and hash v2. The threshold
and production-disabled policies remain in force. No v2 qualification result is
claimed by the fixture correction.
2 changes: 1 addition & 1 deletion package.json
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@
"test": "jest",
"test:watch": "jest --watch",
"test:coverage": "jest --coverage --json --outputFile=coverage/setup-acceptance-jest.json && node scripts/validate-coverage-budgets.cjs && node scripts/validate-setup-assistant-acceptance.cjs coverage/setup-acceptance-jest.json && pnpm run test:extension",
"test:bugbot-shadow-verification": "node --test quality/bugbot/evidence/issue-950/shadow-verification/verification.test.cjs quality/bugbot/evidence/issue-950/normal-flow-shadow/config.test.cjs quality/bugbot/evidence/issue-950/normal-flow-shadow/paths.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/launch-full-review.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/review-runtime.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/score-review.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/plan.test.cjs quality/bugbot/evidence/issue-950/status-card-publication/publisher.test.cjs",
"test:bugbot-shadow-verification": "node --test quality/bugbot/evidence/issue-950/shadow-verification/verification.test.cjs quality/bugbot/evidence/issue-950/normal-flow-shadow/config.test.cjs quality/bugbot/evidence/issue-950/normal-flow-shadow/paths.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/launch-full-review.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/review-runtime.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/score-review.test.cjs quality/bugbot/evidence/issue-950/ev07-shadow/plan.test.cjs quality/bugbot/evidence/issue-950/status-card-publication/publisher.test.cjs quality/bugbot/evidence/issue-985/corpus-revision.test.cjs",
"eval:bugbot": "jest src/tooling/__tests__/bugbot_quality_eval.test.ts src/tooling/__tests__/bugbot_benchmark.test.ts src/tooling/__tests__/bugbot_request_transform_evidence.test.ts --runInBand",
"typecheck": "tsc --noEmit && pnpm run typecheck:extension",
"metrics:architecture": "node scripts/collect-architecture-metrics.cjs",
Expand Down
Loading