Skip to content

test: add separate compact real-model qualification without waiving full gates - #78

Merged
Pavithran-R-A merged 9 commits into
mainfrom
feat/compact-real-model-qualification-20261109
Nov 9, 2026
Merged

Pavithran-R-A merged 9 commits into
mainfrom
feat/compact-real-model-qualification-20261109

Conversation

@Pavithran-R-A

Copy link
Copy Markdown
Owner

Stacked after PR #77 — compact public-repo live qualification

The earlier real Qwen run against MergeSutra's full root repository failed 11/17 verification gates: expensive repeated root tests, TypeScript exit 134 under 512MB container limit and worktree Git metadata outside the one allowed mount. Those are genuine, preserved failures; this does not waive any of those gates.

This change adds an explicit second fixture profile, backed by the public tiny repository, issue #1, and its independently reviewed oracle added by fixture PR #2.

  • Manual workflow choice fixture_profile=compact|full (compact default), only for the credentialed live job. The credential-free preflight continues the original full-repo challenge.
  • Compact checks use real GitHub issue, normal git clone/worktree, operator-bound AC-1..5 check node --test scripts/e2e-acceptance-check.mjs, standalone npm test, model edits confined to src/test/readme, hard independent behavior check, model review and candidate publication bundle.
  • Full-repository profile remains unchanged and must still pass its own repository-required checks to earn a full PASS. A successful compact run is labeled a representative small-repository result, not evidence that the full-root case passed.
  • The same 12-completion ceiling, zero retries, 25-minute driver deadline, pinned Docker, read-only GitHub permissions and no remote PR publication apply.
  • Added tests that assert missing tests, changed independent oracle, added dependencies and profile conflation fail closed.

Do not rerun the failed live attempt. No new API/model requests were made for this PR.

Requires PR #77 merged and retargeting this stacked PR to main; then full hosted CI and customer gate before any new manual credentialed run.

Copilot AI balanced review requested due to automatic review settings November 9, 2026 17:21

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota. Try requesting a review at a lower effort level.

@Pavithran-R-A
Pavithran-R-A changed the base branch from feat/operator-bound-acceptance-gates-20261109 to main November 9, 2026 18:33
@Pavithran-R-A
Pavithran-R-A merged commit a381ff0 into main Nov 9, 2026
7 checks passed
@linear-code

linear-code Bot commented Nov 9, 2026

Copy link
Copy Markdown

PAV-173

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants