Skip to content

feat: v0.13.0 ecosystem, harness check Action, npm publish, agents-md target, plugin CI - #453

Merged
siracusa5 merged 6 commits into
mainfrom
feat/v013-ecosystem-2
Nov 6, 2026
Merged

siracusa5 merged 6 commits into
mainfrom
feat/v013-ecosystem-2

Conversation

@siracusa5

Copy link
Copy Markdown
Collaborator

Track 3 of the v0.13.0 bundle. It is independent of PR #452 (the desktop safety work).

What changes

  • harness check GitHub Action: a root action.yml. uses: harnessprotocol/harness-kit@v0.13.0 runs check (or status --baseline) through npx, writes a job summary, and fails on drift.
  • npm publish: build-cli-npm is back in release.yml. It publishes shared, core, exchange and cli, and skips with a notice until an NPM_TOKEN secret exists. exchange now ships dist only.
  • --target agents-md: an alias for the AGENTS.md compile path (AGENTS.md plus .agents/skills, no MCP file). harness init suggests it when no known tool is detected. Unknown targets still error.
  • status --json exits 1 on drift, as text mode does, so CI can gate on it.
  • Fix: check right after compile reported drift for every non-Claude-Code target when harness.yaml has permissions. The Action would have failed for anyone with deny rules.
  • Plugin CI:
    • claude plugin validate runs on every plugin, with no API key.
    • The offline eval replay runs on PRs that touch docgen, explain, review or evals/.
    • Live claude plugin eval runs only on release, on manual dispatch, or with a run-evals label: Haiku, deterministic graders, changed plugins only, $2 cap per plugin.
    • The 7 eval cases are ported into the plugins.
  • Manifest fix: skills paths in harness-share, membrain and research lacked ./. Patch bumps for all three.
  • Marketplace: plugin pages show the scan date, counts by severity and filesystem patterns.

Needs you

  • Add an NPM_TOKEN repo secret before tagging, or the npm job skips.
  • Live evals need CLAUDE_CODE_OAUTH_TOKEN or ANTHROPIC_API_KEY. Without one, that job skips. No eval case has run against a real model yet: the eval sandbox doesn't carry the local login.
  • claude plugin validate --strict fails all 17 plugins on the repo's own manifest fields (category, tags, requires, x-developed-with), so CI runs it without --strict.

Verification

  • Core: 876 tests. CLI: 151 tests. Core tsc is clean; CLI tsc has 7 errors that already exist on main, in lines this branch doesn't touch.
  • Both new behaviors were mutation-checked: the status exit code and the alias.
  • The check fix comes with a round-trip test across all targets that failed first, 7 of 11, before the fix.
  • The Action's step script was run locally against the built CLI. In sync gives exit 0; edited, missing and error cases give exit 1 with summary rows. act isn't installed.
  • scripts/validate-manifests.sh and claude plugin validate pass for all plugins.
  • The website builds, and a plugin page was checked in Playwright.

Known and left alone: with permissions but no operational instructions, compile drops the permissions text (existing behavior, rare setup).

🤖 Generated with Claude Code

siracusa5 and others added 5 commits November 6, 2026 01:26
…s on plugin security

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- plugin-validate job: claude plugin validate on all plugins, no API key
- offline eval replay on PRs that touch docgen/explain/review or evals/
- live claude plugin eval on release, dispatch, or a run-evals label:
  haiku, deterministic graders, changed plugins only, $2 cap per plugin
- port the 7 eval cases into plugins/{docgen,explain,review}/evals
- fix skills paths missing ./ in harness-share, membrain, research (patch bumps)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ts 1 on drift

- --target agents-md resolves to the AGENTS.md compile path (AGENTS.md plus
  .agents/skills, no MCP file) in compile, check, diff, fix and portability;
  unknown targets still error
- harness init suggests --target agents-md when no known tool is detected
- status --json now exits 1 on drift or a blocked reconciliation, like text
  mode, so CI can gate on it

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- action.yml: uses: harnessprotocol/harness-kit@v0.13.0 runs harness check
  (or status) via npx, writes a job summary, fails on drift
- release.yml: restore build-cli-npm (shared, core, exchange, cli); skips
  with a notice when NPM_TOKEN is not set
- exchange ships dist only and publishes publicly
- README and quick-start: Use in CI; npm install needs Node 24+

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ith permissions

Non-Claude-Code adapters append the permissions text to the operational
block; check compared that block to the bare operational instructions, so
cursor, copilot, codex/agents-md, opencode, windsurf, gemini and junie all
showed drift immediately after compile.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Comment thread scripts/action-summary.mjs Fixed
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@siracusa5
siracusa5 merged commit 15b3d78 into main Nov 6, 2026
22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants