Skip to content

Scope secrets to the checked origin; three-reading method; Google robots.txt conformance (0.3.0) - #3

Merged
joshuarg007 merged 1 commit into
mainfrom
fix/scope-headers-three-way
Nov 15, 2026
Merged

joshuarg007 merged 1 commit into
mainfrom
fix/scope-headers-three-way

Conversation

@joshuarg007

Copy link
Copy Markdown
Contributor

From an outside review.

  • Security fix: custom headers and URL credentials were sent to third-party subresources and across cross-origin redirects. Now scoped per request to the checked origin; test/leak.test.js proves it.
  • Method fix: crawler HTML vs browser HTML vs rendered page, so server differences are no longer blamed on JavaScript.
  • Real Chrome user agent and client hints on the browser readings.
  • robots.txt passes a port of Google's reference conformance cases.
  • 80 tests; 20 protections mutation-tested, all caught.

🤖 Generated with Claude Code

…aps, pass Google's robots.txt cases: 0.3.0

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@joshuarg007
joshuarg007 merged commit 742d96f into main Nov 15, 2026
2 checks passed
@joshuarg007
joshuarg007 deleted the fix/scope-headers-three-way branch November 15, 2026 23:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant