z0 - point agents at llms.txt and per-page .md - #366
Merged
Conversation
Advertise the machine-readable docs in <head> on every page and in robots.txt -- llms.txt was previously only reachable via the navbar icon. Per-page markdown alternates already existed via DocItem/Layout. Emit an RFC 8288 Link header on docs pages so agents fetching over plain HTTP (or HEAD) find the .md twin without parsing HTML. The nginx map only matches extensionless paths, so assets, the .md files themselves, /discord and /search are skipped; an empty value makes nginx omit the header. Fix bogus .md URLs answering 200 with the 260kB HTML shell -- the static base falls back to /index.html, which agents read as a successful fetch. Narrow the .md location to try_files $uri =404. The patch is self- reverting: it no-ops if the config differs, and a failed nginx -t restores the backup. Also correct the llms.txt descriptions (llms-full.txt is all 349 pages, not "without examples") and regenerate the bundles, which were stale. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Advertise the machine-readable docs in on every page and in robots.txt -- llms.txt was previously only reachable via the navbar icon. Per-page markdown alternates already existed via DocItem/Layout.
Emit an RFC 8288 Link header on docs pages so agents fetching over plain HTTP (or HEAD) find the .md twin without parsing HTML. The nginx map only matches extensionless paths, so assets, the .md files themselves, /discord and /search are skipped; an empty value makes nginx omit the header.
Fix bogus .md URLs answering 200 with the 260kB HTML shell -- the static base falls back to /index.html, which agents read as a successful fetch. Narrow the .md location to try_files $uri =404. The patch is self- reverting: it no-ops if the config differs, and a failed nginx -t restores the backup.
Also correct the llms.txt descriptions (llms-full.txt is all 349 pages, not "without examples") and regenerate the bundles, which were stale.
What Type of Change is this?
Description (required)
Related issues & labels (optional)