-
Notifications
You must be signed in to change notification settings - Fork 3.8k
docs: publish translated docs in twelve languages and the tool that maintains them #3280
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
7 commits
Select commit
Hold shift + click to select a range
c65a026
Publish translated docs (zh-CN, ja, ko, pt-BR) and the tool that main…
maxisbey 6107a94
Trim the translation tooling to what publishing needs
maxisbey 4c0a8bb
Extend the translated docs to twelve languages
maxisbey d37ff04
Simplify the heading attribute pattern
maxisbey 00e9565
Address review comments on the translation tooling
maxisbey 8ed9da1
Serve stored translations as generated; make site links relative
maxisbey cf1a61f
Keep language builds from stopping on a stale snippet path
maxisbey File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -21,6 +21,7 @@ on: | |
| paths: | ||
| - docs/** | ||
| - docs_src/** | ||
| - i18n/** | ||
| - mkdocs.yml | ||
| - scripts/docs/** | ||
| - pyproject.toml | ||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| // The theme links each language-switcher entry to that language's home page. | ||
| // Point the entries at the current page on each language's site instead: every | ||
| // prose page exists at the same path on all of them. The API reference is | ||
| // English-only, so from there the entries keep pointing at the site roots. | ||
| // Instant navigation swaps the page but keeps the header, so re-run on every | ||
| // page the theme loads (`document$`) rather than once. | ||
| const base = JSON.parse(document.getElementById("__config").textContent).base; | ||
| // The site root as a directory path; `base` lacks the trailing slash on 404 pages. | ||
| const site = new URL(base.replace(/\/?$/, "/"), location).pathname; | ||
|
|
||
| document$.subscribe(() => { | ||
| let page = location.pathname.slice(site.length); | ||
| if (page.startsWith("api/")) page = ""; | ||
| for (const entry of document.querySelectorAll(".md-select__link[hreflang]")) { | ||
| // The language root the theme rendered, relative to the page first shown. | ||
| entry.dataset.site ??= new URL(entry.getAttribute("href"), location).pathname; | ||
| entry.href = entry.dataset.site + page; | ||
| } | ||
| }); | ||
|
maxisbey marked this conversation as resolved.
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,25 @@ | ||
| # Translations | ||
|
|
||
| This documentation is written in English. To make it useful to more people, we also publish machine-translated editions of it, and this page explains what that means for you and how to help improve them. | ||
|
|
||
| ## What's available | ||
|
|
||
| Translated documentation is currently a **preview** in twelve languages: Deutsch, español, français, हिन्दी, 日本語, 한국어, português (Brasil), русский язык, Türkçe, українська мова, 简体中文 and 繁體中文. Pick one from the language switcher at the top of any page. More languages may follow once these have proved themselves. | ||
|
|
||
| The API reference is not translated: the translated site links to the single English one. | ||
|
|
||
| ## English is the source of truth | ||
|
|
||
| If a translated page and its English original disagree, the English page is correct. Every page of a translated site opens with one of three notes saying where it stands: | ||
|
|
||
| - **Machine translation** — the page was translated automatically and links to its English original. | ||
| - **Translation behind the English page** — the English original changed after the page was translated. You are still reading that translation, so parts of it may be out of date until it catches up; the note links to the current English page. | ||
| - **Shown in English** — the page has not been translated yet, so you are reading the English text. | ||
|
|
||
| ## How the translations are made | ||
|
|
||
| Translated pages are machine-generated by a tool in this repository from the English pages under `docs/`, guided by two human-written inputs per language: a style guide (register, tone, typography, how to handle jokes and idioms) and a glossary (which terms stay in English, and the required and forbidden renderings for the rest). The generated text is never edited by hand. Every improvement goes into those inputs instead, so it survives the next time the pages are regenerated. | ||
|
maxisbey marked this conversation as resolved.
|
||
|
|
||
| ## Reporting a translation problem | ||
|
|
||
| Found a wrong term, an awkward sentence, or a translation that says something the English doesn't? [Open an issue](https://github.com/modelcontextprotocol/python-sdk/issues) with the language, the page and the passage; reports from native speakers are especially valuable. If you know the fix, propose it directly as a pull request against that language's style guide (`instructions.md`) or glossary (`glossary.json`) under [`i18n/`](https://github.com/modelcontextprotocol/python-sdk/tree/main/i18n) — the correction then reaches every affected page the next time the translations are regenerated. Problems with the English text itself are fixed in the pages under `docs/`, like any other documentation change. | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| # Documentation translations | ||
|
|
||
| The English pages under `docs/` are the source. This directory holds what steers their machine translation and the generated result; [`docs/translations.md`](../docs/translations.md) is the reader-facing explanation. | ||
|
|
||
| - `languages.yml` — the registry: one entry per translated site (served at `/<code>/`), the model id, and the nav pages that stay in English. | ||
|
maxisbey marked this conversation as resolved.
|
||
| - `general-prompt.md` — translation rules shared by every language. `notices.md` — English source of the three notes staged onto the pages of a translated site. | ||
|
maxisbey marked this conversation as resolved.
|
||
| - `<code>/instructions.md` (register, voice, typography, terminology) and `<code>/glossary.json` (`keep`: terms that stay in English; `terms`: required renderings, each with an optional `note` and banned `avoid` renderings, which are checked) — human-authored, sent with every request. | ||
|
claude[bot] marked this conversation as resolved.
|
||
| - `<code>/pages/**` and `<code>/notices.md` — **generated**, never edited by hand: a correction goes into that language's `instructions.md` or `glossary.json` (or the English page), and the affected pages are re-run. | ||
|
maxisbey marked this conversation as resolved.
|
||
|
|
||
| ## The tool | ||
|
|
||
| ```text | ||
| uv run --frozen python scripts/docs/translations.py status [--lang CODE] | ||
| uv run --frozen --group translate python scripts/docs/translations.py translate --lang CODE [--pages PATH ...] | ||
|
maxisbey marked this conversation as resolved.
|
||
| uv run --frozen python scripts/docs/translations.py stage [--lang CODE] | ||
| ``` | ||
|
maxisbey marked this conversation as resolved.
claude[bot] marked this conversation as resolved.
|
||
|
|
||
| `status` is offline: per language it lists missing, outdated (with the sections that changed), current and removable pages (translations whose English page is gone — `git rm` them). `translate` calls the Claude API (`ANTHROPIC_API_KEY` in the environment; the registry's model, or `DOCS_TRANSLATE_MODEL` to trial another) for the missing and outdated pages, retranslating only the English sections that changed and keeping the rest byte for byte; `--pages` instead re-translates exactly the named pages from scratch, which is also how a glossary or instructions change reaches existing pages (each generated page records the English section hashes it reflects, so editing those inputs invalidates nothing). `stage` assembles the tree each language site is built from (every language's, or one with `--lang`): each generated page exactly as it was generated, under an "outdated" notice linking the current English page when the English has changed since, and the English page where nothing was generated yet; `scripts/docs/build.sh` runs it before building them. Commit the generated pages in an ordinary pull request. | ||
|
claude[bot] marked this conversation as resolved.
claude[bot] marked this conversation as resolved.
|
||
|
|
||
| To add a language, add an entry to `languages.yml`, write `<code>/instructions.md` (the sections the `pt` file has) and `<code>/glossary.json`, then run `translate --lang <code>`. | ||
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.