Skip to content

Document the screenshot tool, reframe computer_action - #473

Closed
masnwilliams wants to merge 1 commit into
mainfrom
hypeship/mcp-screenshot-tool-docs
Closed

Document the screenshot tool, reframe computer_action#473
masnwilliams wants to merge 1 commit into
mainfrom
hypeship/mcp-screenshot-tool-docs

Conversation

@masnwilliams

@masnwilliams masnwilliams commented Aug 2, 2026

Copy link
Copy Markdown
Contributor

Docs for the MCP server change that splits screenshot out of computer_action into its own read-only tool (kernel/kernel-mcp-server#135). Merge after that ships.

Changes

  • New page: reference/mcp-server/tools/screenshot — parameters, the region crop, and the coordinate space each capture reports. Full-screen captures return screen coordinates you can pass straight to computer_action; cropped captures state the offset you need to add, which is the part callers previously had no way to know.
  • computer_action — rewritten as the fallback for surfaces a selector can't reach (canvas, embedded PDFs, native dialogs, drag). screenshot removed from the action table, and the "always end with a screenshot" tip replaced with guidance to prefer execute_playwright_code and to note that coordinate accuracy depends on the calling model's pixel grounding.
  • execute_playwright_code — stated as the primary way to drive a browser, with a pointer to ariaSnapshot() for locating elements without reading pixels. The existing tip now links the standalone screenshot tool.
  • docs.json — added the new page and reordered the Tools group so execute_playwright_codescreenshotcomputer_action reflects what to reach for first.
  • integrations/vercel/eve-extension — the tool list described computer_action as including screenshot controls, which is no longer true. Updated that line and added screenshot to the allow-list example.

Out of scope but included

The computer_action action table was missing write_clipboard and read_clipboard. Both already existed on the tool; they're added here because read_clipboard is one of the terminal actions the surrounding note describes, so the table would be misleading without them.

changelog.mdx mentions the old behavior and is left alone as a historical record.

Testing

Not rendered locally — the Mintlify CLI wouldn't install in this environment (a dependency's postinstall fails). docs.json parses as valid JSON, and every internal link in the changed files was checked against an existing .mdx path by hand. Worth a preview check before merging.


Note

Low Risk
Documentation and navigation only; no runtime or API behavior changes in this repo.

Overview
Documents the MCP split that moves screenshot out of computer_action into its own read-only tool, aligned with kernel-mcp-server#135.

Adds reference/mcp-server/tools/screenshot with session_id, optional region crop, and how full-screen vs cropped captures map to screen coordinates for computer_action. computer_action is reframed as coordinate-level mouse/keyboard/clipboard fallback when selectors cannot reach the UI; the screenshot action is removed from its action table, with guidance to prefer execute_playwright_code and to confirm results via the separate screenshot tool. write_clipboard / read_clipboard are documented in the action table. execute_playwright_code is described as the primary automation path, with tips pointing at screenshot and ariaSnapshot() instead of pixel reads.

docs.json adds the new page and orders Tools as Playwright → screenshot → computer_action. integrations/vercel/eve-extension lists screenshot separately and includes it in the connection allow-list example.

Reviewed by Cursor Bugbot for commit fdea096. Bugbot is set up for automated code reviews on this repo. Configure here.

The MCP server splits screenshot out of computer_action into its own
read-only tool, and points callers at execute_playwright_code as the default
way to drive a browser.

Add a screenshot reference page covering the region parameter and the
coordinate space each capture reports, and rewrite computer_action as the
fallback for surfaces a selector can't reach. The action table also gains the
write_clipboard and read_clipboard rows it was missing.
@mintlify

mintlify Bot commented Aug 2, 2026

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
Kernel 🟢 Ready View Preview Aug 2, 2026, 8:35 PM

💡 Tip: Enable Workflows to automatically generate PRs for you.

@vercel

vercel Bot commented Aug 2, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
docs Error Error Aug 2, 2026 8:34pm

@masnwilliams
masnwilliams marked this pull request as ready for review August 3, 2026 16:03

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Risk assessment: Very Low

Verdict: Approve

Evidence (from diff only)

Signal Observation
Files 5 changed: docs.json, 3 existing .mdx pages, 1 new .mdx page
Size +71 / −10
Codepaths Mintlify docs content and sidebar navigation only
Blast radius Docs site rendering/navigation; no application runtime, auth, billing, infra, or schema
Complexity Straightforward reference rewrites and a new tool page

What changed

  • Adds reference/mcp-server/tools/screenshot.mdx documenting a standalone screenshot tool (params, crop/region, coordinate-space notes).
  • Updates computer-action.mdx and execute-playwright-code.mdx guidance and action tables to match that split (including documenting clipboard actions already present on the tool).
  • Reorders the Tools group in docs.json and updates the Eve extension integration page tool list / allow-list example.

Why Very Low

This is documentation and docs navigation only. No production logic, shared libraries, infrastructure, or security boundaries are modified in this repository. No CODEOWNERS file is present, and there is no prior approval to re-evaluate.

Action: Approved per Very Low risk criteria.

Open in Web View Automation 

Sent by Cursor Automation: Assign PR reviewers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant