Skip to content

About

Select anything on your Windows screen and ask Gemini, recognize text, translate, or search with Google Lens.

Topics

Resources

Stars

14 stars

Watchers

1 watching

Forks

Latest commit

 

History

5 Commits

Folders and files

Repository files navigation

Magic Pointer

Shake your mouse, select anything on screen, and ask Gemini, ChatGPT or Claude about it. Magic Pointer brings the Googlebook-style AI pointer to Windows.

GitHub · Discord: rono007

Install with Windhawk

Magic Pointer in action

Getting started

Install Windhawk, open Explore, and search for Magic Pointer. Install the mod and adjust its settings to your liking.

  1. Shake your mouse or press Win+Shift+G.
  2. Click a highlighted element, or drag to select an area.
  3. Ask a question in the selection card or choose an action.

You can also just start typing right after step 1: the card opens at the pointer with your text and no image. Turn this off with the Start typing to ask setting.

Press Esc or right-click to dismiss the pointer.

Features

  • Ask Gemini, ChatGPT or Claude about images, text, and anything else on screen.
  • Start typing as soon as the pointer appears to ask without selecting anything.
  • Use your own Gemini, ChatGPT or Claude API key, or no key at all.
  • Stream answers into the card and ask follow-up questions.
  • Open a Gemini browser draft with your selections attached.
  • Recognize and copy text with Windows OCR.
  • Translate selected text and search images with Google Lens.
  • Use your own .cur or .ani file as the pointer, with the same glow.
  • Customize appearance, activation, browser, and excluded apps.
  • Speaks 33 languages and follows your Windows display language.

Gemini, ChatGPT and Claude

Browser actions work without an API key. Magic Pointer prepares a new Gemini draft for you to review and send.

Paste an API key in the mod's Windhawk settings to receive answers directly in the card. You can ask follow-up questions. There is just one API key setting: the mod recognizes which service a key belongs to.

With a key, that assistant handles everything that needs one: answers, follow-up questions, Smart suggestions and Translate. The Model setting chooses how it answers: Fast (the default), Balanced or Smartest. If the chosen model isn't available, a faster one answers instead.

Smart suggestions are optional and disabled by default. When enabled, the assistant suggests up to three things to do with each selection.

Languages

The hint, the card, its buttons and its messages appear in your Windows display language, or in the language you choose with the Language setting. The settings page is translated too, in the languages Windhawk itself offers.

Available: English, Arabic, Bengali, Chinese (Simplified and Traditional), Croatian, Czech, Danish, Dutch, Finnish, French, German, Greek, Hebrew, Hindi, Hungarian, Indonesian, Italian, Japanese, Korean, Norwegian, Persian, Polish, Portuguese (Brazil), Romanian, Russian, Spanish, Swedish, Tamil, Thai, Turkish, Ukrainian and Vietnamese. Any other language shows English.

The translations were written with the help of AI, and not every one has been checked by a native speaker. To fix or improve a text, or to add a language, open an issue.

Privacy

Text recognition runs locally. Gemini and Google Lens actions send the selected content to Google's services. With an API key, asking, suggestions and Translate send it to the service that owns the key: Google, OpenAI or Anthropic. Enabling Smart suggestions with an API key sends each selection to that service automatically. See the mod documentation for the full privacy and temporary-file details.

Report a problem

Open an issue with your Windows version, Windhawk version, Magic Pointer version, and steps to reproduce the problem. Include screenshots when useful and remove private content.

License

MIT · Rono

About

Select anything on your Windows screen and ask Gemini, recognize text, translate, or search with Google Lens.

Topics

Resources

Stars

14 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages