Gemini computer use started rolling out in the Gemini app for Mac today. You need an Apple Silicon Mac and a Google AI Plus, Pro or Ultra plan, and the feature is limited to English in the United States for now.
You describe the task, and Gemini does the clicking and typing for you, including menus and forms, across your local files, desktop apps and the web. Google says the feature is built for repetitive work that normally takes dozens of clicks.
Gemini Fills Forms and Builds Decks
Google gives four examples of chores you can hand to Gemini.
- Creative work, such as batch color-grading photos in design software or setting up complex 3D scenes.
- Shipping quotes, where Gemini pulls weights, dimensions and addresses from local PDFs and fills in multi-box forms.
- Presentations, where Gemini collects metrics and screenshots from live dashboards across multiple regions and builds a deck in Google Slides.
- Resale listings, where Gemini looks at clothing photos in a local folder, researches pricing and logs item details before staging listings on resale platforms.
Gemini Computer Use Runs in the Background
Gemini works inside an isolated background window, and a live preview of that window appears in your chat. Your main screen and cursor stay free, so you can keep working or take a call while the task runs. A long job such as a photo batch or a set of resale listings does not tie up your Mac.
You choose which apps Gemini can access, and you can pause it at any time. Gemini asks for your approval on key actions before they happen, and you can watch each step in the live preview.
Screen sharing already lets you give the app a window or a local file to summarize or analyze, and Gemini for Mac has been gaining more reach into your Mac this year, from voice control with the Fn key to a Messages integration in Connected Apps. Computer use adds the ability to operate other apps on your behalf.
Access Needs a Paid Google AI Plan
Computer use is not available outside the United States yet, and it works in English only. You also need the following.
- An Apple Silicon Mac running macOS Sequoia 15.0 or later.
- A personal Google account that belongs to a user aged 18 or older.
- A Google AI Plus, Pro or Ultra plan.
- The Gemini app for Mac, which you download from gemini.google/mac.
