Google has confirmed that it’s recently brought over new updates for the Gemini app for macOS, which now gives users the option of using voice commands to create, edit, and summarize content anywhere on their desktop, all AI. The feature works by long-pressing the “Fn” key, which activates a new intelligent dictation mode.
As for what it actually does, the new feature allows your Mac to transcribe spoken speech directly into clean, formatted text at the user’s cursor. The system automatically takes out filler words like “ums” and “ahs” while making real-time adjustments for mid-sentence corrections.
READ: You can Now Use Gemini to Create Presentations in Google Slides
Users can also choose to enable screen-aware context reasoning through the app’s settings—this allows Gemini to execute complex tasks based on on-screen content, such as highlighting local files, documents, or images and speaking instructions directly to the app. As per Google:
If you want Gemini to do more than intelligently transcribe, you can opt into Gemini reasoning through your settings. Once enabled, Gemini can understand the context on your screen to help you execute complex tasks.
That in mind, this expanded ability lets users extract and summarize data across multiple local files, select and rewrite text into different tones or formats, and even generate or iterate on images directly on their desktop using voice prompts.
The updated Gemini for macOS app is available for download at gemini.google/mac, and is rolling out globally in English to all Gemini for macOS app users today, with support for additional languages planned in the near future.
