Redakcja Choose TV
Google is developing the Gemini app for macOS, adding two productivity-boosting features. From now on, users can dictate text in virtually any app and use analysis of on-screen content. The AI will not only transcribe spoken words but also help carry out more complex tasks based on open windows. The company is aiming for more convenient working without the need for extra tools. Some of the new features are already being rolled out to users around the world. Google hopes this will further strengthen Gemini's position in Apple's ecosystem.
Gemini allows you to dictate text in any app on your Mac
One of the most important new features is system-wide dictation available from within the Gemini app. Just hold down the Fn key to start recording your speech in any macOS window. The artificial intelligence automatically converts speech into organised text placed directly at the cursor. Common disfluencies, such as pauses and unnecessary noises, are also removed during transcription. The feature is enabled by default and requires no extra configuration. This makes it possible to quickly write emails, reply to messages or create documents using only your voice. Until now, similar capabilities were offered by apps such as Wispr Flow and Willow. In many cases, however, they required a separate installation or a paid subscription. Google is integrating this feature directly into Gemini, which may reduce the need to rely on external tools. Currently dictation supports English only. The company says it will expand the list of supported languages later this year. The update is being rolled out gradually to all Gemini users on macOS.
Artificial intelligence can analyse screen content and carry out tasks
The second new feature analyses the contents of active windows displayed on the computer screen. The solution works only with the user's consent and uses open apps as context for commands given to Gemini. For example, the artificial intelligence can turn highlighted notes into an organised summary and automatically paste it where the cursor is. Google also showed a more advanced use of this feature when planning a team meeting. Gemini can read information from open documents about the budget and participants' dietary preferences. It then prepares an email incorporating all the information it found. In the demo the system also added suggestions for nearby venues found in Google Maps. According to Google, the new capabilities make Gemini a significantly more advanced assistant than before. The company emphasises that these functions go beyond merely answering questions and help carry out specific tasks. At the same time, Google stresses that the solution gives users control over sharing screen content. The new features are also intended to provide an edge over solutions currently being developed by Apple. The company says it will continue to develop the Gemini app for the macOS platform.
Google is steadily expanding Gemini's capabilities on Macs. System-wide text dictation and analysis of on-screen content aim to make everyday tasks easier and to make artificial intelligence an even more practical tool for macOS users.
source: digitaltrends
