Redakcja Choose TV
Google is expanding the Gemini app for macOS, adding two productivity-boosting features. From now on, users can dictate text in virtually any app and use analysis of on-screen content. The AI will not only transcribe spoken words but also help carry out more complex tasks based on open windows. The company aims for a more convenient workflow without the need for additional tools. Some of the new features are already being rolled out to users worldwide. Google hopes this will further strengthen Gemini’s position within Apple’s ecosystem.
Gemini lets you dictate text in any Mac app
One of the biggest additions is system-wide text dictation available from within the Gemini app. Just hold the Fn key to start recording your speech in any macOS window. The AI automatically converts speech into cleaned-up text placed directly at the cursor. The transcription also removes common disfluencies, such as pauses or unnecessary noises. The feature is enabled by default and requires no additional setup. That makes it possible to quickly compose emails, reply to messages or create documents using only your voice. Until now, similar capabilities have been offered by apps such as Wispr Flow and Willow. In many cases, though, they required separate installation or a paid subscription. Google integrates this feature directly into Gemini, which could reduce the need for external tools. Dictation currently supports English only. The company says it will expand the list of supported languages later this year. The update is being rolled out gradually to all Gemini users on macOS.
Artificial intelligence can analyse screen content and perform tasks
The second new feature analyses the contents of active windows on your computer screen. The feature only works with the user's consent and uses open apps as context for commands issued to Gemini. For example, the AI can turn selected notes into an organised summary and automatically paste it at the cursor. Google also demonstrated a more elaborate use of the feature while planning a team meeting. Gemini can read information from open documents about the budget and participants' dietary preferences. It then prepares an email that incorporates all the information it found. In the demo example the system also added suggestions for nearby venues found in Google Maps. According to Google, the new capabilities make Gemini a much more advanced assistant than before. The company stresses that these features go beyond simply answering questions and help carry out specific tasks. At the same time Google notes that the solution gives users control over sharing their screen content. The new features are also intended to give Google an advantage over solutions currently being developed by Apple. The company says it will continue to develop the Gemini app on macOS.
Google is steadily expanding Gemini's capabilities on Macs. System-wide text dictation and screen content analysis are designed to make everyday work easier and to make artificial intelligence an even more practical tool for macOS users.
source: digitaltrends
