Redakcja Choose TV
Google is developing the Gemini app for macOS, adding two productivity-boosting features. From now on, users can dictate text in virtually any app and use analysis of on-screen content. The artificial intelligence will not only transcribe spoken words but also help carry out more complex tasks based on open windows. The company is focusing on more convenient workflows without the need for additional tools. Some of the new features are already being rolled out to users worldwide. Google hopes this will further strengthen Gemini's position within Apple’s ecosystem.
Gemini lets you dictate text in any macOS app
One of the most important new features is system-wide dictation available from within the Gemini app. Just press and hold the Fn key to start recording speech in any macOS window. The AI automatically converts speech into tidy text placed directly at the cursor. The transcription also removes common fillers, such as pauses or unnecessary noises. The feature is on by default and requires no extra setup. That makes it possible to quickly write emails, reply to messages, or create documents using only your voice. Similar capabilities have previously been offered by apps like Wispr Flow and Willow. In many cases they required a separate installation or a paid subscription. Google integrates this feature directly into Gemini, which may reduce the need to use external tools. Currently dictation supports English only. The company says it will expand the list of supported languages later this year. The update is being gradually rolled out to all users of the Gemini app on macOS.
Artificial intelligence can analyze screen content and perform tasks
The second new feature is a function that analyzes the content of active windows displayed on the computer screen. The solution works only with the user's consent and uses open apps as the context for commands given to Gemini. For example, the AI can turn selected notes into an organized summary and automatically paste it at the cursor. Google also showed a more advanced use of this feature when planning a team meeting. Gemini can read information from open documents about the budget and participants' food preferences. It then prepares an email that takes all the found information into account. In the demo, the system also added suggestions for nearby venues found in Google Maps. According to Google, the new capabilities make Gemini a far more advanced assistant than before. The company emphasizes that these features go beyond simply answering questions and help carry out specific tasks. At the same time, Google notes that the solution gives the user control over sharing screen content. The updates are also intended to provide an edge over solutions currently being developed by Apple. The company says it will continue to develop the Gemini app on macOS.
Google consistently expands Gemini's capabilities on Macs. System-wide text dictation and on-screen content analysis are intended to simplify everyday tasks and make AI an even more practical tool for macOS users.
source: digitaltrends
