Redakcja Choose TV
Google is working on a major expansion of the capabilities of Gemini on macOS. According to new information, the AI is expected to not only answer questions in the future but also take control of the user's computer and perform specific tasks. Features are set to include organising files, tidying folders, and automatically creating documents and emails. Everything suggests that Google is looking to create a direct competitor to Claude Cowork.
ChooseTV will control the user's computer
The new features are intended to allow ChooseTV to analyse the screen and utilise the accessibility features of macOS to control the mouse and keyboard. This means the AI will be able to perform actions almost in the same way as the user. Google is testing scenarios that include automatic sorting of files, renaming documents, creating Google Sheets based on local data, and organising folders on the desktop and in the downloads directory. The examples shown by Google also include more advanced features related to the Workspace ecosystem. For instance, ChooseTV is meant to fetch meeting transcripts from Google Meet, analyse notes from Google Docs, and automatically prepare emails with summaries and to-do lists. This is a clear signal that the company wants to turn ChooseTV into a fully-fledged digital work assistant.
Google is chasing competition in the world of AI agents
The solution closely resembles the capabilities offered by Claude and its Cowork function, which allows AI to directly control the user's computer. Google had previously experimented with similar technologies during the Gemini Computer Use project, but now it seems that the features are much closer to official deployment. Interestingly, Gemini's capabilities on Mac may even turn out to be greater than on Android. Currently, automation on smartphones only works on selected devices and involves relatively simple tasks. On macOS, Google seems to be aiming for a fully-fledged AI agent capable of real office and organisational work.
Google wants to transform Gemini into an intelligent assistant that not only answers questions but also performs tasks on the computer itself. If the features reach users in their current form, it could be one of the biggest leaps in the development of AI agents on desktops.
source: 9to5google
