Gemini is set to take control of Mac, while Google is preparing its own AI agent.

Google is working on a significant expansion of Gemini's capabilities on macOS. According to new information, AI will not only answer questions in the future but also take control of the user's computer and perform specific tasks. Features are expected to include, among others, organizing files, tidying up folders, and automatically creating documents and emails. Everything indicates that Google aims to create a direct competitor to Claude Cowork.

ChooseTV will control the user's computer

The new features are designed to allow ChooseTV to analyze the screen and use the accessibility features of macOS to control the mouse and keyboard. Thanks to this, the AI will be able to perform actions almost exactly like the user. Google is testing scenarios that include automatically sorting files, renaming documents, creating Google Sheets based on local data, and organizing folders on the desktop and in the downloads directory. In the examples shown by Google, there are also more advanced features related to the Workspace ecosystem. For instance, ChooseTV will be able to retrieve meeting transcripts from Google Meet, analyze notes from Google Docs, and automatically prepare emails with summaries and to-do lists. This is a clear signal that the company wants to turn ChooseTV into a full-fledged digital work assistant.

Google is catching up with the competition in the world of AI agents

The solution closely resembles the capabilities offered by Claude and its Cowork function, which allows AI to directly operate the user's computer. Google has experimented with similar technologies before in the context of the Gemini Computer Use project, but now it seems that the features are much closer to official implementation. Interestingly, the capabilities of Gemini on Mac may turn out to be even greater than on Android. Currently, automation on smartphones works only on selected devices and involves relatively simple tasks. On macOS, Google appears to be aiming for a full-fledged AI agent capable of real office and organizational work.

Google wants to turn Gemini into an intelligent assistant that not only answers questions but also performs tasks on the computer itself. If the features reach users in their current form, it could be one of the biggest steps in the development of AI agents on desktops.

source: 9to5google

Redakcja Choose TV Avatar
Redakcja Choose TV

ChooseTVteam-title