Katarzyna Petru
Microsoft is testing a solution that could change the way gamers save and share their best moments. The feature, called Highlight Reels, is meant to automatically analyse gameplay in real-time and create ready-to-use clips without pressing a recording button. Interestingly, the technology is not being tested on the classic Xbox console, but on the handheld ROG Xbox Ally X. This Asus device features an AMD chip equipped with a dedicated NPU module for AI computations.
AI instead of a classic DVR
Highlight Reels does not function like a traditional recorder that saves everything in the background. The system is designed to analyse the image in real-time and decide for itself when something worth noting has occurred. In practice, this means recognising: spectacular victories, key plot moments, spectacular actions in shooters, unusual or humorous situations. Everything is processed locally, without sending the image to the cloud. This is where the NPU plays a crucial role, offloading the CPU and GPU and minimising the impact on the performance and battery of the device. The feature is being tested in many games of different genres, including Forza Horizon 5, Elden Ring, Fortnite, Overwatch 2, and Call of Duty. This is important because the algorithm must recognise "strong moments" in completely different gaming contexts.
Why are tests being conducted on a handheld device?
At first glance, this may seem puzzling. If the feature is set to be included in the next generation of Xbox, why is it being tested on an Asus device? For months, there have been reports suggesting that the next Xbox may be closer to a classic PC running Windows 11 than to a traditional console. The ROG Xbox Ally X with the Xbox Full Screen Experience interface provides a convenient testing environment. It is a mobile device with Windows, AMD APU, and NPU, which allows for testing how AI performs in real-world conditions. If the future Xbox is indeed a hybrid of a console and a computer, such tests make sense.
Element of a larger AI strategy
Highlight Reels is not an isolated project. Microsoft is developing a whole suite of artificial intelligence-based features: Postgame Recaps, which are automatic session summaries, Gaming Copilot with real-time suggestions, Auto SR, a system-level image upscaling supported by AI. In this context, automatic cutting of the best moments seems like a natural extension of the ecosystem. However, the question arises as to whether players actually need this. The DVR system in Windows can be unreliable, and the Xbox app on PC does not always work perfectly. The new feature could be a significant convenience for content creators, but its success depends on the accuracy of the algorithms.
Highlight Reels shows that Microsoft wants future consoles to be not only a gaming platform but also a content creation tool. Automatically editing the best actions without pressing the recording button sounds like a convenient solution, but everything depends on the quality of the AI's performance. If the algorithms can indeed accurately recognise the most interesting moments, the feature could become a standard in next-gen devices.
source: Spider’s Web, Windows Central
