A recent patent application from Microsoft has surfaced, revealing plans for an AI assistant designed to take control of Xbox sessions temporarily, permitting the AI to play games on behalf of users. This filing follows a similar patent by Sony, which proposed an AI helper for their gaming platform.

Discovered by Tech4Games, Microsoft’s patent involves a concept dubbed “state management for video game help sessions,” submitted in 2024. The initiative aims to enhance the current, basic methods available for players facing in-game challenges, which Microsoft describes as often requiring considerable effort to overcome.

The patent outlines the potential for cloud-based assistance sessions that could involve various forms of communication, such as text, chat, or video. This would enable players to hand over control of their gaming session to either another human or an AI, leading to an “updated help session state” that players can either accept to continue or reject to revert to the original state.

The term “another game player” refers to either a live person or, in certain instances, an AI model capable of understanding game elements—often referred to as a “generative model.” This model could analyze input images and generate diverse outputs, including text, images, audio, and more, to aid in gameplay.

Additionally, the patent touches upon the possibility of rating helpers based on their overall performance, specific game metrics, and genre ratings, which players could use when selecting assistance for their gaming sessions.

This filing offers a glimpse into Microsoft’s vision for gaming assistance as early as 2024. It follows the previous launch of Xbox’s Gaming Copilot, an AI-powered companion that provides real-time support in titles like Minecraft.

In comparison, Sony’s patent revealed plans for an in-game AI ‘ghost’ designed to aid PlayStation players by providing instructions or even completing sections of a game when needed.

Despite the excitement surrounding AI advancements, some controversies remain. Concerns about the ethical implications and environmental impact of generative AI are prevalent, especially given the substantial memory and processing demands these technologies impose. This has led to significant challenges in the consumer electronics space, with companies like Valve delaying products and both Nintendo and Sony reevaluating pricing strategies for their next-gen consoles.

In light of these complexities, Asha Sharma, the new head of gaming at Xbox, recently expressed her concerns regarding the rise of ineffective AI, emphasizing the necessity for improvement in this rapidly evolving field.