Sony patents AI to auto-create personalized PS5 highlights

Sony filed a patent in 2023 for an AI-driven system designed to monitor PS5 gameplay and automatically generate personalized highlight reels. The application was published in May 2026 by the U.S. Patent and Trademark Office.

The filing describes continuous observation of gameplay to detect key moments such as boss fights, high scores and decisive kills. Machine learning models would build a profile of a player’s typical performance and rank or select moments based on how meaningful they are relative to that profile. For example, a game-winning double kill could be marked as a highlight for a player who rarely achieves it, while the same event could be deprioritized for a player who achieves it frequently.

The document says the system would assemble video packages and create images from clips and screenshots, producing ready-to-share highlight reels and promotional-style posters. The application outlines technical steps that include real-time monitoring of gameplay events, classification of those events by significance, AI-based scoring and generation of multimedia outputs that combine video and still images.

The filing links the proposed system to existing capture features introduced since the Share button era and frames the technology as an automated alternative to manual recording, trimming and editing. The document states generated packages could emphasize achievements that are unique to each player rather than applying a single metric to all users.

The patent notes potential platform effects, saying increased sharing of standout moments could raise visibility for PlayStation titles and the platform. It provides examples of contextual relevance where rare achievements for one player are elevated while commonplace actions for another may be omitted, allowing highlight reels to reflect individual playstyles.

The publication includes standard patent caveats: filing and publication do not guarantee the technology will appear in a commercial product, and Sony’s intent to develop or deploy the system in a future console or software update is not confirmed. The application joins other filings that explore the use of AI to enhance gaming experiences and social sharing functions.