Sony AI Eye Tech to Predict Your Next Button Push

Sony's new patent, WO2025010132, titled "Timed Input/Action Release," aims to revolutionize gaming by significantly reducing latency. The patent, first highlighted by Tech4gamers, focuses on predicting user inputs to streamline command execution. This innovative approach addresses the inherent delay between user input and system processing, a common issue exacerbated by advanced graphics technologies like frame generation.

Sony's PlayStation 5 Pro already utilizes PlayStation Spectral Super Resolution (PSSR), an upscaler, but newer technologies often introduce latency. Competitors AMD and Nvidia have addressed this with Radeon Anti-Lag and Nvidia Reflex, respectively, prompting Sony to explore its own solution.

The patent details a system incorporating a machine-learning AI model that anticipates user inputs. This prediction is enhanced by an external sensor, potentially a camera monitoring the controller, to identify the impending button press. The patent explicitly mentions using "camera input as an input to a machine learning (ML) model," illustrating the sensor's role in refining predictions.

Alternatively, the sensor could be integrated directly into the controller's buttons, potentially leveraging analog inputs, a technology Sony has historically championed. While the exact implementation in a future PlayStation console (like the hypothetical PlayStation 6) remains uncertain, the patent signifies Sony's commitment to minimizing latency without compromising responsiveness.

This technology holds significant promise for fast-paced games requiring both high frame rates and low latency, such as twitch shooters. The success of technologies like FSR 3 and DLSS 3, which introduce frame latency, further underscores the importance of Sony's innovative approach. However, the eventual integration of this patent into future hardware remains to be seen.