SONY INTERACTIVE ENTERTAINMENT LLC (20250058214). MODALITY-EXPANDING GAMING EXPERIENCE
Contents
MODALITY-EXPANDING GAMING EXPERIENCE
Organization Name
SONY INTERACTIVE ENTERTAINMENT LLC
Inventor(s)
Chockalingam Ravi Sundaram of Belmont CA (US)
Lakshmish Kaushik of San Jose CA (US)
Ayush Raina of Foster City CA (US)
Kusha Sridhar of Foster City CA (US)
MODALITY-EXPANDING GAMING EXPERIENCE
This abstract first appeared for US patent application 20250058214 titled 'MODALITY-EXPANDING GAMING EXPERIENCE
Original Abstract Submitted
systems and methods are disclosed for expanding the output modalities of a gameplay session. gameplay input data, such as audio data, video data, haptics data, and gameplay context data, can be processed using machine learning (ml) models to generate output state vectors, which can be used to drive state changes in remote devices, such as smarthome devices (e.g., smart lightbulbs, smart light switches, smart fans, smart thermostats, smart blinds, smart speakers, etc.). to generate the output state vectors, first gameplay features are extracted from the gameplay input data, then the gameplay features are processed by a state vector generation model to generate the state vectors. each modality of gameplay input data can be processed by a corresponding feature extractor. gameplay sessions can be evaluated to train the ml models.
