18809564. SYSTEMS AND METHODS FOR RESOURCE-OPTIMIZED MIXED REALITY USING USER-CENTRIC ADAPTIVE OBJECT DETECTION (Toyota Motor Engineering & Manufacturing North America, Inc.)

SYSTEMS AND METHODS FOR RESOURCE-OPTIMIZED MIXED REALITY USING USER-CENTRIC ADAPTIVE OBJECT DETECTION

Organization Name

Toyota Motor Engineering & Manufacturing North America, Inc.

Inventor(s)

Daniel Doe of San Jose CA US

Dawei Chen of Milpitas CA US

Kyungtae Han of Palo Alto CA US

SYSTEMS AND METHODS FOR RESOURCE-OPTIMIZED MIXED REALITY USING USER-CENTRIC ADAPTIVE OBJECT DETECTION

This abstract first appeared for US patent application 18809564 titled 'SYSTEMS AND METHODS FOR RESOURCE-OPTIMIZED MIXED REALITY USING USER-CENTRIC ADAPTIVE OBJECT DETECTION

Original Abstract Submitted

System and method for reducing latency and bandwidth usage in reality devices include a reality device and one or more processors. The reality device includes a camera to operably capture a set of consequent frames of views external to a vehicle. The one or more processors are operable to monitor movements of one or more eyes of a user to obtain eye-tracking data using the reality device, identify an area of interest (AoI) in the frame based on the eye-tracking data, AoI history, or driving statistics of the user, crop the frame to obtain a reduced-size frame including the AoI in the frame, and transmit the reduced-size frame to an edge server for performing a task on behalf of the vehicle.