18485422. Visual Search Interface in an Operating System (Google LLC)

Visual Search Interface in an Operating System

Organization Name

Google LLC

Inventor(s)

Golden Gopal Krishna of Albany CA US

Simon Edward Roberts of Brighton and Hove GB

Sarah Fay Smith of San Francisco CA US

Rosemary Margaret La Prairie of London GB

Zhipeng Pan of San Mateo CA US

Clement Dickinson Wright of Los Angeles CA US

Shadia Walsh of San Francisco CA US

Carsten Hinz of Mountain View CA US

Stacy Lou Chiou of Los Angeles CA US

Visual Search Interface in an Operating System

This abstract first appeared for US patent application 18485422 titled 'Visual Search Interface in an Operating System

Original Abstract Submitted

Visual search in an operating system of a computing device can process and provide additional information on the content being provided for display. The computing device can include an operating system that includes a visual search interface that obtains and processes display data associated with content currently being provided for display. The visual search interface can generate display data based on the current content provided for display, process the display data with one or more on-device machine-learned models, and provide additional information to the user. The visual search interface may transmit data associated with the display data to perform additional data processing tasks. Application suggestions may be determined and provided based on the visual search data.