US Patent Application 18347374. ENCODING/DECODING USER INTERFACE INTERACTIONS simplified abstract

From WikiPatents
Jump to navigation Jump to search

ENCODING/DECODING USER INTERFACE INTERACTIONS

Organization Name

Google LLC


Inventor(s)

Keun Soo Yim of San Jose CA (US)

Ilya Firman of Sunnyvale CA (US)

ENCODING/DECODING USER INTERFACE INTERACTIONS - A simplified explanation of the abstract

This abstract first appeared for US patent application 18347374 titled 'ENCODING/DECODING USER INTERFACE INTERACTIONS

Simplified Explanation

- The patent application describes a method for encoding and decoding user interface interactions. - The method involves receiving a query from a user through an assistant-enabled device. - The query includes the user's intent for interacting with an application. - The method obtains a set of categorized actions for the application. - Each categorized action is associated with one or more parameters and represents a high-level description of the user's intent. - For each categorized action, the method selects a script that performs low-level interactions with the application. - The selected script is executed to represent the user's intent for interacting with the application.


Original Abstract Submitted

A method of encoding and decoding user interface interactions includes receiving a query from a user captured by an assistant-enabled device associated with the user. The query includes a user intent for interacting with an application. The method includes obtaining, for the application, a set of categorized actions. Each categorized action of the set of categorized actions is associated with one or more parameters and represents a high-level description of the user intent of the user interacting with the application. For each respective categorized action of the set of categorized actions, the method includes selecting a respective script associated with the respective categorized action that performs one or more low-level interactions with the application and executing the respective script to represent the user intent for interacting with the application.