ENCODING/DECODING USER INTERFACE INTERACTIONS

Abstract: a method of encoding and decoding user interface interactions includes receiving a query from a user captured by an assistant-enabled device associated with the user. the query includes a user intent for interacting with an application. the method includes obtaining, for the application, a set of categorized actions. each categorized action of the set of categorized actions is associated with one or more parameters and represents a high-level description of the user intent of the user interacting with the application. for each respective categorized action of the set of categorized actions, the method includes selecting a respective script associated with the respective categorized action that performs one or more low-level interactions with the application and executing the respective script to represent the user intent for interacting with the application.

Inventor(s): Keun Soo Yim, Ilya Firman

CPC Classification: G06F3/0484 (for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range)

Search for rejections for patent application number 20250181219