Microsoft technology licensing, llc (20250110985). PERSONALIZED AI ASSISTANCE USING AMBIENT CONTEXT
PERSONALIZED AI ASSISTANCE USING AMBIENT CONTEXT
Organization Name
microsoft technology licensing, llc
Inventor(s)
Justin James Wagle of Pacifica CA US
Rogerio Bonatti of Bellevue WA US
PERSONALIZED AI ASSISTANCE USING AMBIENT CONTEXT
This abstract first appeared for US patent application 20250110985 titled 'PERSONALIZED AI ASSISTANCE USING AMBIENT CONTEXT
Original Abstract Submitted
large language models (llms) are able to provide robust results based on specified formatting and organization. traditionally, however, users must form detailed queries to obtain desired results in a desired format. accordingly, although llms are designed to receive natural language input, users often lack the skill, knowledge, or patience to utilize llms to their full potential. ambient information and user history associated with device screenshots are leveraged to provide proactive artificial-intelligence (ai) assistance and query resolution in an llm environment. in particular, screenshots associated with a computer display are continuously captured and analyzed to detect activity triggers for plugins, for example. in response to detecting an activity trigger, local context associated with one or more prior screenshots is collected. the collected context is then used to inform the plugin for performing the task, thereby reducing the burden placed on the user to input the required information.