18353327. PIXEL-BASED AUTOMATED TESTING OF A NAVIGABLE SIMULATED ENVIRONMENT simplified abstract (Microsoft Technology Licensing, LLC)

From WikiPatents
Jump to navigation Jump to search

PIXEL-BASED AUTOMATED TESTING OF A NAVIGABLE SIMULATED ENVIRONMENT

Organization Name

Microsoft Technology Licensing, LLC

Inventor(s)

Guoqing Liu of Beijing (CN)

Li Zhao of Beijing (CN)

Tao Qin of Beijing (CN)

Adrian Lee Brown of Kirkland WA (US)

James Eugene Bischoff, Jr. of Redmond WA (US)

Tieyan Liu of Beijing (CN)

PIXEL-BASED AUTOMATED TESTING OF A NAVIGABLE SIMULATED ENVIRONMENT - A simplified explanation of the abstract

This abstract first appeared for US patent application 18353327 titled 'PIXEL-BASED AUTOMATED TESTING OF A NAVIGABLE SIMULATED ENVIRONMENT

Simplified Explanation

The abstract describes a computing system that uses pixel-based automated testing to detect errors in a simulated environment. Here are the key points:

  • The system uses one or more processors to execute an application testing program during runtime.
  • The application testing program includes a machine learning model trained to detect errors in the application being tested.
  • The system processes a screen image of the simulated environment using an object detection module.
  • The object detection module determines if a key object is present in the screen image.
  • If a key object is detected, an object investigation module is executed to generate investigation inputs for further analysis.
  • If a key object is not detected, an environment exploration module is executed to generate simulated user input to explore the environment.
  • The system aims to identify errors in the application under test by analyzing the presence or absence of key objects in the simulated environment.

Potential applications of this technology:

  • Software testing: The system can be used to automate the testing of applications by detecting errors in a simulated environment.
  • Quality assurance: It can help ensure the quality and reliability of software by identifying and investigating potential issues.
  • Bug detection: The system can be used to detect and investigate bugs or glitches in software applications.
  • User experience testing: By simulating user input and analyzing the resulting environment, the system can assess the user experience of an application.

Problems solved by this technology:

  • Manual testing limitations: The system automates the testing process, reducing the need for manual testing and potentially saving time and resources.
  • Error detection: By using machine learning and object detection, the system can identify errors or anomalies in the application being tested.
  • Efficient investigation: The system generates investigation inputs to further analyze and investigate potential errors, allowing for more efficient debugging.

Benefits of this technology:

  • Increased efficiency: Automated testing can be faster and more efficient than manual testing, allowing for quicker identification of errors.
  • Improved accuracy: The machine learning model and object detection module can provide accurate detection of errors in the application.
  • Cost savings: By automating the testing process, the system can potentially reduce the need for manual testers, leading to cost savings.
  • Enhanced user experience: By identifying and addressing errors, the system can help improve the overall user experience of software applications.


Original Abstract Submitted

A computing system for pixel-based automated testing of a navigable simulated environment includes one or more processors configured to execute, in a run-time inference phase, an application testing program. The application testing program includes a machine learning model trained to detect errors in the application under test. A screen image of the simulated environment is processed by an object detection module to determine if a key object is present in the screen image. If a key object is present in the screen image, the application testing program executes an object investigation module to generate investigation inputs to investigate the key object. If a key object is not present in the screen image, the application testing program executes an environment exploration module to generate an environment exploration action to be provided to the application under test as simulated user input.