18180764. MACHINE LEARNING INTEGRATION IN ROBOTIC PROCESS AUTOMATION simplified abstract (SAP SE)
Contents
MACHINE LEARNING INTEGRATION IN ROBOTIC PROCESS AUTOMATION
Organization Name
Inventor(s)
Louis Rakotoarivony of Verrières-Le-Buisson (FR)
Xiaohui Xue of Courbevoie (FR)
MACHINE LEARNING INTEGRATION IN ROBOTIC PROCESS AUTOMATION - A simplified explanation of the abstract
This abstract first appeared for US patent application 18180764 titled 'MACHINE LEARNING INTEGRATION IN ROBOTIC PROCESS AUTOMATION
- Simplified Explanation:**
The abstract discusses the integration of machine learning to improve the automation of robotic process automation design. It involves capturing a screenshot of an application's user interface, extracting information using a machine learning model, identifying user interface elements, declaring them as robotic process automation entities, assigning actions to these elements, and performing the actions on the application.
- Key Features and Innovation:**
- Integration of machine learning with robotic process automation design - Automated extraction of user interface elements and criteria - Declaration of user interface elements as robotic process automation entities - Assignment of actions to the elements based on criteria - Performance of actions on the application to be automated
- Potential Applications:**
- Streamlining and improving the efficiency of robotic process automation design - Enhancing the accuracy and effectiveness of automation processes - Reducing manual intervention in repetitive tasks - Increasing productivity and scalability of automation solutions
- Problems Solved:**
- Streamlining the design process of robotic process automation - Enhancing the accuracy and efficiency of automation tasks - Reducing manual errors in automation processes - Improving the scalability and productivity of automation solutions
- Benefits:**
- Improved efficiency and accuracy in automation design - Reduction in manual errors and repetitive tasks - Increased productivity and scalability of automation solutions - Enhanced performance and effectiveness of automation processes
- Commercial Applications:**
Title: Enhanced Robotic Process Automation Design with Machine Learning Integration This technology can be utilized in various industries such as finance, healthcare, e-commerce, and manufacturing to automate repetitive tasks, streamline processes, and improve overall efficiency. It can benefit companies looking to enhance their automation capabilities and increase productivity.
- Questions about Robotic Process Automation Design with Machine Learning Integration:**
1. How does the integration of machine learning improve the automation of robotic process automation design? 2. What are the potential applications of this technology in different industries?
Original Abstract Submitted
Automation of robotic process automation design may be improved by integrating machine learning. A screenshot of a user interface of an application to be automated is captured. Then a selection of an area of the screenshot is determined. The area is provided as input to a document information extraction machine learning model configured to output labels and coordinates for user interface elements in the area. Labels for respective user interface elements of the one or more user interface elements and a respective set of coordinates are identified for each of the user interface elements. The user interface elements and respective criteria are declared as robotic process automation entities in a robotic process automation object model. Actions are assigned to the robotic process automation elements. And then the actions are performed on the application to be automated based on the respective criteria for the robotic process automation elements.
