17846930. ROBOTIC LEARNING OF ASSEMBLY TASKS USING AUGMENTED REALITY simplified abstract (Snap Inc.)

From WikiPatents
Jump to navigation Jump to search

ROBOTIC LEARNING OF ASSEMBLY TASKS USING AUGMENTED REALITY

Organization Name

Snap Inc.

Inventor(s)

Kai Zhou of Wiener Neudorf (AT)

Adrian Schoisengeier of Vienna (AT)

ROBOTIC LEARNING OF ASSEMBLY TASKS USING AUGMENTED REALITY - A simplified explanation of the abstract

This abstract first appeared for US patent application 17846930 titled 'ROBOTIC LEARNING OF ASSEMBLY TASKS USING AUGMENTED REALITY

Simplified Explanation

The patent application describes a method for programming a robotic system using an augmented reality (AR) device. Here are the key points:

  • The method involves displaying a virtual object in the AR device that corresponds to a physical object in the real world.
  • The AR device tracks the manipulation of the virtual object by a user, identifying the initial and final states of the object based on the tracking.
  • The method then uses this tracking data to program a robotic system, taking into account the initial and final poses of the virtual object.

Potential applications of this technology:

  • Industrial automation: This method can be used to program robots in manufacturing settings, allowing operators to easily demonstrate the desired tasks and movements.
  • Healthcare: Robotic systems used in surgeries or rehabilitation can be programmed using this method, making it easier for medical professionals to teach the robots specific movements.
  • Education and training: This technology can be used in educational settings to teach students about robotics and programming, allowing them to interact with virtual objects and program robots through demonstration.

Problems solved by this technology:

  • Simplified programming: Traditional methods of programming robots can be complex and time-consuming. This method simplifies the programming process by allowing users to demonstrate the desired movements instead of writing code.
  • Intuitive interaction: By using augmented reality, users can interact with virtual objects in a more natural and intuitive way, making it easier to program robots.
  • Flexibility: This method allows for easy reprogramming of robotic systems, as users can simply demonstrate the desired movements instead of rewriting code.

Benefits of this technology:

  • Time and cost savings: The simplified programming process reduces the time and resources required to program robotic systems, making them more accessible and cost-effective.
  • Increased productivity: By simplifying the programming process, operators can quickly and easily program robots to perform specific tasks, improving overall productivity.
  • Enhanced user experience: The use of augmented reality and demonstration-based programming provides a more engaging and user-friendly experience for operators and programmers.


Original Abstract Submitted

A method for programming a robotic system by demonstration is described. In one aspect, the method includes displaying a first virtual object in a display of an augmented reality (AR) device, the first virtual object corresponding to a first physical object in a physical environment of the AR device, tracking, using the AR device, a manipulation of the first virtual object by a user of the AR device, identifying an initial state and a final state of the first virtual object based on the tracking, the initial state corresponding to an initial pose of the first virtual object, the final state corresponding to a final pose of the first virtual object, and programming by demonstration a robotic system using the tracking of the manipulation of the first virtual object, the first initial state of the first virtual object, and the final state of the first virtual object.