18623987. ROBOTIC LEARNING OF ASSEMBLY TASKS USING AUGMENTED REALITY simplified abstract (Snap Inc.)

ROBOTIC LEARNING OF ASSEMBLY TASKS USING AUGMENTED REALITY

Organization Name

Snap Inc.

Inventor(s)

Kai Zhou of Wiener Neudorf (AT)

Adrian Schoisengeier of Vienna (AT)

ROBOTIC LEARNING OF ASSEMBLY TASKS USING AUGMENTED REALITY - A simplified explanation of the abstract

This abstract first appeared for US patent application 18623987 titled 'ROBOTIC LEARNING OF ASSEMBLY TASKS USING AUGMENTED REALITY

The abstract describes a method for programming a robotic system through demonstration using an augmented reality (AR) device.

• Display a virtual object corresponding to a physical object in the AR device.
• Track manipulation of the virtual object by a user.
• Identify initial and final states of the virtual object based on tracking.
• Program the robotic system based on the manipulation of the virtual object.

Potential Applications: - Industrial automation - Healthcare robotics - Education and training in robotics

Problems Solved: - Simplifying programming of robotic systems - Enhancing user interaction with robots

Benefits: - Increased efficiency in programming robots - Intuitive user interface for controlling robots

Commercial Applications: Augmented reality-based robotic programming solutions for industries such as manufacturing, healthcare, and education.

Questions about the technology: 1. How does this method improve the efficiency of programming robotic systems? 2. What are the potential limitations of using augmented reality for robot programming?

Frequently Updated Research: Stay updated on advancements in augmented reality technology for robotic programming.

Original Abstract Submitted

A method for programming a robotic system by demonstration is described. In one aspect, the method includes displaying a first virtual object in a display of an augmented reality (AR) device, the first virtual object corresponding to a first physical object in a physical environment of the AR device, tracking, using the AR device, a manipulation of the first virtual object by a user of the AR device, identifying an initial state and a final state of the first virtual object based on the tracking, the initial state corresponding to an initial pose of the first virtual object, the final state corresponding to a final pose of the first virtual object, and programming by demonstration a robotic system using the tracking of the manipulation of the first virtual object, the first initial state of the first virtual object, and the final state of the first virtual object.