Snap Inc. (20240256220). SPEECH-BASED SELECTION OF AUGMENTED REALITY CONTENT FOR DETECTED OBJECTS simplified abstract
Contents
SPEECH-BASED SELECTION OF AUGMENTED REALITY CONTENT FOR DETECTED OBJECTS
Organization Name
Inventor(s)
Joseph Timothy Fortier of Los Angeles CA (US)
Celia Nicole Mourkogiannis of Los Angeles CA (US)
Evan Spiegel of Los Angeles CA (US)
Kaveh Anvaripour of Culver City CA (US)
SPEECH-BASED SELECTION OF AUGMENTED REALITY CONTENT FOR DETECTED OBJECTS - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240256220 titled 'SPEECH-BASED SELECTION OF AUGMENTED REALITY CONTENT FOR DETECTED OBJECTS
The present disclosure involves a system that utilizes a computer-readable storage medium to store a program and method for displaying augmented reality content. The program and method enable a messaging application on a device to capture an image using the device's camera, receive speech input to select augmented reality content to display with the image, determine keywords in the speech input, identify objects and actions indicated by the keywords in the image, select corresponding augmented reality content items, and display the chosen augmented reality content item with the image.
- Messaging application on a device captures an image using the device's camera.
- Speech input is received to select augmented reality content to display with the image.
- Keywords in the speech input are determined to identify objects and actions in the image.
- Corresponding augmented reality content items are selected based on the identified objects and actions.
- The chosen augmented reality content item is displayed with the image.
Potential Applications: - Enhancing messaging applications with augmented reality features. - Improving user experience by integrating augmented reality content with images. - Facilitating interactive communication through augmented reality elements.
Problems Solved: - Simplifying the process of selecting and displaying augmented reality content. - Enhancing the visual communication experience for users. - Streamlining the integration of augmented reality into messaging platforms.
Benefits: - Engaging and interactive messaging experience. - Personalized and visually appealing content sharing. - Efficient and user-friendly augmented reality content selection.
Commercial Applications: Title: Augmented Reality Messaging System This technology can be utilized in messaging applications, social media platforms, and e-commerce websites to enhance visual communication and user engagement. The market implications include increased user retention, improved brand visibility, and enhanced customer interaction.
Questions about Augmented Reality Messaging System: 1. How does the system determine the keywords in the speech input? The system uses natural language processing algorithms to analyze the speech input and identify relevant keywords based on semantic context and syntax.
2. What are some potential challenges in integrating augmented reality content with messaging applications? One potential challenge could be ensuring seamless compatibility across different devices and operating systems to provide a consistent user experience.
Original Abstract Submitted
aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. the program and method provide for causing, by a messaging application running on a device, a camera of the device to capture an image; receiving by the messaging application, speech input to select augmented reality content for display with the image; determining at least one keyword included in the speech input; determining that the at least one keyword indicates an object depicted in the image and an action to perform with respect to the object; identifying, from plural augmented reality content items, an augmented reality content item that corresponds to performing the action with respect to the object; and displaying the augmented reality content item with the image.
