18747599. IMAGE BASED HUMAN-COMPUTER INTERACTION METHOD AND APPARATUS, DEVICE, AND STORAGE MEDIUM simplified abstract (Beijing Baidu Netcom Science Technology Co., Ltd.)
Contents
IMAGE BASED HUMAN-COMPUTER INTERACTION METHOD AND APPARATUS, DEVICE, AND STORAGE MEDIUM
Organization Name
Beijing Baidu Netcom Science Technology Co., Ltd.
Inventor(s)
Zhongwen Zhang of Beijing (CN)
IMAGE BASED HUMAN-COMPUTER INTERACTION METHOD AND APPARATUS, DEVICE, AND STORAGE MEDIUM - A simplified explanation of the abstract
This abstract first appeared for US patent application 18747599 titled 'IMAGE BASED HUMAN-COMPUTER INTERACTION METHOD AND APPARATUS, DEVICE, AND STORAGE MEDIUM
The present disclosure introduces an image-based human-computer interaction method that enhances the accuracy of answering questions and improves user experience.
- Acquiring a to-be-analyzed image
- Determining image layout information and image content information
- Extracting layout information representing the distribution of image elements
- Extracting content information representing the content expressed by the modal data in the image
- Generating response information corresponding to question information proposed by a user
- Enhancing human-computer interaction by analyzing image layout and content information
Potential Applications: This technology can be applied in image recognition systems, virtual assistants, educational tools, and customer service chatbots.
Problems Solved: Improves the accuracy of answering questions based on image content and layout information, enhances user experience in human-computer interactions.
Benefits: Enhanced accuracy in answering questions, improved user experience, increased efficiency in information retrieval from images.
Commercial Applications: "Image-Based Human-Computer Interaction Method for Enhanced User Experience and Accuracy in Answering Questions" can be utilized in AI-powered customer service platforms, educational software, and image recognition applications.
Prior Art: Researchers can explore existing patents related to image recognition, human-computer interaction, and question-answering systems to understand the evolution of this technology.
Frequently Updated Research: Stay updated on advancements in image processing, natural language processing, and AI technologies to enhance the capabilities of this image-based human-computer interaction method.
Questions about Image-Based Human-Computer Interaction Method: 1. How does this technology improve user experience in human-computer interactions? 2. What are the potential limitations of relying on image layout and content information for answering questions accurately?
Original Abstract Submitted
The present disclosure provides an image based human-computer interaction method, which includes: acquiring a to-be-analyzed image, and determining image layout information and image content information of the to-be-analyzed image, where the to-be-analyzed image includes a variety of modal data, the image layout information represents distribution of image elements with preset granularity in the to-be-analyzed image, and the image content information represents a content expressed by the modal data in the to-be-analyzed image; and determining, in response to acquiring question information, response information corresponding to the question information according to the image layout information and the image content information, where the question information represents a question proposed by a user for the to-be-analyzed image, and the response information represents a reply answer corresponding to the question information. By extracting layout information and content information from an image, the accuracy of answering a question and user experience of human-computer interaction are improved.
