US Patent Application 18344512. VISUAL SEARCH IN REAL WORLD USING OPTICAL SEE-THROUGH HEAD MOUNTED DISPLAY WITH AUGMENTED REALITY AND USER INTERACTION TRACKING simplified abstract
VISUAL SEARCH IN REAL WORLD USING OPTICAL SEE-THROUGH HEAD MOUNTED DISPLAY WITH AUGMENTED REALITY AND USER INTERACTION TRACKING
Organization Name
Inventor(s)
Md Sazzadur Rahman of San Jose CA (US)
Martin Renschler of San Diego CA (US)
VISUAL SEARCH IN REAL WORLD USING OPTICAL SEE-THROUGH HEAD MOUNTED DISPLAY WITH AUGMENTED REALITY AND USER INTERACTION TRACKING - A simplified explanation of the abstract
- This abstract for appeared for US patent application number 18344512 Titled 'VISUAL SEARCH IN REAL WORLD USING OPTICAL SEE-THROUGH HEAD MOUNTED DISPLAY WITH AUGMENTED REALITY AND USER INTERACTION TRACKING'
Simplified Explanation
This abstract describes techniques for conducting online visual searches using an augmented reality device with a see-through head mounted display. The device can identify a specific part of an object in the user's field of view, such as a barcode, based on their interaction with the device. This interaction can be through eye gaze or gestures. Once the device identifies the part of the object, it captures an image of it, which is then transmitted to a visual search engine for further analysis. It's important to note that the identified part of the object is not the entire object, so the captured image is smaller in size compared to the object in the user's field of view.
Original Abstract Submitted
Techniques can conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.
