Snap Inc. patent applications on August 22nd, 2024

Patent Applications by Snap Inc. on August 22nd, 2024

Snap Inc.: 17 patent applications

Snap Inc. has applied for patents in the areas of G06T19/00 (5), G02B27/01 (4), G06F3/01 (4), G06F3/14 (2), G06Q50/00 (2) G06T19/006 (2), G02B27/017 (2), G01B5/30 (1), G06F3/011 (1), G06F3/04817 (1)

With keywords such as: frame, image, data, user, display, environment, hair, device, generate, and messaging in patent application abstracts.

Patent Applications by Snap Inc.

20240280355. JOINT BENDING ESTIMATION_simplified_abstract_(snap inc.)

Inventor(s): Matthias Kalkgruber of Vienna (AT) for snap inc., Tiago Miguel Pereira Torres of Vienna (AT) for snap inc., Chao Chen of Marina Del Rey CA (US) for snap inc., Jason Heger of Louisville CO (US) for snap inc., John Recchio of Los Angeles CA (US) for snap inc., Mark Kraz of Los Gatos CA (US) for snap inc., Michael Ryner of Santa Monica CA (US) for snap inc.

IPC Code(s): G01B5/30, G01L1/22, G02B27/01, G06T19/00

CPC Code(s): G01B5/30

Abstract: a system for correcting for frame bending of an augmented reality system is provided. a combination of strain gauges and visual inertial odometry is used to determine strains in the frame. an initial model between strain gauge measurements and actual frame spatial relationships is based on finite element analysis or calibration. during an initial visual inertial odometry data calculation phase, the augmented reality system calculates bending or strains of the frame using strain data from the strain gauges mounted to the frame. subsequent visual inertial odometry data calculations are used to generate a corrected frame model of the frame. the corrected frame model is used for calculating corrected tracking data and corrected virtual overlays that are used to generate virtual overlays used in an ar experience provided by the augmented reality system.

20240280811. RECREATING PERIPHERAL VISION ON A WEARABLE DEVICE_simplified_abstract_(snap inc.)

Inventor(s): Farid Zare Seisan of San Diego CA (US) for snap inc., Ulf Oscar Michel Loenngren of Los Angeles CA (US) for snap inc.

IPC Code(s): G02B27/01, G06F3/01

CPC Code(s): G02B27/017

Abstract: a head-wearable apparatus includes a frame having a front piece configured to hold left and right lenses. a left temple is coupled to the front piece and a right temple coupled to the front piece. a camera system includes one or more cameras coupled to the front piece, one or more left peripheral cameras coupled to an outside surface of the frame, and one or more right peripheral cameras coupled to an outside surface of the frame. a left peripheral display is coupled to an inside surface of the frame. the left peripheral display is configured to receive and display input from the one or more left peripheral cameras. a right peripheral display is coupled to an inside surface of the frame. the right peripheral display is configured to receive and display input from the one or more right peripheral cameras.

20240280814. AR SYSTEM BENDING CORRECTION_simplified_abstract_(snap inc.)

Inventor(s): Matthias Kalkgruber of Vienna (AT) for snap inc., Tiago Miguel Pereira Torres of Vienna (AT) for snap inc., Weston Welge of Boulder CO (US) for snap inc., Ramzi Zahreddine of Denver CO (US) for snap inc.

IPC Code(s): G02B27/01, G02B27/00, G06T19/00

CPC Code(s): G02B27/017

Abstract: a system for deformation or bending correction in an augmented reality (ar) system. sensors are positioned in a frame of a head-worn ar system to sense forces or pressure acting on the frame by temple pieces attached to the frame. the sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. the corrected model is used to correct video data captured by the ar system and to correct a video virtual overlay that is provided to a user wearing the head-worn ar system.

20240281054. OCCLUSION DETECTION SYSTEM_simplified_abstract_(snap inc.)

Inventor(s): Piers George Cowburn of London (GB) for snap inc., David Li of London (GB) for snap inc., Isac Andreas Müller Sandvik of London (GB) for snap inc., Qi Pan of London (GB) for snap inc.

IPC Code(s): G06F3/01, G06T7/90, G06T19/00, G06V10/40, G06V20/20, H04L51/222, H04W4/021, H04W4/30

CPC Code(s): G06F3/011

Abstract: an occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.

20240281114. MAP-BASED GRAPHICAL USER INTERFACE FOR MULTI-TYPE SOCIAL MEDIA GALLERIES_simplified_abstract_(snap inc.)

Inventor(s): Daniel Amitay of New York NY (US) for snap inc., Jonathan Dale Brody of Marina del Rey CA (US) for snap inc., Jeffrey Arthur Johnson of Brooklyn NY (US) for snap inc., Andrew Lin of Long Island City NY (US) for snap inc., Walton Lin of Chatham NJ (US) for snap inc., John Rauser of Seattle WA (US) for snap inc., Evan Spiegel of Los Angeles CA (US) for snap inc.

IPC Code(s): G06F3/04817, G06F3/0482, G06F3/04842, G06F3/0488, G06F9/54, G06F16/248, G06F16/29, G06F16/487, G06F16/9535, G06F16/9537, G06Q50/00, G06T11/20, G06T11/60, H04L9/40, H04L41/22, H04L41/28, H04L51/52, H04L67/12, H04L67/306, H04L67/50, H04L67/52, H04W4/02, H04W4/029, H04W4/18, H04W4/21, H04W12/02

CPC Code(s): G06F3/04817

Abstract: a social media platform provides a map-based graphical user interface (gui) with multiple geographically anchored icons that are selectable to trigger playback of respective galleries of ephemeral messages. each of the plurality of location-based ephemeral galleries comprises media content contributed by multiple different users. the ephemeral galleries are compiled based on geotag data associated with respective ephemeral messages submitted by multiple users to be publicly viewable via the map-based gui. two or more different types of galleries are represented in the map-based gui by different, visually distinct types of gallery icon.

20240281121. INTERACTING WITH VISUAL CODES WITHIN MESSAGING SYSTEM_simplified_abstract_(snap inc.)

Inventor(s): Vadim Velicodnii of London (GB) for snap inc.

IPC Code(s): G06F3/0484, G06F3/0482, H04L51/07

CPC Code(s): G06F3/0484

Abstract: aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for interacting with visual codes within a messaging system. the program and method provide for displaying, by a messaging application, captured image data comprising a visual code, the visual code including a custom graphic and being decodable to access a first feature of the messaging application; receiving user input selecting the visual code; displaying an updated version of the custom graphic; providing an animation which depicts the updated version of the custom graphic as moving from the visual code to an interface element comprising a group of icons, each icon within the group of icons being user-selectable to access a respective second feature of the messaging application; and updating the group of icons to include an additional icon which is user-selectable to access the first feature of the messaging application.

20240281125. GESTURE-DRIVEN MESSAGE CONTENT RESIZING_simplified_abstract_(snap inc.)

Inventor(s): Dennis Jin of Paris (FR) for snap inc., Daniel Moreno of Los Angeles CA (US) for snap inc.

IPC Code(s): G06F3/04845, G06F3/01, G06F3/0488

CPC Code(s): G06F3/04845

Abstract: a user interface comprising a message composition area is presented at a user device. commencement of a resizing gesture is detected. a location of the resizing gesture within the user interface is tracked while the resizing gesture is in progress. the location of the resizing gesture is adjustable to cause resizing of message content in the message composition area. responsive to detecting ending of the resizing gesture, a size of the message content is checked. transmission of the message content to a recipient is based on a size of the message content relative to a base size.

20240281192. LOCATION-BASED SHARED AUGMENTED REALITY EXPERIENCE SYSTEM_simplified_abstract_(snap inc.)

Inventor(s): Pawel Wawruch of Freienbach (CH) for snap inc.

IPC Code(s): G06F3/14, A63F13/87, G06F3/01

CPC Code(s): G06F3/1454

Abstract: a location-based shared augmented reality (ar) experience system is configured to permit users that find themselves in the same geographic area to easily join in a shared ar experience by creating respective instances of the shared ar experience for different previously defined geographic areas. when a user indicates a request to launch a shared ar experience accessible via a messaging client, the location-based shared ar experience system obtains or receives from the user device executing the messaging client location information of the user device, determines a previously-defined ar experience area that encompasses the location of the user device, and communicates to the user device an address of an associated instance of the shared ar experience.

20240281216. SOFTWARE DEVELOPMENT KIT ENGAGEMENT MONITOR_simplified_abstract_(snap inc.)

Inventor(s): Patrick Mandia of Venice CA (US) for snap inc.

IPC Code(s): G06F8/20, G06F8/60, G06F9/54, G06F11/34

CPC Code(s): G06F8/20

Abstract: an example developer tools system provided by a messaging system includes a software development kit (skd) engagement monitor that permits capturing app open events in third party resources (e.g., third party apps) that use the developer tools system. the skd engagement monitor is configured to operate in a manner that preserves privacy of the third party developers and avoids conveying to the messaging system backend environment personally identifiable information (pii) about the third party resource usage.

20240281279. AUTO-RECOVERY FOR AR WEARABLE DEVICES_simplified_abstract_(snap inc.)

Inventor(s): Piotr Gurgul of Hergiswil (CH) for snap inc.

IPC Code(s): G06F9/48, G02B27/01, G06F3/14

CPC Code(s): G06F9/4856

Abstract: systems, methods, and computer readable media for auto-recovery of an augmented reality (ar) wearable device are disclosed. a pass-through application is invoked as a background process and an application is invoked as a foreground process. the pass-through application includes an on-resume procedure that is called if the operating system or interpreter determines that the foreground process is unresponsive. the on-resume procedure restarts the application as the foreground process and may first reboot the ar wearable device. the pass-through application remains transparent to the user by not displaying output on the display of the ar wearable device. additionally, an uncaught exception handler is registered with the operating system to be called in the event that an exception occurs that does not have a handler. the exception handler restarts the application as the foreground process and may first reboot the ar wearable device.

20240281478. SEARCHING SOCIAL MEDIA CONTENT_simplified_abstract_(snap inc.)

Inventor(s): Newar Husam Al Majid of New York NY (US) for snap inc., Wisam Dakka of San Francisco CA (US) for snap inc., Donald Giovannini of Venice CA (US) for snap inc., Andre Madeira of Saratoga CA (US) for snap inc., Andrei Damian of San Francisco CA (US) for snap inc., Seyed Reza Mir Ghaderi of San Francisco CA (US) for snap inc., Yaming Lin of Palo Alto CA (US) for snap inc., Ranveer Kunal of San Francisco CA (US) for snap inc., Congxing Cai of Mountain View CA (US) for snap inc., Robson Araujo of Mountain View CA (US) for snap inc., Guilherme Fernandes of Mountain View CA (US) for snap inc., Jungho Ahn of Palo Alto CA (US) for snap inc.

IPC Code(s): G06F16/951, G06F16/14, G06Q50/00

CPC Code(s): G06F16/951

Abstract: various embodiments provide for systems, methods, and computer-readable storage media that improve media content search functionality and curation of media content. for instance, various embodiments described in this document provide features that can present media content items in the form of dynamic collection of media content items upon a user typing into a search bar. in another instance, various embodiments described herein improve media content search functionality by ranking user facing search features using input signals.

20240281936. SELFIE PERSPECTIVE UNDISTORTION BY 3D FACE GAN INVERSION_simplified_abstract_(snap inc.)

Inventor(s): Jian Wang of Pittsburgh PA (US) for snap inc., Zhixiang Wang of New York NY (US) for snap inc., Gurunandan Krishnan Gorumkonda of Kirkland WA (US) for snap inc.

IPC Code(s): G06T5/00, G06V40/16

CPC Code(s): G06T5/77

Abstract: a method of correcting perspective distortion of a selfie image captured with a short camera-to-face distance by processing the selfie image and generating an undistorted selfie image appearing to be taken with a longer camera-to-face distance. a pre-trained 3d face gan processes the selfie image, inverts the 3d face gan to obtain improved face latent code and camera parameters, fine tunes a 3d face gan generator, and manipulates camera parameters to render a photorealistic face selfie image. the processed selfie image has less distortion in the forehead, nose, cheek bones, jaw line, chin, lips, eyes, eyebrows, ears, hair, and neck of the face.

20240282015. AUGMENTED REALITY EXPERIENCE WITH LIGHTING ADJUSTMENT_simplified_abstract_(snap inc.)

Inventor(s): Hanna Davidovich of Ramat Gan (IL) for snap inc., Nir Malbin of Shoham (IL) for snap inc., Avihay Assouline of Tel Aviv (IL) for snap inc.

IPC Code(s): G06T11/00, G06T5/50

CPC Code(s): G06T11/00

Abstract: aspects of the present disclosure involve a system for an augmented reality (ar) try-on experience with lighting adjustment. the system accesses an image that depicts a real-world person. the system retrieves an ar fashion item. the system applies the image and the ar fashion item to a machine learning model to estimate a lighting adjustment for the ar fashion item based on lighting properties of the real-world person depicted in the image, the machine learning model trained to match lighting properties of images depicting real-world objects to lighting properties of ar objects and vice versa. the system combines the ar fashion item with the image that depicts the real-world person based on the estimated lighting adjustment to generate a modified image.

20240282058. GENERATING USER INTERFACES DISPLAYING AUGMENTED REALITY GRAPHICS_simplified_abstract_(snap inc.)

Inventor(s): Sharon Moll of Lachen (CH) for snap inc.

IPC Code(s): G06T19/00, G06F3/04815

CPC Code(s): G06T19/006

Abstract: an augmented reality (ar) graphics system is provided. the ar graphics system may coordinate the display of augmented reality graphics created by multiple users located in an environment. the ar graphics system may determine an alignment object located in the environment that is designated as a common origin of a real-world coordinate system that is used to determine where to display ar graphics within the environment. additionally, a prioritization scheme is implemented to resolve conflicts between overlapping input provided by different users in order to generate a single version of ar graphics.

20240282066. MESSAGING SYSTEM WITH NEURAL HAIR RENDERING_simplified_abstract_(snap inc.)

Inventor(s): Artem Bondich of Marina del Rey CA (US) for snap inc., Menglei Chai of Los Angeles CA (US) for snap inc., Olekssandr Pyshchenko of Pacific Palisades CA (US) for snap inc., Jian Ren of Marina Del Ray CA (US) for snap inc., Sergey Tulyakov of Santa Monica CA (US) for snap inc.

IPC Code(s): G06T19/00, G06F18/214, G06N3/045, G06N3/08, G06T7/246, G06T17/00, G06T19/20

CPC Code(s): G06T19/006

Abstract: a messaging system performs neural network hair rendering for images provided by users of the messaging system. a method of neural network hair rendering includes processing a three-dimensional (3d) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. the method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. the method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.

20240282110. MACHINE LEARNING-BASED SELECTION OF A REPRESENTATIVE VIDEO FRAME WITHIN A MESSAGING APPLICATION_simplified_abstract_(snap inc.)

Inventor(s): Kavya Venkata Kota Kopparapu of Herndon VA (US) for snap inc., Benjamin Dodson of Dover NH (US) for snap inc., Francesc Xavier Drudis Rius of Bellevue WA (US) for snap inc., Angus Kong of Seattle WA (US) for snap inc., Richard Leider of San Francisco CA (US) for snap inc., Jien Ren of Marina Del Ray CA (US) for snap inc., Sergey Tulyakov of Santa Monica CA (US) for snap inc., Jiayao Yu of Venice CA (US) for snap inc.

IPC Code(s): G06V20/40, G06F16/783, G06N20/00, G06T5/70, G06V10/70, G06V20/70

CPC Code(s): G06V20/46

Abstract: aspects of the present disclosure involve a system comprising a medium storing a program and method for machine-learning based selection of a representative video frame. the program and method provide for receiving a set of video frames; determining a first subset of frames by removing frames outside of an image quality threshold; determining a second subset by removing frames outside of an image stillness threshold; computing feature data for each frame in the second subset; providing, for each frame in the second subset, the feature data to a machine learning model (mlm), the mlm being configured to output a score for each frame in the second subset of frames based on the feature data, the mlm having been trained with a first set of images labeled based on aesthetics, and with a second set of images labeled based on image quality; and selecting a frame based on output scores.

20240282330. ACOUSTIC NEURAL NETWORK SCENE DETECTION_simplified_abstract_(snap inc.)

Inventor(s): Jinxi Guo of Los Angeles CA (US) for snap inc., Jia Li of Marina Del Rey CA (US) for snap inc., Ning Xu of Irvine CA (US) for snap inc.

IPC Code(s): G10L25/30, G06F18/24, G06N3/045, G06V10/764, G06V10/82, G06V20/00, H04S7/00

CPC Code(s): G10L25/30

Abstract: an acoustic environment identification system is disclosed that can use neural networks to accurately identify environments. the acoustic environment identification system can use one or more convolutional neural networks to generate audio feature data. a recursive neural network can process the audio feature data to generate characterization data. the characterization data can be modified using a weighting system that weights signature data items. classification neural networks can be used to generate a classification of an environment.

Snap Inc. patent applications on August 22nd, 2024