18377101. DEPTH OF FIELD IN VIDEO BASED ON GAZE simplified abstract (Apple Inc.)
Contents
DEPTH OF FIELD IN VIDEO BASED ON GAZE
Organization Name
Inventor(s)
Alexandre Da Veiga of San Francisco CA (US)
Timothy T. Chong of Sunnyvale CA (US)
DEPTH OF FIELD IN VIDEO BASED ON GAZE - A simplified explanation of the abstract
This abstract first appeared for US patent application 18377101 titled 'DEPTH OF FIELD IN VIDEO BASED ON GAZE
Simplified Explanation
Various implementations disclosed herein include devices, systems, and methods that modify a video to enable replay of the video with a depth-based effect based on the gaze of a user during capture or playback of the video.
- Tracking gaze direction during video capture or playback
- Identifying a portion of the 3D environment depicted in the video based on the gaze direction
- Determining the depth of the identified portion of the 3D environment
- Modifying the video to enable replay with a depth-based effect based on the depth of the identified portion
Potential applications of this technology:
- Enhanced virtual reality experiences
- Immersive video playback
- Interactive video games
- Augmented reality applications
Problems solved by this technology:
- Lack of depth perception in traditional video playback
- Limited interactivity in video content
- Inability to recreate the user's gaze experience during video capture or playback
Benefits of this technology:
- Enhanced user engagement and immersion
- Improved realism in video playback
- Increased interactivity and control over video content
- Enhanced storytelling capabilities in video production
Original Abstract Submitted
Various implementations disclosed herein include devices, systems, and methods that modify a video to enable replay of the video with a depth-based effect based on gaze of a user during capture or playback of the video. For example, an example process may include tracking a gaze direction during a capture or a playback of a video, wherein the video includes a sequence of frames including depictions of a three-dimensional (3D) environment, identifying a portion of the 3D environment depicted in the video based on the gaze direction, determining a depth of the identified portion of the 3D environment, and modifying the video to enable replay of the video with a depth-based effect based on the depth of the identified portion.
