18367377. NEURAL NETWORK MASK GENERATION BASED ON TEMPORAL WINDOWS (ADOBE INC.)
NEURAL NETWORK MASK GENERATION BASED ON TEMPORAL WINDOWS
Organization Name
Inventor(s)
Nikhil Kalra of San Jose CA (US)
Seoung Wug Oh of San Jose CA (US)
Nico Alexander Becherer of Hamberg (DE)
Joon-Young Lee of San Jose CA (US)
Jimei Yang of Mountain View CA (US)
NEURAL NETWORK MASK GENERATION BASED ON TEMPORAL WINDOWS
This abstract first appeared for US patent application 18367377 titled 'NEURAL NETWORK MASK GENERATION BASED ON TEMPORAL WINDOWS
Original Abstract Submitted
In one aspect, a processor determines a first set of video frames of a video based on a target video frame. The first set of video frames includes the target video frame, one or more frames of the video preceding the target video frame, and one or more frames of the video subsequent to the target video frame. The first set of video frames includes a sequence of video frames of the video. An encoder neural network executing on the processor encodes the first set of video frames of a video to generate a respective feature vector for each video frame in the first set. A decoder neural network executing on the processor decodes the feature vectors to generate a mask for the target video frame.
