18206459. METHOD AND APPARATUS FOR GENERATING VIDEO INTERMEDIATE FRAME simplified abstract (Samsung Electronics Co., Ltd.)
METHOD AND APPARATUS FOR GENERATING VIDEO INTERMEDIATE FRAME
Organization Name
Inventor(s)
Cheulhee Hahm of Suwon-si (KR)
METHOD AND APPARATUS FOR GENERATING VIDEO INTERMEDIATE FRAME - A simplified explanation of the abstract
This abstract first appeared for US patent application 18206459 titled 'METHOD AND APPARATUS FOR GENERATING VIDEO INTERMEDIATE FRAME
Simplified Explanation
The patent application describes a method for generating an intermediate frame in a video sequence using optical flow estimation and pixel synthesis models. The method involves constructing an image pyramid for each frame in a target video frame pair and generating the intermediate frame by recursively calling the models in a layer-by-layer manner.
- Obtaining a target video frame pair
- Constructing an image pyramid for each frame in the target video frame pair
- Generating an intermediate frame by using a bidirectional optical flow estimation model and a pixel synthesis model
- The generation process follows an order from high layer to low layer based on the image pyramid
- Repairing the bidirectional optical flow and the previous intermediate frame for each layer using the models
Potential Applications
- Video editing and post-production
- Video compression and streaming
- Computer-generated imagery (CGI) in movies and games
Problems Solved
- Generating high-quality intermediate frames in video sequences
- Smoothly interpolating between two video frames
- Reducing artifacts and distortions in the generated frames
Benefits
- Improved video quality and visual smoothness
- More efficient video processing and editing workflows
- Enhanced user experience in video playback and streaming
Original Abstract Submitted
A method for generating a video intermediate frame, including obtaining a target video frame pair; constructing an image pyramid for each video frame in the target video frame pair; and generating an intermediate frame of the target video frame pair by using a bidirectional optical flow estimation model and a pixel synthesis model in a layer-by-layer recursive calling manner according to an order of the image pyramid from a high layer to a low layer based on the image pyramid, wherein the generating of the intermediate frame of the target video frame pair comprising: repairing a bidirectional optical flow corresponding to a previous layer using the bidirectional optical flow estimation model, and repairing a previous intermediate frame corresponding to the previous layer using the pixel synthesis model.