18206459. METHOD AND APPARATUS FOR GENERATING VIDEO INTERMEDIATE FRAME simplified abstract (Samsung Electronics Co., Ltd.)

From WikiPatents
Jump to navigation Jump to search

METHOD AND APPARATUS FOR GENERATING VIDEO INTERMEDIATE FRAME

Organization Name

Samsung Electronics Co., Ltd.

Inventor(s)

Xin Jin of Nanjing (CN)

Guotao Shin of Nanjing (CN)

Youxin Chen of Nanjing (CN)

Longhai Wu of Nanjing (CN)

Jie Chen of Nanjing (CN)

Jayoon Koo of Suwon-si (KR)

Cheulhee Hahm of Suwon-si (KR)

METHOD AND APPARATUS FOR GENERATING VIDEO INTERMEDIATE FRAME - A simplified explanation of the abstract

This abstract first appeared for US patent application 18206459 titled 'METHOD AND APPARATUS FOR GENERATING VIDEO INTERMEDIATE FRAME

Simplified Explanation

The patent application describes a method for generating an intermediate frame in a video sequence using optical flow estimation and pixel synthesis models. The method involves constructing an image pyramid for each frame in a target video frame pair and generating the intermediate frame by recursively calling the models in a layer-by-layer manner.

  • Obtaining a target video frame pair
  • Constructing an image pyramid for each frame in the target video frame pair
  • Generating an intermediate frame by using a bidirectional optical flow estimation model and a pixel synthesis model
  • The generation process follows an order from high layer to low layer based on the image pyramid
  • Repairing the bidirectional optical flow and the previous intermediate frame for each layer using the models

Potential Applications

  • Video editing and post-production
  • Video compression and streaming
  • Computer-generated imagery (CGI) in movies and games

Problems Solved

  • Generating high-quality intermediate frames in video sequences
  • Smoothly interpolating between two video frames
  • Reducing artifacts and distortions in the generated frames

Benefits

  • Improved video quality and visual smoothness
  • More efficient video processing and editing workflows
  • Enhanced user experience in video playback and streaming


Original Abstract Submitted

A method for generating a video intermediate frame, including obtaining a target video frame pair; constructing an image pyramid for each video frame in the target video frame pair; and generating an intermediate frame of the target video frame pair by using a bidirectional optical flow estimation model and a pixel synthesis model in a layer-by-layer recursive calling manner according to an order of the image pyramid from a high layer to a low layer based on the image pyramid, wherein the generating of the intermediate frame of the target video frame pair comprising: repairing a bidirectional optical flow corresponding to a previous layer using the bidirectional optical flow estimation model, and repairing a previous intermediate frame corresponding to the previous layer using the pixel synthesis model.