18593281. HARDWARE FRIENDLY DESIGN FOR MOTION FIELD PROCESSING AND QUALITY IMPROVEMENT OF MOTION FIELD simplified abstract (Apple Inc.)

HARDWARE FRIENDLY DESIGN FOR MOTION FIELD PROCESSING AND QUALITY IMPROVEMENT OF MOTION FIELD

Organization Name

Apple Inc.

Inventor(s)

Yeqing Wu of Cupertino CA (US)

Yunfei Zheng of Santa Clara CA (US)

Yixin Du of Milpitas CA (US)

Alican Nalci of Cupertino CA (US)

Hilmi E. Egilmez of Santa Clara CA (US)

Guoxin Jin of San Diego CA (US)

Alexandros Tourapis of Los Gatos CA (US)

Jun Xin of San Jose CA (US)

Hsi-Jung Wu of San Jose CA (US)

HARDWARE FRIENDLY DESIGN FOR MOTION FIELD PROCESSING AND QUALITY IMPROVEMENT OF MOTION FIELD - A simplified explanation of the abstract

This abstract first appeared for US patent application 18593281 titled 'HARDWARE FRIENDLY DESIGN FOR MOTION FIELD PROCESSING AND QUALITY IMPROVEMENT OF MOTION FIELD

The patent application proposes techniques to enhance temporal motion projection in video coding by sorting candidate reference frames based on their suitability for prediction.

• Candidate reference frames are sorted in processing order according to scores assigned based on estimates of their suitability for prediction.
• Estimates may be based on temporal distance between each candidate reference frame and its prediction references.
• Estimates may also be based on the coding quality of a reference frame used for prediction.
• Sorted candidate reference frames are then processed in the sorting order to provide prediction data to a current frame for coding.

Key Features and Innovation:

• Sorting candidate reference frames based on prediction suitability.
• Estimating suitability for prediction based on temporal distance and coding quality.
• Hardware-friendly designs for motion field hole filling and motion vector smoothing operations.

Potential Applications:

• Video coding and compression technologies.
• Multimedia streaming services.
• Virtual reality and augmented reality applications.

Problems Solved:

• Improving temporal motion projection accuracy.
• Enhancing video coding efficiency.
• Reducing hardware implementation complexity.

Benefits:

• Higher quality video coding.
• Improved compression ratios.
• Enhanced hardware parallel processing capabilities.

Commercial Applications:

• Video streaming platforms.
• Video surveillance systems.
• Virtual reality content creation tools.

Questions about the Technology: 1. How does the proposed sorting technique improve temporal motion projection in video coding? 2. What are the potential benefits of the hardware-friendly designs for motion field operations?

Frequently Updated Research: There may be ongoing research in the field of video coding and compression techniques to further optimize temporal motion projection and hardware efficiency. Researchers may be exploring new algorithms and hardware implementations to enhance video coding performance.

Original Abstract Submitted

Techniques are proposed to improve temporal motion projection in video coding. Candidate reference frames available for use in temporal motion projection are sorted in processing order according to scores assigned based on estimates of the reference frames' suitability for prediction. Such estimates may be based on temporal distance between each candidate reference frame and that reference frame's prediction references. Estimates may be based, for each reference frame, based on an estimate of coding quality of a reference frame from which the respective candidate reference frame makes a prediction reference. Once sorted, the candidate reference frames may be processing in the sorting order to supply prediction data to a current frame that is to be coded from the candidate reference frames. Additionally, hardware friendly designs of motion field hole filling and motion vector smoothing operations are proposed. Such designs can reduce hardware implementation complexity and benefit hardware parallel processing in several aspects: by removing the dependency among different processing block rows for hole filling and motion vector smoothing so that it is becomes easier and friendlier to achieve hardware parallel processing; by reducing the hardware bandwidth loading overhead; by improving hardware pipeline throughput; and/or by avoiding adding a line buffer to store the data from the above row since a line buffer will increase hardware cost.