Apple inc. (20240340438). HARDWARE FRIENDLY DESIGN FOR MOTION FIELD PROCESSING AND QUALITY IMPROVEMENT OF MOTION FIELD simplified abstract

HARDWARE FRIENDLY DESIGN FOR MOTION FIELD PROCESSING AND QUALITY IMPROVEMENT OF MOTION FIELD

Organization Name

apple inc.

Inventor(s)

Yeqing Wu of Cupertino CA (US)

Yunfei Zheng of Santa Clara CA (US)

Yixin Du of Milpitas CA (US)

Alican Nalci of Cupertino CA (US)

Hilmi E. Egilmez of Santa Clara CA (US)

Guoxin Jin of San Diego CA (US)

Alexandros Tourapis of Los Gatos CA (US)

Jun Xin of San Jose CA (US)

Hsi-Jung Wu of San Jose CA (US)

HARDWARE FRIENDLY DESIGN FOR MOTION FIELD PROCESSING AND QUALITY IMPROVEMENT OF MOTION FIELD - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240340438 titled 'HARDWARE FRIENDLY DESIGN FOR MOTION FIELD PROCESSING AND QUALITY IMPROVEMENT OF MOTION FIELD

The patent application proposes techniques to enhance temporal motion projection in video coding by sorting candidate reference frames based on their suitability for prediction.

• Candidate reference frames are sorted in processing order according to scores assigned based on estimates of their suitability for prediction.
• Estimates may be based on temporal distance between each candidate reference frame and its prediction references.
• Estimates may also be based on the coding quality of a reference frame from which the candidate reference frame makes a prediction reference.
• Once sorted, the candidate reference frames are processed in the sorting order to provide prediction data to a current frame being coded.
• Hardware-friendly designs for motion field hole filling and motion vector smoothing operations are proposed to reduce complexity and benefit hardware parallel processing.

Potential Applications: - Video coding and compression technologies - Multimedia streaming services - Virtual reality and augmented reality applications

Problems Solved: - Improving temporal motion projection accuracy - Enhancing video coding efficiency - Reducing hardware implementation complexity

Benefits: - Higher quality video compression - Improved prediction accuracy - Enhanced hardware parallel processing capabilities

Commercial Applications: Title: Advanced Video Coding Technology for Enhanced Compression This technology can be utilized in industries such as: - Media and entertainment - Telecommunications - Surveillance and security systems

Questions about the technology: 1. How does this technology improve video coding efficiency? - This technology enhances video coding efficiency by sorting candidate reference frames based on their suitability for prediction, leading to more accurate temporal motion projection. 2. What are the potential applications of this technology in virtual reality? - This technology can be applied in virtual reality to improve video compression and enhance the overall immersive experience for users.

Original Abstract Submitted

techniques are proposed to improve temporal motion projection in video coding. candidate reference frames available for use in temporal motion projection are sorted in processing order according to scores assigned based on estimates of the reference frames' suitability for prediction. such estimates may be based on temporal distance between each candidate reference frame and that reference frame's prediction references. estimates may be based, for each reference frame, based on an estimate of coding quality of a reference frame from which the respective candidate reference frame makes a prediction reference. once sorted, the candidate reference frames may be processing in the sorting order to supply prediction data to a current frame that is to be coded from the candidate reference frames. additionally, hardware friendly designs of motion field hole filling and motion vector smoothing operations are proposed. such designs can reduce hardware implementation complexity and benefit hardware parallel processing in several aspects: by removing the dependency among different processing block rows for hole filling and motion vector smoothing so that it is becomes easier and friendlier to achieve hardware parallel processing; by reducing the hardware bandwidth loading overhead; by improving hardware pipeline throughput; and/or by avoiding adding a line buffer to store the data from the above row since a line buffer will increase hardware cost.