20240022786. Signaling for Picture In Picture In Media Container File and In Streaming Manifest simplified abstract (TENCENT AMERICA LLC)

From WikiPatents
Jump to navigation Jump to search

Signaling for Picture In Picture In Media Container File and In Streaming Manifest

Organization Name

TENCENT AMERICA LLC

Inventor(s)

Iraj Sodagar of Los Angeles CA (US)

Signaling for Picture In Picture In Media Container File and In Streaming Manifest - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240022786 titled 'Signaling for Picture In Picture In Media Container File and In Streaming Manifest

Simplified Explanation

The disclosed patent application relates to signaling picture-in-picture (PIP) in media container files and streaming media manifest. It describes a method for defining and identifying a PIP experience in media tracks, where a main media track and substitute/overlay media tracks are defined within a media track group. The PIP experience is identified with a role scheme. The media tracks in the PIP can be decoded independently or, if supported by the coding scheme, the substitute coded stream can replace specific regions in the main picture stream in a merge mode. The order of importance of the substitute picture and specific regions of the main picture are also signaled.

  • The patent application describes a method for signaling PIP experience in media container files and streaming media manifest.
  • It introduces the concept of a media track group to define the main media track and substitute/overlay media tracks.
  • The PIP experience is identified using a role scheme.
  • The media tracks in the PIP can be decoded independently or merged with the main picture stream in a merge mode.
  • The order of importance of the substitute picture and specific regions of the main picture can be signaled.

Potential applications of this technology:

  • Enhancing user experience in media playback by allowing simultaneous display of multiple media tracks.
  • Enabling seamless substitution of specific regions in the main picture stream with substitute/overlay media tracks.
  • Facilitating the creation of interactive media content with PIP capabilities.

Problems solved by this technology:

  • Simplifies the signaling and identification of PIP experiences in media container files and streaming media manifest.
  • Allows for independent decoding or merging of media tracks in the PIP, providing flexibility in displaying multiple media tracks.
  • Provides a standardized method for signaling the order of importance of substitute pictures and specific regions of the main picture.

Benefits of this technology:

  • Improved user experience with the ability to view multiple media tracks simultaneously.
  • Enhanced flexibility in media playback by allowing independent decoding or merging of media tracks.
  • Streamlined creation and delivery of interactive media content with PIP capabilities.


Original Abstract Submitted

this disclosure relates to signaling of picture-in-picture (pip) in media container files and in streaming media manifest. in one aspect, signaling of pip experience in container files are disclosed, where the pip experience consists of two or more media tracks. a media track group is used to define a picture-in-picture experience, wherein the main media track or tracks and the substitute/overlay media tracks are defined. the pip experience is identified with a role scheme. the media tracks in the pip can be decoded independently, or if the coding scheme supports, the substitute coded stream can replace the corresponding regions in the main picture stream in a merge mode, for which an order of importance of the substitute picture and the specific regions of the main picture are also signaled. in another aspect, a picture-in-picture experience may be signaled in streaming manifest. such signaling may include identifying the adaptation sets with a picture-in-picture descriptor as well as using a role descriptor to identify the pip experience, and further annotating the subpicture in a manifest where one or more subpictures are identified as one or more regions for substitutions.