18431134. CAPTIONING USING GENERATIVE ARTIFICIAL INTELLIGENCE (ADOBE INC.)
CAPTIONING USING GENERATIVE ARTIFICIAL INTELLIGENCE
Organization Name
Inventor(s)
Deepali Aneja of Seattle WA US
Zeyu Jin of San Francisco CA US
Anh Lan Truong of San Francisco CA US
Dingzeyu Li of Sammamish WA US
Hanieh Deilamsalehy of Seattle WA US
Rubaiat Habib of Seattle WA US
Matthew David Fisher of Palo Alto CA US
Kim Pascal Pimmel of Seattle WA US
Lubomira Assenova Dontcheva of Seattle WA US
CAPTIONING USING GENERATIVE ARTIFICIAL INTELLIGENCE
This abstract first appeared for US patent application 18431134 titled 'CAPTIONING USING GENERATIVE ARTIFICIAL INTELLIGENCE
Original Abstract Submitted
Embodiments of the present invention provide systems, methods, and computer storage media for cutting down a user's larger input video into an edited video comprising the most important video segments and applying corresponding video effects. Some embodiments of the present invention are directed to adding captioning video effects to the trimmed video (e.g., applying face-aware and non-face-aware captioning to emphasize extracted video segment headings, important sentences, quotes, words of interest, extracted lists, etc.). For example, a prompt is provided to a generative language model to identify portions of a transcript (e.g., extracted scene summaries, important sentences, lists of items discussed in the video, etc.) to apply to corresponding video segments as captions depending on the type of caption (e.g., an extracted heading may be captioned at the start of a corresponding video segment, important sentences and/or extracted list items may be captioned when they are spoken).
- ADOBE INC.
- Deepali Aneja of Seattle WA US
- Zeyu Jin of San Francisco CA US
- Hijung Shin of Natick MA US
- Anh Lan Truong of San Francisco CA US
- Dingzeyu Li of Sammamish WA US
- Hanieh Deilamsalehy of Seattle WA US
- Rubaiat Habib of Seattle WA US
- Matthew David Fisher of Palo Alto CA US
- Kim Pascal Pimmel of Seattle WA US
- Wilmot Li of Seattle WA US
- Lubomira Assenova Dontcheva of Seattle WA US
- G06F16/783
- G06F16/738
- G06V20/40
- G06V40/16
- CPC G06F16/7844