20250173822. Trajectory (Microsoft Technology Licensing, LLC)

TRAJECTORY-AWARE TRANSFORMER FOR VIDEO SUPER-RESOLUTION

Abstract: a computing system comprises a processor and memory storing instructions executable by the processor to obtain a sequence of image frames in a video. a target image frame of the sequence are input into a visual token embedding network of a trajectory-aware transformer to output a plurality of query tokens. a plurality of different image frames are input into a motion estimation network, the visual token embedding network, and a value embedding network to output a location map for each image frame, a plurality of key tokens, and a plurality of value embeddings, respectively. an image frame is selected the plurality of different image frames that has a closest similarity value from among the plurality of key tokens, and a super-resolution image frame is generated at a target time step as a function of an index query token, a value embedding of the selected frame, and the target image frame.

Inventor(s): Jianlong FU, Huan YANG

CPC Classification: G06T3/4046 (using neural networks)

Search for rejections for patent application number 20250173822