US Patent Application 18354485. CONTROLLABLE IMAGE GENERATION simplified abstract

From WikiPatents
Jump to navigation Jump to search

CONTROLLABLE IMAGE GENERATION

Organization Name

Microsoft Technology Licensing, LLC


Inventor(s)

Marek Adam Kowalski of Cambridge (GB)

Stephan Joachim Garbin of London (GB)

Matthew Alastair Johnson of Cambridge (GB)

Tadas Baltrusaitis of Cambridge (GB)

Martin De La Gorce of Cambridge (GB)

Virginia Estellers Casas of Cambridge (GB)

Sebastian Karol Dziadzio of Cambridge (GB)

CONTROLLABLE IMAGE GENERATION - A simplified explanation of the abstract

This abstract first appeared for US patent application 18354485 titled 'CONTROLLABLE IMAGE GENERATION

Simplified Explanation

The patent application describes a method of image processing that involves storing a real image of a specific object in memory.

  • Real image of an object is stored in memory

The method uses a first encoder to compute a factorized embedding of the real image.

  • First encoder is used to compute a factorized embedding of the real image

The method receives a value of at least one parameter from a synthetic image rendering apparatus, which controls an attribute of synthetic images of objects of the specified type.

  • Value of at least one parameter is received from a synthetic image rendering apparatus

A second encoder is used to compute an embedding factor based on the received value.

  • Second encoder is used to compute an embedding factor based on the received value

The factorized embedding is then modified with the computed embedding factor.

  • Factorized embedding is modified with the computed embedding factor

Using a decoder with the modified embedding as input, the method computes an output image of an object that is similar to the real image, except for the attribute controlled by the parameter.

  • Decoder is used to compute an output image that is similar to the real image, except for the controlled attribute


Original Abstract Submitted

In various examples there is a method of image processing comprising: storing a real image of an object in memory, the object being a specified type of object. The method involves computing, using a first encoder, a factorized embedding of the real image. The method receives a value of at least one parameter of a synthetic image rendering apparatus for rendering synthetic images of objects of the specified type. The parameter controls an attribute of synthetic images of objects rendered by the rendering apparatus. The method computes an embedding factor of the received value using a second encoder. The factorized embedding is modified with the computed embedding factor. The method computes, using a decoder with the modified embedding as input, an output image of an object which is substantially the same as the real image except for the attribute controlled by the parameter.