US Patent Application 18354485. CONTROLLABLE IMAGE GENERATION simplified abstract
Contents
CONTROLLABLE IMAGE GENERATION
Organization Name
Microsoft Technology Licensing, LLC
Inventor(s)
Marek Adam Kowalski of Cambridge (GB)
Stephan Joachim Garbin of London (GB)
Matthew Alastair Johnson of Cambridge (GB)
Tadas Baltrusaitis of Cambridge (GB)
Martin De La Gorce of Cambridge (GB)
Virginia Estellers Casas of Cambridge (GB)
Sebastian Karol Dziadzio of Cambridge (GB)
CONTROLLABLE IMAGE GENERATION - A simplified explanation of the abstract
This abstract first appeared for US patent application 18354485 titled 'CONTROLLABLE IMAGE GENERATION
Simplified Explanation
The patent application describes a method of image processing that involves storing a real image of a specific object in memory.
- Real image of an object is stored in memory
The method uses a first encoder to compute a factorized embedding of the real image.
- First encoder is used to compute a factorized embedding of the real image
The method receives a value of at least one parameter from a synthetic image rendering apparatus, which controls an attribute of synthetic images of objects of the specified type.
- Value of at least one parameter is received from a synthetic image rendering apparatus
A second encoder is used to compute an embedding factor based on the received value.
- Second encoder is used to compute an embedding factor based on the received value
The factorized embedding is then modified with the computed embedding factor.
- Factorized embedding is modified with the computed embedding factor
Using a decoder with the modified embedding as input, the method computes an output image of an object that is similar to the real image, except for the attribute controlled by the parameter.
- Decoder is used to compute an output image that is similar to the real image, except for the controlled attribute
Original Abstract Submitted
In various examples there is a method of image processing comprising: storing a real image of an object in memory, the object being a specified type of object. The method involves computing, using a first encoder, a factorized embedding of the real image. The method receives a value of at least one parameter of a synthetic image rendering apparatus for rendering synthetic images of objects of the specified type. The parameter controls an attribute of synthetic images of objects rendered by the rendering apparatus. The method computes an embedding factor of the received value using a second encoder. The factorized embedding is modified with the computed embedding factor. The method computes, using a decoder with the modified embedding as input, an output image of an object which is substantially the same as the real image except for the attribute controlled by the parameter.