18943472. SHAPE FUSION FOR IMAGE ANALYSIS (NVIDIA Corporation)
SHAPE FUSION FOR IMAGE ANALYSIS
Organization Name
Inventor(s)
David Jesus Acuna Marrero of Toronto CA
Towaki Takikawa of Waterloo CA
SHAPE FUSION FOR IMAGE ANALYSIS
This abstract first appeared for US patent application 18943472 titled 'SHAPE FUSION FOR IMAGE ANALYSIS
Original Abstract Submitted
Various types of image analysis benefit from a multi-stream architecture that allows the analysis to consider shape data. A shape stream can process image data in parallel with a primary stream, where data from layers of a network in the primary stream is provided as input to a network of the shape stream. The shape data can be fused with the primary analysis data to produce more accurate output, such as to produce accurate boundary information when the shape data is used with semantic segmentation data produced by the primary stream. A gate structure can be used to connect the intermediate layers of the primary and shape streams, using higher level activations to gate lower level activations in the shape stream. Such a gate structure can help focus the shape stream on the relevant information and reduces any additional weight of the shape stream.