Samsung electronics co., ltd. (20240414448). EFFICIENT ON-DEVICE TRANSFORMER ARCHITECTURE FOR IMAGE PROCESSING
EFFICIENT ON-DEVICE TRANSFORMER ARCHITECTURE FOR IMAGE PROCESSING
Organization Name
Inventor(s)
Karim Ahmed of San Jose CA (US)
Vasili Ramanishka of Mountain View CA (US)
Yilin Shen of San Jose CA (US)
Hongxia Jin of San Jose CA (US)
EFFICIENT ON-DEVICE TRANSFORMER ARCHITECTURE FOR IMAGE PROCESSING
This abstract first appeared for US patent application 20240414448 titled 'EFFICIENT ON-DEVICE TRANSFORMER ARCHITECTURE FOR IMAGE PROCESSING
Original Abstract Submitted
provided is a u-shaped network for image restoration. the u-shaped network is lightweight based on a transformer block and is suitable to be deployed on-device, such as in a smartphone. the u-shaped network uses the transformer block to implement encoder, decoder and bottleneck functions. decoders are connected to respective encoders using skip connections based on element-wise addition, which avoids dimension expansion of concatenation. the transformer block uses a configuration of scaling and pool mixing to process input image data without the need for self-attention computations which permits reduction in memory, reduction in latency, reduction in computational demand, all while maintaining good output image quality.