Samsung electronics co., ltd. (20240126833). APPARATUS AND METHOD OF PERFORMING MATRIX MULTIPLICATION OPERATION OF NEURAL NETWORK simplified abstract

From WikiPatents
Jump to navigation Jump to search

APPARATUS AND METHOD OF PERFORMING MATRIX MULTIPLICATION OPERATION OF NEURAL NETWORK

Organization Name

samsung electronics co., ltd.

Inventor(s)

Songyi Han of Hwaseong-si (KR)

Hyunsun Park of Suwon-si (KR)

APPARATUS AND METHOD OF PERFORMING MATRIX MULTIPLICATION OPERATION OF NEURAL NETWORK - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240126833 titled 'APPARATUS AND METHOD OF PERFORMING MATRIX MULTIPLICATION OPERATION OF NEURAL NETWORK

Simplified Explanation

The abstract describes a neural network apparatus for performing a matrix multiplication operation, which includes determining whether to divide an initial weight in a column or row direction based on reshape and transpose operations, generating division weights, performing matrix multiplication operations, and generating final feature maps.

  • Processor determines direction to divide initial weight
  • Processor generates division weights
  • Processor performs matrix multiplication operations
  • Processor generates final feature maps

Potential Applications

This technology can be applied in various fields such as image processing, natural language processing, and computer vision for tasks like object recognition, language translation, and image classification.

Problems Solved

This technology solves the problem of efficiently performing matrix multiplication operations in neural networks by optimizing weight division and multiplication processes.

Benefits

The benefits of this technology include improved efficiency in neural network operations, faster processing speeds, and enhanced accuracy in tasks such as image recognition and language processing.

Potential Commercial Applications

A potential commercial application of this technology could be in the development of advanced AI systems for industries like healthcare, finance, and autonomous vehicles.

Possible Prior Art

One possible prior art for this technology could be existing neural network architectures that perform matrix multiplication operations, but may not optimize weight division and multiplication processes as described in this patent application.

Unanswered Questions

How does this technology compare to existing neural network architectures in terms of performance and efficiency?

This article does not provide a direct comparison between this technology and existing neural network architectures in terms of performance and efficiency.

What are the specific use cases where this technology would outperform traditional neural network architectures?

This article does not specify the specific use cases where this technology would outperform traditional neural network architectures.


Original Abstract Submitted

a neural network apparatus for performing a matrix multiplication operation includes a memory having at least one program stored therein and a processor to perform one or more operations by executing the at least one program. the processor can determine whether to divide an initial weight in one of a column direction and a row direction according to whether a reshape operation and a transpose operation are performed before or after a matrix multiplication operation and generate division weights by dividing the initial weight by a head count in the determined direction. also, the processor can generate intermediate feature maps by performing a matrix multiplication operation between the input feature map and the division weights and generate a final feature map based on the intermediate feature maps.