18189489. LEARNING METHOD FOR ENHANCING ROBUSTNESS OF A NEURAL NETWORK simplified abstract (SK hynix Inc.)

From WikiPatents
Jump to navigation Jump to search

LEARNING METHOD FOR ENHANCING ROBUSTNESS OF A NEURAL NETWORK

Organization Name

SK hynix Inc.

Inventor(s)

Sein Park of Daegu (KR)

Eunhyeok Park of Pohang (KR)

LEARNING METHOD FOR ENHANCING ROBUSTNESS OF A NEURAL NETWORK - A simplified explanation of the abstract

This abstract first appeared for US patent application 18189489 titled 'LEARNING METHOD FOR ENHANCING ROBUSTNESS OF A NEURAL NETWORK

Simplified Explanation

The learning method of a neural network system involves preparing a second neural network with the same weights as a pre-trained first neural network, adding noise to the weights of the first neural network, generating output data from both networks, and calculating a loss function using the output data and true values.

  • Second neural network with same weights as first neural network
  • Adding noise to weights of first neural network
  • Generating output data from both networks
  • Calculating loss function using output data and true values

Potential Applications

This technology could be applied in various fields such as:

  • Machine learning
  • Artificial intelligence
  • Data analysis

Problems Solved

This technology helps in:

  • Improving the accuracy of neural networks
  • Enhancing the learning capabilities of AI systems

Benefits

The benefits of this technology include:

  • Increased efficiency in data processing
  • Enhanced performance of neural networks

Potential Commercial Applications

With its capabilities, this technology could be used in:

  • Predictive analytics software
  • Autonomous vehicles technology

Possible Prior Art

One possible prior art related to this technology is:

  • Research on noise injection in neural networks

Unanswered Questions

How does this method compare to traditional neural network training techniques?

This method introduces noise to the weights of the neural network, which may help in preventing overfitting and improving generalization. Traditional techniques usually involve adjusting weights based on backpropagation without noise injection.

What impact does the noise injection have on the overall performance of the neural network?

The noise injection can potentially help the neural network explore different solutions and avoid getting stuck in local minima. However, the optimal level of noise and its effect on convergence speed and final accuracy need to be further studied.


Original Abstract Submitted

A learning method of a neural network system includes preparing a second neural network having the same weights as a first neural network which is pre-trained; adding noise to weights of the first neural network; generating a first output data of the first neural network and generating a second output data of the second neural network by providing input data to the first neural network and the second neural network; and calculating a loss function using the first output data, the second output data, and a true value corresponding to the input data.