18897244. ENHANCING NEURAL NETWORK TRAINING VIA BALANCED CONCATENATION (NVIDIA Corporation)

ENHANCING NEURAL NETWORK TRAINING VIA BALANCED CONCATENATION

Organization Name

NVIDIA Corporation

Inventor(s)

Tero Tapani Karras of Helsinki FI

Miika Samuli Aittala of Helsinki FI

Janne Johannes Hellsten of Helsinki FI

Jaakko T. Lehtinen of Helsinki FI

Timo Oskari Aila of Tuusula FI

Samuli Matias Laine of Vantaa FI

ENHANCING NEURAL NETWORK TRAINING VIA BALANCED CONCATENATION

This abstract first appeared for US patent application 18897244 titled 'ENHANCING NEURAL NETWORK TRAINING VIA BALANCED CONCATENATION

Original Abstract Submitted

Apparatuses, systems, and techniques to train neural networks and to use neural networks to perform inference. In at least one embodiment, a balanced concatenation layer performs a balanced concatenation operation during a forward pass of a training iteration during the training of a neural network. In at least one embodiment, a balanced concatenation layer performs a balanced concatenation operation during the use of a neural network to perform inference.