18824034. BUS FOR TRANSPORTING OUTPUT VALUES OF NEURAL NETWORK LAYER (Amazon Technologies, Inc.)

BUS FOR TRANSPORTING OUTPUT VALUES OF NEURAL NETWORK LAYER

Organization Name

Amazon Technologies, Inc.

Inventor(s)

Kenneth Duong of San Jose CA US

Jung Ko of San Jose CA US

Steven L. Teig of Menlo Park CA US

BUS FOR TRANSPORTING OUTPUT VALUES OF NEURAL NETWORK LAYER

This abstract first appeared for US patent application 18824034 titled 'BUS FOR TRANSPORTING OUTPUT VALUES OF NEURAL NETWORK LAYER

Original Abstract Submitted

Some embodiments provide a neural network inference circuit (NNIC) for executing a neural network that includes multiple computation nodes at multiple layers. The NNIC includes multiple core circuits including memories for storing input values for the computation nodes. The NNIC includes a set of post-processing circuits for computing output values of the computation nodes. The output values for a first layer are for storage in the core circuits as input values for a second layer. The NNIC includes an output bus that connects the post-processing circuits to the core circuits. The output bus is for (i) receiving a set of output values from the post-processing circuits, (ii) transporting the output values of the set to the core circuits based on configuration data specifying a core circuit at which each of the output values is to be stored, and (iii) aligning the output values for storage in the core circuits.