Amazon technologies, inc. (20250103341). BUS FOR TRANSPORTING OUTPUT VALUES OF NEURAL NETWORK LAYER
BUS FOR TRANSPORTING OUTPUT VALUES OF NEURAL NETWORK LAYER
Organization Name
Inventor(s)
Kenneth Duong of San Jose CA US
Steven L. Teig of Menlo Park CA US
BUS FOR TRANSPORTING OUTPUT VALUES OF NEURAL NETWORK LAYER
This abstract first appeared for US patent application 20250103341 titled 'BUS FOR TRANSPORTING OUTPUT VALUES OF NEURAL NETWORK LAYER
Original Abstract Submitted
some embodiments provide a neural network inference circuit (nnic) for executing a neural network that includes multiple computation nodes at multiple layers. the nnic includes multiple core circuits including memories for storing input values for the computation nodes. the nnic includes a set of post-processing circuits for computing output values of the computation nodes. the output values for a first layer are for storage in the core circuits as input values for a second layer. the nnic includes an output bus that connects the post-processing circuits to the core circuits. the output bus is for (i) receiving a set of output values from the post-processing circuits, (ii) transporting the output values of the set to the core circuits based on configuration data specifying a core circuit at which each of the output values is to be stored, and (iii) aligning the output values for storage in the core circuits.
