Microsoft technology licensing, llc (20240411691). COMPUTER MEMORY ACCESS FOR MACHINE LEARNING MODELS
COMPUTER MEMORY ACCESS FOR MACHINE LEARNING MODELS
Organization Name
microsoft technology licensing, llc
Inventor(s)
Gilad Kirshenboim of Petach Tiqva (IL)
COMPUTER MEMORY ACCESS FOR MACHINE LEARNING MODELS
This abstract first appeared for US patent application 20240411691 titled 'COMPUTER MEMORY ACCESS FOR MACHINE LEARNING MODELS
Original Abstract Submitted
a method for computer memory access includes, during execution of a machine learning model, receiving an input vector for multiplication with a matrix of network weight values. each network weight value of the matrix of network weight values is stored in computer memory using a stored quantity(s) of bits. for a network weight value of the matrix of network weight values, a representation quantity (r) of bits is determined to be used for representing the network weight value during multiplication with a corresponding vector value of the input vector, based at least in part on a magnitude of the corresponding vector value. the r bits of the network weight value are retrieved from the computer memory for multiplication with the corresponding vector value.