Google llc (20250005354). Learning Strides in Convolutional Neural Networks
Learning Strides in Convolutional Neural Networks
Organization Name
Inventor(s)
David Grangier of Mountain View CA US
Learning Strides in Convolutional Neural Networks
This abstract first appeared for US patent application 20250005354 titled 'Learning Strides in Convolutional Neural Networks
Original Abstract Submitted
a method of training a machine learning model, includes receiving training data for the machine learning model, wherein the training data comprises a plurality of batches. the method also includes applying a downsampling layer of the machine learning model to the plurality of batches of the training data to determine a stride comprising a learnable parameter for the downsampling layer. applying the downsampling layer of the machine learning model to a batch of the training data includes projecting an input in a spatial domain to a fourier domain, constructing a mask in the fourier domain based on a current value of the stride and dimensions of the input, applying the mask as a low-pass filter to the projected input to produce a tensor in the fourier domain, cropping the tensor based on the mask, and transforming the cropped tensor to the spatial domain.