DeepMind Technologies Limited patent applications on November 14th, 2024
Patent Applications by DeepMind Technologies Limited on November 14th, 2024
DeepMind Technologies Limited: 1 patent applications
DeepMind Technologies Limited has applied for patents in the areas of G06N3/08 (1), G06N20/00 (1) G06N3/08 (1)
With keywords such as: data, item, support, attention, soft, patches, upon, query, values, and example in patent application abstracts.
Patent Applications by DeepMind Technologies Limited
Inventor(s): Aaron Gerard Antonius van den Oord of London (GB) for deepmind technologies limited, Yutian Chen of Cambridge (GB) for deepmind technologies limited, Danilo Jimenez Rezende of London (GB) for deepmind technologies limited, Oriol Vinyals of London (GB) for deepmind technologies limited, Joao Ferdinando Gomes de Freitas of London (GB) for deepmind technologies limited, Scott Ellison Reed of Atlanta GA (US) for deepmind technologies limited
IPC Code(s): G06N3/08, G06N20/00
CPC Code(s): G06N3/08
Abstract: a system comprising a causal convolutional neural network to autoregressively generate a succession of values of a data item conditioned upon previously generated values of the data item. the system includes support memory for a set of support data patches each of which comprises an encoding of an example data item. a soft attention mechanism attends to one or more patches when generating the current item value. the soft attention mechanism determines a set of scores for the support data patches, for example in the form of a soft attention query vector dependent upon the previously generated values of the data item. the soft attention query vector is used to query the memory. when generating the value of the data item at a current iteration layers of the causal convolutional neural network are conditioned upon the support data patches weighted by the scores.
DeepMind Technologies Limited patent applications on November 14th, 2024
