Salesforce, inc. (20250131246). SYSTEMS AND METHODS FOR AN ATTENTION-BASED NEURAL NETWORK ARCHITECTURE
SYSTEMS AND METHODS FOR AN ATTENTION-BASED NEURAL NETWORK ARCHITECTURE
Organization Name
Inventor(s)
Devansh Arpit of Pacifica CA US
Caiming Xiong of Menlo Park CA US
SYSTEMS AND METHODS FOR AN ATTENTION-BASED NEURAL NETWORK ARCHITECTURE
This abstract first appeared for US patent application 20250131246 titled 'SYSTEMS AND METHODS FOR AN ATTENTION-BASED NEURAL NETWORK ARCHITECTURE
Original Abstract Submitted
embodiments provide an attention mechanism that computes attention weights for an input sequence by employing a set of multi-head learnable vectors (referred to as âbinder vectorsâ) to attend to the input sequence.