Robert bosch gmbh (20250111859). SYSTEMS AND METHODS FOR CROSS-MODAL SIGNAL INFERENCE USING AUDIO SIGNALS
SYSTEMS AND METHODS FOR CROSS-MODAL SIGNAL INFERENCE USING AUDIO SIGNALS
Organization Name
Inventor(s)
Long Huang of Baton Rouge LA US
Pongtep Angkititrakul of Dublin CA US
SYSTEMS AND METHODS FOR CROSS-MODAL SIGNAL INFERENCE USING AUDIO SIGNALS
This abstract first appeared for US patent application 20250111859 titled 'SYSTEMS AND METHODS FOR CROSS-MODAL SIGNAL INFERENCE USING AUDIO SIGNALS
Original Abstract Submitted
systems and methods for converting a primary one-dimensional signal into a secondary one-dimensional signal of another modality. the primary signal is spliced into a plurality of consecutive frames. a first linear transformation transforms the frames into corresponding vectors. positional encodings are provided on the vectors to encode relative positional information associated with each sample within each frame. a multi-head self-attention machine-learning model compares relative importance of the samples within each vector to each other in that vector to yield high-level representation vectors. a second linear transformation transforms the high-level representation vectors into corresponding secondary signal frames. the secondary signal frames are concatenated into a reconstructed one-dimensional secondary signal having a different modality than the primary signal.