METHOD AND SYSTEM FOR EARLY DIAGNOSIS OF PARKINSON'S DISEASE BASED ON MULTIMODAL DEEP LEARNING

Abstract: a method for early diagnosis of parkinson's disease based on multimodal deep learning is provided. audio-visual data of a to-be-diagnosed subject while performing a speech task is acquired. the audio-visual data are preprocessed to extract a plurality of audio segments and a plurality of video segments. a face image sequence is extracted from each of the plurality of video segments. a mel-spectrogram of each of the plurality of audio segments is calculated. the face image sequence and the mel-spectrogram are input into a multimodal deep learning model to output a classification result for parkinson's disease early diagnosis of the to-be-diagnosed subject. a system for early diagnosis of parkinson's disease based on multimodal deep learning is also provided.

Inventor(s): Xin MA, Cuihua LV

CPC Classification: A61B5/4082 ({Diagnosing or monitoring movement diseases, e.g. Parkinson, Huntington or Tourette})

Search for rejections for patent application number 20250213174