20240008785. INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, AND INFORMATION PROCESSING PROGRAM simplified abstract (Yume Cloud Japan Inc.)

INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, AND INFORMATION PROCESSING PROGRAM

Organization Name

Yume Cloud Japan Inc.

Inventor(s)

Michio Yokoyama of Yonezawa-shi, Yamagata (JP)

Tomochika Harada of Yonezawa-shi, Yamagata (JP)

Daisuke Yoshida of Yonezawa-shi, Yamagata (JP)

Makoto Shohara of Yonezawa-shi, Yamagata (JP)

Kenichi Suzuki of Yonezawa-shi, Yamagata (JP)

Shigeyuki Seko of Yonezawa-shi, Yamagata (JP)

INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, AND INFORMATION PROCESSING PROGRAM - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240008785 titled 'INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, AND INFORMATION PROCESSING PROGRAM

Simplified Explanation

The abstract describes an information processing device that is connected to a terminal device of a subject and visualizes the subject's emotion. The device includes a data managing section that acquires data related to voice, facial expression image, and pulse wave of the subject. It also includes an emotion expression engine section that calculates a brain fatigue level based on the frequency of the voice, calculates a mood level by extracting the subject's emotion from the facial expression image, and calculates a stress level by performing a frequency analysis of the pulse wave. Lastly, it includes a three-axes processing section that displays a graph of points plotted at coordinates corresponding to the brain fatigue level, mood level, and stress level in a three-dimensional space defined by an x-axis, y-axis, and z-axis.

• The device is connected to a subject's terminal device and visualizes their emotion.
• It acquires data related to voice, facial expression image, and pulse wave of the subject.
• It calculates the subject's brain fatigue level based on the frequency of their voice.
• It calculates the subject's mood level by extracting their emotion from the facial expression image.
• It calculates the subject's stress level by performing a frequency analysis of their pulse wave.
• It displays a graph of points in a three-dimensional space representing the brain fatigue level, mood level, and stress level.

Potential applications of this technology:

• Mental health monitoring and assessment
• Emotion recognition in human-computer interaction systems
• Stress management and relaxation techniques
• Biofeedback therapy and training

Problems solved by this technology:

• Difficulty in accurately assessing and understanding a person's emotional state
• Lack of real-time feedback on brain fatigue, mood, and stress levels
• Limited tools for self-awareness and emotional well-being

Benefits of this technology:

• Improved mental health monitoring and early detection of emotional distress
• Enhanced human-computer interaction experiences
• Personalized stress management and relaxation techniques
• Empowerment and self-awareness for individuals in managing their emotions and well-being

Original Abstract Submitted

an information processing device connected to a terminal device of a subject and which visualizes emotion of the subject includes a data managing section that acquires at least data related to voice, a facial expression image, and a pulse wave of the subject; an emotion expression engine section which calculates a brain fatigue level based on a frequency of the voice, which calculates a mood level by extracting an emotion of the subject from the facial expression image, and which calculates a stress level by performing a frequency analysis of the pulse wave by fast fourier transform and extracting a high-frequency section and a low-frequency section; and a three-axes processing section which displays a graph of points plotted at coordinates corresponding to the brain fatigue level, the mood level, and the stress level in a three-dimensional space defined by an x-axis, a y-axis, and a z-axis.