Multimodal fusion diagnosis of depression and anxiety based on face video 2021 International Conference on Medical Imaging Physics and Engineering and the 10th National Annual Meeting of Medical Imaging Physics 2021 IEEE国际医学影像物理和工程大会暨第十届中国医学影像物理学术年会 ICMIPE 2021

Presentation Details

Multimodal fusion diagnosis of depression and anxiety based on face video

ID：54 View Protection：ATTENDEE Updated Time：2021-10-30 18:04:16 Hits：1892 Poster Presentation

Start Time：2021-11-13 10:05（Asia/Shanghai）

Duration：5min

Session：Pos Poster » PosPoster Session

Video No Permission Presentation File

Tips: Only the registered participant can access the file. Please sign in first.

Abstract

In order to diagnose depression and anxiety, clinicians will conduct interviews with subjects. If large-scale screening is carried out, this method is too costly and difficult to implement. Because facial expressions play an important role in the diagnosis of clinicians, this provides an opportunity to solve this problem. Therefore, we recorded 303 subjects who answered the self-rated anxiety scale (SAS) and the self-rated depression scale (SDS) Video. Based on Convolutional Neural Networks (CNN) and Long Short-Term Memory Networks (LSTM), by using either of these two types of videos alone as a binary classification experiment, the accuracy of the diagnosis of depression is 72.53%, and the diagnosis of anxiety is 72.08%. In addition, by fusing the two types of videos to diagnose anxiety, depression, and normal in three categories, the accuracy of the model is 80.22%. Through the comparison of the results, the multimodal fusion diagnosis can not only diagnose the three categories but also has the highest accuracy. This model can be deployed on smartphones, not only for large-scale screening but also to assist doctors in diagnosis.

Keywords

Depression detection, Anxiety detection, Face video, Long Short-Term Memory Networks,Classification

Speaker

Chen Wang

Harbin Engineering University

Submission Author

Chen Wang Harbin Engineering University

Lizhong Liang Sun Yat-Sen University；Marine Biomedical Research Institute of Guangdong

Xiaofeng Liu Harvard Medical School；Suzhou Fanhan Information Technology Co., Ltd

Yao Lu Sun Yat-Sen University；Marine Biomedical Research Institute of Guangdong

Jihong Shen Harbin Engineering University

Hui Luo Southern Marine Science and Engineering Guangdong Laboratory；Marine Biomedical Research Institute of Guangdong

Wanqing Xie Harbin Engineering University；Suzhou Fanhan Information Technology Co., Ltd

Submit Comment

All Comments

Important Date

Conference Date

Nov 13

2021

to

Nov 14

2021
Sep 30 2021

Contribution Submission Deadline
Nov 14 2021

Registration deadline

Organized By

Anhui Biomedical Engineering Society.
University of Science and Technology of China

Contact Information

Mrs. Yang
ic******@ustc.edu.cn
+86********

Previous Conferences

2017-11-04 China Beijing,China
2017 International Conference on Medical Imaging Physics and Engineering
2017-11-03 China 海淀区
2017 IEEE 国际医学影像物理和工程大会
2013-10-19 China 沈阳市
2013 IEEE International Conference on Medical Imaging Physics and Engineering (ICMIPE)

2021 International Conference on Medical Imaging Physics and Engineering and the 10th National Annual Meeting of Medical Imaging Physics (ICMIPE 2021)