Please use this identifier to cite or link to this item: http://bura.brunel.ac.uk/handle/2438/14803
Title: Artificial intelligent system for automatic depression level analysis through visual and vocal expressions
Authors: Jan, A
Meng, H
Gaus, Y
Zhang, F
Keywords: Artificial system;Depression;Beck depression inventory;Facial expression;Vocal expression;Regression;Deep learning
Issue Date: 2017
Publisher: IEEE
Citation: IEEE Transactions on Cognitive and Developmental Systems, (2017)
Abstract: A human being’s cognitive system can be simulated by artificial intelligent systems. Machines and robots equipped with cognitive capability can automatically recognize a humans mental state through their gestures and facial expressions. In this paper, an artificial intelligent system is proposed to monitor depression. It can predict the scales of Beck Depression Inventory (BDI-II) from vocal and visual expressions. Firstly, different visual features are extracted from facial expression images. Deep Learning method is utilized to extract key visual features from the facial expression frames. Secondly, Spectral Low-level Descriptors (LLDs) and Mel-frequency cepstral coefficients (MFCCs) features are extracted from short audio segments to capture the vocal expressions. Thirdly, Feature Dynamic History Histogram (FDHH) is proposed to capture the temporal movement on the feature space. Finally these FDHH and Audio features are fused using regression techniques for the prediction of the BDI-II scales. The proposed method has been tested on the public AVEC2014 dataset as it is tuned to be more focused on the study of depression. The results outperform all the other existing methods on the same dataset.
URI: http://bura.brunel.ac.uk/handle/2438/14803
ISSN: 2379-8920
Appears in Collections:Dept of Electronic and Computer Engineering Research Papers

Files in This Item:
File Description SizeFormat 
FullText.pdf1.22 MBAdobe PDFView/Open


Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.