
Automatic Detection of Auditory, Visual and Physiological Parameters for the Diagnosis
of Affective Disorders
EU Funded Project Affective Mind


Project Justification



Automatic Speech Feature Extraction. Input: Real time PC-Speaker Audio. Processing (a) Extraction of Mel Frequency Cepstral Coefficients (MFCC). Output (b): BDI-Depression Score.
Depression Symptoms (a) Low vs. (b) High Energy Sample
Our Approach


Example of extraction of key figures from time-frequency diagrams of the speech signal. Shown as horizontal bars are the resonance frequencies of the vocal tract associated with jaw opening, horizontal tongue position and vocal tract tension. Vocal tract parameters provide, among other things, information on depression-associated speaker states such as sadness, fatigue depression states and comorbid anxiety states.
Work Packages, Insights and Outcomes

Overview of the Multi-Modal Depression Classification Framework
Demonstrator Prototype: Sadness Detection via Speech


Related Projects
Development of a screening and support portal as an extensive psycho-social diagnostic mode for refugees
A holistic view of interrelated frailties to reduce frailty risk by improving overall well-being
Feedback-assisted rehabilitation after surgery of the anterior cruciate ligament
A contribution of German elite sport to smart health promotion
Market overview, legal and technical requirement analysis, living lab study, and implementation of corporate health management programs
Desktop and virtual reality-supported module variants to bridge waiting times between therapy sessions and enrich ambulant therapy
Support of acute therapy and relapse prevention in the deep psychological treatment
Features extraction of auditory, visual, and physiological data for diagnosis system of affective disorders