You look stressed: A pilot study on facial action unit activity in the context of psychosocial stress

Abstract

Quality and quantity of the human stress response are highly individual. Not only are there differences in terms of psychological and physiological stress reactivity, but also with regard to facial muscle stress reactivity. In a first correlative pilot study to decipher the signature of stress as it presents in the physiognomy of a stressed individual, we investigated how stress-induced muscle movement activity in the face is associated with stress marker activation during a standardized laboratory stress test. Female and male participants (N = 62) completed the Trier Social Stress Test and provided multiple measurements of salivary cortisol, subjective experience, heart rate, and high-frequency heart rate variability. In addition, participants were filmed during stress induction to derive the activation of 13 individual muscles or muscle groups, also termed action units (AU). Mean AU intensity and occurrence rates were measured using the opensource software OpenDBM. We found that facial AU activity correlated with different aspects of the psychosocial stress response. Higher stress-induced cortisol release was associated with more frequent upper eyelid raiser (AU05) and upper lip raiser (AU10) occurrences, while more lip corner pulling (AU12) went along with lower cortisol reactivity. More frequent eyelid tightener (AU07) occurrences were linked to higher subjective stress reactivity but decreased heart rate and HF-HRV reactivity. Last, women showed greater stress-induced smiling intensity and occurrence rates than men. We conclude that psychosocial stress reactivity is systematically linked to facial muscle activity, with distinct facial stress profiles emerging for different stress markers. From all the AUs studied, eyelid tightening (AU07) seems to provide the strongest potential for future attempts of diagnosing phases of acute stress via facial activity.