Can a building read your mind? Results from a small trial in facial action unit detection

Abstract

In the last few decades, the energy consumption of individual buildings has been steadily improving. As a result, research efforts are shifting towards acquiring a deeper understanding of occupant comfort, health, and well-being in the built environment. However, existing techniques used to measure and predict the comfort of occupants have seen little change since Fanger. New research attempts are hence focusing on methods to gather more data, more frequently, and less intrusively. A little explored source of data is the one gathered from real-time videos of occupants, the so-called facial action units (FAU), which is the focus of this paper. These are the facial movements and positions that constitute the basic elements of emotions. Using software developed in the realm of affective computing, seven building occupants were monitored for a period of 2 weeks, whilst also completing surveys that gathered information about the office environment, and their work and personal life. Results found that participants that were happy with their office space showed significantly higher average values of the Cheek Raiser (AU06) and Lid Tightener (AU07) facial action units. These findings show the potential of using FAUs to assist in the control and design of buildings in a human-centric manner.