Non-contact physiological monitoring of heart rate, facial temperature, and respiration rate with thermal and RGB cameras

Abstract

In this paper, we evaluated a non-contact physiological measurement technique using a thermal camera and an RGB camera aimed at the participant's face. The thermal camera effectively measured the temperature of specific facial regions, such as the tip of the nose, which is related to stress and mental workload. It also accurately measured respiration rate, which is an important indicator of mental state. On the other side, the RGB camera successfully measured heart rate by detecting subtle color changes in the face. However, the thermal camera was not effective in measuring heart rate, possibly due to a lack of thermal sensitivity and image resolution. Overall, our results confirmed that using thermal and RGB cameras can be a practical and discreet method for monitoring an individual's mental state. Additionally, these cameras can monitor movements and detect states of medical incapacitation, such as loss of consciousness.