Abstract

We present Captivates, an open-source smartglasses system designed for long-term, in-the-wild psychophysiological monitoring at scale. Captivates integrate many underutilized physiological sensors in a streamlined package, including temple and nose temperature measurement, blink detection, head motion tracking, activity classification, 3D localization, and head pose estimation. Captivates were designed with an emphasis on: (1) manufacturing and scalability, so we can easily support large scale user studies for ourselves and offer the platform as a generalized tool for ambulatory psychophysiology research; (2) robustness and battery life, so long-term studies result in trustworthy data individual's entire day in natural environments without supervision or recharge; and (3) aesthetics and comfort, so people can wear them in their normal daily contexts without self-consciousness or changes in behavior. Captivates are intended to enable large scale data collection without altering user behavior. We validate that our sensors capture useful data robustly for a small set of beta testers. We also show that our additional effort on aesthetics was imperative to meet our goals; namely, earlier versions of our prototype make people uncomfortable to interact naturally in public, and our additional design and miniaturization effort has made a significant impact in preserving natural behavior. There is tremendous promise in translating psychophysiological laboratory techniques into real-world insight. Captivates serve as an open-source bridge to this end. Paired with an accurate underlying model, Captivates will be able to quantify the long-term psychological impact of our design decisions and provide real-time feedback for technologists interested in actuating a cognitively adaptive, user-aligned future.

Highlights

  • 1 INTRODUCTION If we can measure the experiential quality of our work, our entertainment, our education– the mental experiences of deep engagement, stress, alertness, and emotion– we can dissect the influence of our technology and infrastructure on our lives

  • The glasses we used are shown in Figure 24; they include well known smartglasses: Google Glass, which includes a suite of functionality, including an outward facing camera; Bose AR, which plays audio; the Snapchat Spectacles, which can take a picture on demand; and the GoVision video recording glasses

  • With the Captivates project, we set out to build a system for long-term, in-the-wild psychophysiological monitoring at scale

Read more

Summary

Introduction

If we can measure the experiential quality of our work, our entertainment, our education– the mental experiences of deep engagement, stress, alertness, and emotion– we can dissect the influence of our technology and infrastructure on our lives. This analysis would catalyze our ability to actuate our tools and our environments in support of deep, effortless engagement in the tasks we wish to prioritize and otherwise react to our internal state. Physiological signals have shown strong correlations to mental experience in isolated contexts, like concerts and classrooms, where group data can be cross-referenced against emotional stimuli.

Objectives
Methods
Findings
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call