Abstract
We present Captivates, an open-source smartglasses system designed for long-term, in-the-wild psychophysiological monitoring at scale. Captivates integrate many underutilized physiological sensors in a streamlined package, including temple and nose temperature measurement, blink detection, head motion tracking, activity classification, 3D localization, and head pose estimation. Captivates were designed with an emphasis on: (1) manufacturing and scalability, so we can easily support large scale user studies for ourselves and offer the platform as a generalized tool for ambulatory psychophysiology research; (2) robustness and battery life, so long-term studies result in trustworthy data individual's entire day in natural environments without supervision or recharge; and (3) aesthetics and comfort, so people can wear them in their normal daily contexts without self-consciousness or changes in behavior. Captivates are intended to enable large scale data collection without altering user behavior. We validate that our sensors capture useful data robustly for a small set of beta testers. We also show that our additional effort on aesthetics was imperative to meet our goals; namely, earlier versions of our prototype make people uncomfortable to interact naturally in public, and our additional design and miniaturization effort has made a significant impact in preserving natural behavior. There is tremendous promise in translating psychophysiological laboratory techniques into real-world insight. Captivates serve as an open-source bridge to this end. Paired with an accurate underlying model, Captivates will be able to quantify the long-term psychological impact of our design decisions and provide real-time feedback for technologists interested in actuating a cognitively adaptive, user-aligned future.
Highlights
1 INTRODUCTION If we can measure the experiential quality of our work, our entertainment, our education– the mental experiences of deep engagement, stress, alertness, and emotion– we can dissect the influence of our technology and infrastructure on our lives
The glasses we used are shown in Figure 24; they include well known smartglasses: Google Glass, which includes a suite of functionality, including an outward facing camera; Bose AR, which plays audio; the Snapchat Spectacles, which can take a picture on demand; and the GoVision video recording glasses
With the Captivates project, we set out to build a system for long-term, in-the-wild psychophysiological monitoring at scale
Summary
If we can measure the experiential quality of our work, our entertainment, our education– the mental experiences of deep engagement, stress, alertness, and emotion– we can dissect the influence of our technology and infrastructure on our lives. This analysis would catalyze our ability to actuate our tools and our environments in support of deep, effortless engagement in the tasks we wish to prioritize and otherwise react to our internal state. Physiological signals have shown strong correlations to mental experience in isolated contexts, like concerts and classrooms, where group data can be cross-referenced against emotional stimuli.
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
