Conducting Studies in Human-Robot Interaction

Abstract

This chapter provides an overview on approaches for planning, designing, and executing human studies for Human-Robot Interactions (HRI). Recent literature is presented on approaches used for conducting studies in human-robot interactions. There is a detailed section on terminology commonly used in HRI studies, along with some statistical calculations that can be performed to evaluate the effect sizes of the data collected during HRI studies. Two improvements are described, using insights from the psychology and social science disciplines. First is to use appropriate sample sizes to better represent the populations being investigated to have a higher probability of obtaining statistically significant results. Second is the application of three or more methods of evaluation to have reliable and accurate results, and convergent validity. Five primary methods of evaluation exist: self-assessments, behavioral observations, psychophysiological measures, interviews, and task performance metrics. The chapter describes specific tools and procedures to operationalize these improvements, as well as suggestions for recruiting participants. A large-scale, complex, controlled human study in HRI using 128 participants and four methods of evaluation is presented to illustrate planning, design, and execution choices. The chapter concludes with ten recommendations and additional comments associated with the experimental design and execution of human studies for human-robot interactions.