Towards a reliable and valid mixed methods instrument in user eXperience studies

Abstract

The paper presents an exploratory study based on the use of mixed methods in the context of conducting user experience experiments. The applied user experience model is an instantiation of a holistic model adopted from a previous EU research project. The design of the related survey instrument for collecting both quantitative and qualitative data is intended to measure the user experience resulting from the use of a mobile app. Besides assessing the effectiveness of using mixed methods for carrying out user experience studies, the main objective of this exploratory study is to check reliability and validity of the survey instrument. It is also intended to suggest potential improvements to the survey instrument. The actual findings show an acceptable level of reliability of some elements of the user experience survey instrument.