Measuring User Experience Research Articles

Biological-Signal-Based User-Interface System for Virtual-Reality Applications for Healthcare

Biosignal interfaces provide important data that reveal the physical status of a user, and they are used in the medical field for patient health status monitoring, medical automation, or rehabilitation services. Biosignals can be used in developing new contents, in conjunction with virtual reality, and are important factors for extracting user emotion or measuring user experience. A biological-signal-based user-interface system composed of sensor devices, a user-interface system, and an application that can extract biological-signal data from multiple biological-signal devices and be used by content developers was designed. A network-based protocol was used for unconstrained use of the device so that the biological signals can be freely received via USB, Bluetooth, WiFi, and an internal system module. A system that can extract biological-signal data from multiple biological-signal data and simultaneously extract and analyze the data from a virtual-reality-specific eye-tracking device was developed so that users who develop healthcare contents based on virtual-reality technology can easily use the biological signals.

From Lonely to Resilient through Humanoid Robots: Building a New Framework of Resilience

This paper connects different theories and methods from the social sciences and applies them to human-humanoid robot interaction (HHRI) to explain loneliness reduction and the build-up of resilience in older adults through social robots. It allows for user-related aspects such as age, social connectedness, gender role, personality, and need satisfaction as well as robot-related aspects, particularly coaching behaviors and communication styles. From these scientific considerations, solutions to design challenges are pinpointed, proposing novel interaction schemes that enhance the feeling of support and companionship. This paper also opens the way to conducting empirical research to examine HHRI-related designs, measuring user experience in HHRI, while suggesting applications in HHRI in various settings, such as coaching and eldercare.

Rancang Bangun Aplikasi UMN Library Catalog Menggunakan Metode Rocchio Relevance Feedback

Library catalog is a documentation or list of all library collections. Unfortunately, there is a problem identified in the process of searching a book inside library catalog in Universitas Multimedia Nusantara’s library information system regarding the relevant result based on user query input. This research aims to design and build a library catalog application on Android platform in order to increase the relvancy of searching result in a database using calculated Rocchio Relevance Feedback method along with user experience measurement. User experience analysis result presented a good respond with 91.18% score based by all factor and relevance value present 71.43% precision, 100% recall, and 83.33% F-Measure. Differences of relevant results between the Senayan Library Information system (SLiMS) and the new Android application ranged at 36.11%. Therefore, this Android application proved to give relevant result based on relevance rank.
 Index Terms—Rocchio, Relevance, Feedback, Pencarian, Buku, Aplikasi, Android, Perpustakaan.

A STEP FORWARD IN INTEGRATING HEALTHCARE AND VOICE-ENABLED TECHNOLOGY: CONCEPT DEMONSTRATION WITH DEPLOYMENT OF AUTOMATIC MEDICAL CODING MODEL AS AN AMAZON “ALEXA” SKILL

Digital technology is fast improving and being adopted by many fields of research. Although the adoption is slow in clinical research, the change is inevitable. Amazon, Google and Microsoft are accelerating the progress and implementation by providing cloud-based web services. HIPAA compliance of such platforms has provided confidence to the medical community to adopt cloud services at a quicker pace. With deep learning making a paradigm shift in every field it touches, all the above-mentioned tech giants provide Artificial Intelligence tools and architectures to rapidly create and deploy applications. These services act as bricks which when put together creates applications that can significantly improve user experience and quality control measures. Using an in-house developed model in conjunction with Amazon Web Services, we have developed a voice-interactive virtual assistant that answers users’ requests to obtain MedDRA coding results by understanding the user's question (Alexa skill with interaction model), executing the model in a server-less function (model deployed in AWS Lambda), querying the obtained code in a server-less interactive query service (AWS Athena) to obtain the corresponding meaningful description, and finally based on the result, communicates to them appropriately in a human-like voice. We had previously reported machine learning based models for medical coding that predict proper adverse event (AE) coding with an accuracy of 75 - 82% (Ravindranath et. al, AAIC 2017, 2018). Here, we demonstrate deployment of a custom built medical-coding model within services offered by Amazon to render a voice-based User Interface that can communicate and provide AE coding results seamlessly. We expect this method to act like a quick-lookup solution for the medical coders while coding, or training coders to find and validate their coding results.

O instrumentalismo na aferição da experiência do usuário

Instrumentalismo é o nome de uma doutrina no campo de Epistemologia que indica que conhecimento e método científico não são necessariamente falsos ou verdadeiros. Mas, devido ao seu caráter instrumental, esses servem de recursos para lidar com a realidade. Por sua vez, como aspecto da realidade prática na área de Design, observa-se a busca por métodos e outros recursos para mensurar a experiência do usuário (UX), porque, progressivamente, aumentou o interesse em design orientado para a experiência. Contudo, as experiências abrangem uma gama de propriedades e métricas que são variadas, muitas vezes particulares, efêmeras e subjetivas. Por isso, há dificuldades para se encontrar conceitos que designam a experiência do usuário e, consequentemente, recursos instrumentais relacionados com essa temática. Isso caracteriza a problemática desta pesquisa sobre o instrumentalismo na aferição da experiência do usuário. O objetivo foi identificar instrumentos que, de maneira eficiente, auxiliam os designers na projeção e mensuração da experiência do usuário, visando o desenvolvimento coerente de produtos e serviços. O procedimento adotado inicialmente no estudo proposto, como é descrito neste artigo, foi pesquisar trabalhos publicados em periódicos internacionais por meio de uma revisão sistemática. O conhecimento resultante permitiu a sistematização da literatura e a seleção de instrumentos considerados coerentes com o propósito da pesquisa. Portanto, o resultado foi o mapeamento descritivo de instrumentos destinados à aferição da experiência do usuário, para serem aplicados em projetos de design.

Using psychophysiological measures to evaluate the multisensory and emotional dynamics of the tea experience

In recent years, the user experience has gradually become the main focus in the design of consumer products, rather than the products’ features and functions. Therefore, designers should consider the user experience to be of paramount importance in the development of a successful product. In addition, user experience is not static, but rather it changes over the different stages of usage due to the variations in consumers’ sensory modalities and emotional responses. Therefore, this study aims to use psychophysiological measures to explore how the interaction between the user and the product at each different stage influences sensory modalities and emotional responses to products. The experiment was conducted in five stages according to the different levels of interaction for two tea products. Subjective data about sensory modalities and emotions related to the products were collected. In addition, the research gathered objective data to examine the feasibility of relating physiological measures to subjective experiences. The results showed that the tea experience tends to be dynamic over the different stages of usage, demonstrating important variations in the different sensory modalities and emotional feedback. In addition, physiological signals such as galvanic skin response, have been shown to be of potential value for evaluation of the user’s emotional reaction. Our findings could be important not only for a theoretical understanding of sensory and emotional feedback in a product experience but also as a measure of user experience using psychophysiological methods.

Designing for global mobile

An important element for global design is an approach that can be used for international (e.g., non-US) users. Such a design approach has to factor in how the user's culture influences how they perceive a design while using their mobile devices across a different culture. As mobile use is expected to grow globally, more mobile interactions will require increasingly robust tools for measuring user experiences across different online and physical channels. This article focuses on how experience mapping, a common user experience (UX) design technique that tells stories about how a user experiences a design as a seamless whole across such channels, can help address global mobile design contexts. To further address such global contexts, this article proposes extending experience mapping by considering the factors of existing infrastructures, global openness to innovation, local user contexts, and local beliefs on the function of technology so that designers of communication can better conceptualize sequences of events of interactions across cultures.

User Experience Metric for Augmented Reality Application: A Review

Augmented Reality Technology is developing rapidly and has been widely used in the field of education. Due to the ease of developing AR by non-professionals, User Experience (UX) is often not considered in the application. Currently, there are no standard measurements of UX for AR applications especially in Education. The authors reviewed previous research to obtain UX references and the existing measurement standards. From the results of the review, the metrics were analyzed based on the characteristics of AR, especially in the field of education. The metrics will be recommended for the UX measurement of an AR application. The available standard metrics can be used to determine the UX quality of an AR application and contribute to the improvement of UX in AR applications, especially in the field of Education.

A step-wise approach to developing indicators to compare the performance of maternity units using hospital administrative data.

Hospital administrative data are attractive for comparing performance of maternity units because of their often large sample sizes, lack of selection bias and the relatively low costs of accessing these data compared with conducting primary data collection. However, using administrative data to develop indicators can also present challenges including varying data quality, the limited detail on clinical risk factors and a lack of structural and user experience measures. This review illustrates how to develop performance indicators for maternity units using hospital administrative data, including methods to address the challenges that administrative data pose.Tweetable abstractHow to develop maternity indicators from administrative data.

Serious games for arm rehabilitation of persons with multiple sclerosis. A randomized controlled pilot study

ObjectivesThe feasibility and preliminary evidence for efficacy of a serious games platform compared to exergame using the Wii for arm rehabilitation in persons with multiple sclerosis (MS) was investigated. MethodsA pilot single-blind randomized (2:1) controlled in clinic trial was carried out. Sixteen persons with MS participated (age years 56.8 (SD 12.3), MS-onset years 19.4 (SD 12.3), EDSS 6.5). Ten participants used a serious games platform (Rehab@Home) while 6 participants played with the commercial Wii platform, for four weeks (40min, 12 sessions/4 weeks). Feasibility and user experience measures were collected. Primary outcomes were the 9 Hole Peg Test (9HPT) and the Box and Block test (BBT). Secondary outcomes were the EQ-5D visual analogue scale (EQ-VAS) and the SF-12. Nonparametric analysis was used to verify changes from pre to post rehabilitation within group and treatment effect was verified with Mann-Whitney U test. P value was set at 0.10 and clinical improvement was set at 20% improvement from baseline. ResultsSerious games were perceived positively in terms of user experience and motivation. There were clinically significant improvements in arm function in the serious games group as measured by 9HPT (38–29.5s, P = 0.046, > 20%) and BBT 32–42 cubes, P = 0.19, > 20%) following the 12 gaming sessions while the exergame group did not improve on either test (9HPT 34.5–41.5s, P = 0.34; BBT 38,5 to 42 cubes, P = 0.34). Only the exergame group perceived themselves as having improved their health. There was a significant between groups treatment effect only in perception of health (EQ-VAS) (Z = 1.93, P = 0.06) favouring the exergame group. ConclusionsVirtual reality in a serious gaming approach was feasible and beneficial to arm function of persons with MS but motivational aspects of the approach may need further attention.

Design and measurement of user experience oriented auto-stereoscopic 3D display based on optical lens

In order address the issues of crosstalk, poor user experiences, and difficult assessment of image quality in auto-stereoscopic 3D displays, we propose an easy-to-implement measurement method called fault-width-assessment for auto-stereoscopic 3D applications. Based on this method, we perform a study on the influence of camera group setups and multi-view image arrangements during the image fusion process. For scenes with multiple users and a non-fixed view, we propose various schemes for camera setups and multi-view image arrangement, which contribute to improving the user experience. Finally, cross-experimental comparisons and applications of the user experience tests are implemented, which are ultimately helpful for choosing a reasonable proposal.

Measuring User Experience With Postural Sway and Performance in a Head-Mounted Display

The purpose of this study was to examine differences in performance and postural sway among individuals performing a task when using and not using a head-mounted display (HMD). Twenty participants completed a repeated measures study in which they performed a simple object location targeting task while using and not using an HMD. Accuracy, time-to-hit, and postural sway were measured. Significant differences in accuracy and time-to-hit were found, indicating participants’ task performance was worse while using the HMD. Significant differences in magnitude of postural sway were found in elliptical area and path length, showing more sway when using the HMD than when not using it. These methods can be used to objectively measure user differences in response to wearing and using an HMD that can result in negative effects for users.

Validation of the Italian version of the Patient Reported Experience Measures for intermediate care services.

BackgroundIntermediate care (IC) services are a key component of integrated care for elderly people, providing a link between hospital and home through provision of rehabilitation and health and social care. The Patient Reported Experience Measures (PREMs) are designed to measure user experience of care in IC settings.ObjectiveTo examine the feasibility and the scaling properties of the Italian version of PREMs questionnaires for use in IC services.MethodsA cross-sectional survey was conducted on consecutive users of 1 home-based and 4 bed-based IC services in Emilia-Romagna (Italy). The main outcome measure was the PREMs questionnaire results. PREMs for each home- and bed-based IC services were translated, back-translated, and adapted through consensus among the members of the advisory board and pilot testing of face validity in 15 patients. A total of 199 questionnaires were returned from users of bed-based services and 185 were returned by mail from users of home-based services. The return rates and responses were examined. Mokken analysis was used to examine the scaling properties of the PREMs.ResultsAnalysis performed on the bed-based PREMs (N=154) revealed that 13 items measured the same construct and formed a moderate-strength scale (Loevinger H=0.488) with good reliability (Cronbach’s alpha =0.843). Analysis of home-based PREMs (N=134 records) revealed that 15 items constituted a strong scale (Loevinger H=0.543) with good reliability (Cronbach’s alpha =0.875).ConclusionThe Italian versions of the bed- and home-based IC-PREMs questionnaires proved to be valid and reliable tools to assess patients’ experience of care. Future plans include monitoring user experience over time in the same facilities and in other Italian IC settings for between-service benchmarking.

Evaluasi Perancangan Antarmuka untuk Membangun User Experience pada Layanan SInTA Universitas Kristen Duta Wacana Yogyakarta

SInTA is a search engine developed by Duta Wacana Christian University (DWCU) to locate references of final task reports or thesis ever made by DWCU students.The existence and function of SInTA is not widely known by students. In addition, SInTA still require many improvements on feature and UI design to simplify the interaction between users and interface.This research use individual expert review approach to evaluate interface, whereas data divided into 6 User Experience measurement scales. The result of evaluation is User Experience recommendation which used to build prototype.Considering User Experience shall be created a prototype which should attract users, meet the needs of users, and satisfy the users. In this research, prototype has higher User Experience mean values rather than SInTA old interface, thereby the research be assessed as being successful.

Contributions of mixed reality in a calligraphy learning task: Effects of supplementary visual feedback and expertise on cognitive load, user experience and gestural performance

The learning of handwriting and calligraphy can be improved by supplementary sensory feedback. Emerging technologies such as mixed reality devices can implement appropriate visual, auditory, or proprioceptive feedback. Yet there have been few studies on supplementary visual feedback. Our study was designed to fill this gap, by comparing the effects of two visual feedback types implemented on a graphic tablet with touchscreen (PenWidthFB versus ColoredVelocityFB feedback), in two groups with different levels of expertise in calligraphy (novice versus expert). We collected measures of cognitive load, user experience and gestural performance. Results showed that 1) there was no significant difference in cognitive load between experts and novices, but PenWidthFB feedback created a higher cognitive load than ColoredVelocityFB feedback, 2) for the user experience, there were no obvious differences between experts and novices, and between the two feedback types, 3) concerning the gestural performance, the experts were faster than the novices, and the applied pressure with ColoredVelocityFB feedback was higher than with PenWidthFB feedback.

The User Affective Experience Scale: A Measure of Emotions Anticipated in Response to Pop-Up Computer Warnings

ABSTRACTWe measured reported User Affective Experience (UAX) anticipated to pop-up warnings that unexpectedly appear during computer use. Such warnings, designed to protect the user, are often ignored, suggesting the influence of nonrational factors. Emotions can both enhance and undermine effective decision-making, but in the decision literature they are typically defined and measured simply in terms of positive and negative valence. We examined discrete emotions anticipated when pop-up warnings appear, including specific positive, negative, individualist, and prosocial emotions based upon affective neuroscience. Forty-five emotions associated with receiving warnings associated with failing to update software, both in relaxed online sessions and sessions involving time and attention pressures, were assessed for underlying measurement structure. Four hundred participants were recruited via Mechanical Turk and reported about specific emotions presented in random order. Exploratory structural equation modeling analyses revealed four reliable latent factors for relaxed (R) and pressured (P) conditions: Positive Affect, Anxiety, Hostility, and Loneliness. P conditions were higher in reported Anxiety, Hostility, and Loneliness and lower in reported Positive Affect. Men reported higher feelings of Hostility and Loneliness; women reported higher Anxiety. Implications are discussed for designing pop-up warnings and also more generally regarding conceptualizing and measuring user experience.

Subjective perception scoring: psychological interpretation of network usage metrics in order to predict user satisfaction

Experiences of users determine their actions and therefore have great influence on the business result of service providers. Thus, it is highly important to know and control these experiences. Decisions and actions are most effective if they are based on individual users and their detailed experience history. Currently available methods for measuring user experience fail in providing sufficient detail or continuous availability. This paper introduces a big data analytics method, which predicts every user’s satisfaction with the service provider. This is performed using an analytics algorithm, adding psychological interpretation to the measured and individually perceived user’s quality of experience. The result is a score that enables individualized marketing and allows understanding the cause of dissatisfaction. It is also able to assign a subjective quality score to network assets.

The Influence of Computer-Related Attributions on System Evaluation in Usability Testing

Abstract Computer-related attributions are cognitions related to the causes and effects of user interactions – or, in other words, subjective explanations of users of why specific system reactions occur. Prior research has revealed different attribution styles, which influence how users interact with computers and how they perceive situations of failure and success. In this paper, we report on a study investigating how computer-related attributions influence users’ perceptions and evaluations of interactive systems. To that end, we conducted usability tests with N = 74 $\mathrm{N}=74$ users and measured both system evaluations and attributions. Results show correlations between attributions and usability as well as user experience measures, indicating that users’ attributions do influence their evaluations of the test systems. Furthermore, gender differences were revealed. Practical and research implications are described.

Flow experience in game based learning – a systematic literature review

The entertaining elements implemented in a serious game are key factors in determining whether a player will be engaged in a play-learn process and able to achieve the desired learning outcomes. Thus, optimization of subjective playing experience is a crucial part of a game design process. Flow theory can be adopted for measuring user experience and analyzing the quality of serious game designs. In addition, flow seems to have a positive influence on performance enhancement, learning and engagement. The focus of this review is especially on examining the meaning of flow in the context of serious games as well as exploring the relationship between flow and learning, factors that influence occurrence of flow and how flow is operationalized. The review revealed that there are mainly conceptual considerations about flow in serious games, but no robust empirical evidence about the meaning of flow. This is in line with other studies. We argue that research on flow should focus on the specific aspects related to the very nature of serious games that combine enjoyment and learning. Furthermore, new methods to measure flow and analyse the data need to be developed and studied.

Measurement of User Emotion and Experience in Interaction with Space

Designer-oriented space design has been transferred to user-oriented space design that considers users′ emotions as well as the functions of the space, producing a multi-sensory space. Further, with the advent of embedded digital media and information technology in a space, various interface functions of the space have been developed and the user experience in the space has been much extended. This research investigated user experience and emotional aspects of a space′s design, which have been sparsely researched previously. Further, authors emphasize not only the emotion expression of the space, but also the interaction of people and space for the embodiment of the emotions from a wider perspective. Authors reviewed multidisciplinary literatures and compared various methodologies of measurement. Based on the understanding of the studies on the measurement of emotion, authors developed measures of emotion in interaction associated with spaces. The strength of the research is the focus on the integration of the space with technologies and user experiences from a new perspective in emotion research, rather than concentrating only on the architecture components of the buildings themselves. Through empirical studies, the measurements of emotion in architectural spaces can be verified and elaborated.