User Experience Evaluation Methods Research Articles

Research on User Interface Design and Interaction Experience: A Case Study from "Duolingo" Platform

INTRODUCTION: In today's information age, user interface design and interaction experience are crucial to the success of online platforms.OBJECTIVES: Through in-depth analysis of the user interface design features and user interaction experience of the "Duolingo" platform, this study reveals the potential correlation between them and proposes effective improvement methods to enhance user satisfaction and efficiency.METHODS: Interaction design principles were adopted to guide the improvement and optimization of the user interface. These principles include usability, consistency, and feedback to improve overall user satisfaction with the platform by actively considering user behavior and needs in the design. At the same time, specific mathematical models and equations are used to quantitatively analyze the efficiency and smoothness of the user interaction process, providing designers with more precise directions for improvement.RESULTS: Optimized user interface design and interaction experience can significantly improve user satisfaction and usage efficiency. Users operate the platform more smoothly, which provides useful reference and guidance for the design and development of e-learning platforms.CONCLUSION: Through in-depth analysis of the case of the "Duolingo" platform and the introduction of user experience evaluation methods and interaction design principles, this study has come up with a series of effective improvement measures and verified their effectiveness through experiments. It has certain theoretical and practical significance for improving the user experience of online learning platforms and promoting the design and development of Internet products.

Applying Kano’s two-factor theory to prioritize learning analytics dashboard features for learning technology designers

Existing methods for software requirements elicitation, five-point Likert scales and voting methods for requirements prioritization, and usability and user experience evaluation methods do not enable prioritizing the learning analytics dashboard requirements. Inspired by management and product design field, this research applies Kano’s two-factor theory to prioritize the features of learning analytics dashboards (LADs) of adaptive learning platform (ALP) called Rhapsode<sup>TM</sup> learner, based on students’ perceived usefulness to support designers’ decision-making. Comparing usability and user experience methods for evaluating LAD features, this paper contributes with the protocol and a case applying Kano method for evaluating the perceived importance of the dashboards in ALP. The paper applies Kano’s two-factor questionnaire on the 13 LADs features of Rhapsode<sup>TM</sup> learner. Responses from 17 students are collected using a questionnaire, which is used to showcase the strength of the two-factor theory through five tabular and graphical techniques. Through these five tabular and graphical techniques, we demonstrate the application and usefulness of the method as designers and management are often carried away by the possibilities of insights instead of actual usefulness. The results revealed a variation in the categorization of LADs depending on the technique employed. As the complexity of the techniques increases, additional factors that indicate data uncertainty are gradually incorporated, clearly highlighting the growing requirement for data. In the case of RhapsodeTM learner platform, results based on the students responses show that 11 of 13 LADs being excluded due to low significance level in categorization (technique 1) and low response rate.

Exploring the Long-Term User Experience of an Interactive Loading Screen Using UX Curve and QUIS

User experience can change with time, and achieving a positive long-term user experience is an important goal in a successful product design. The long-term user experience of the interactive loading screen in Honor of Kings was studied by using two evaluation methods, UX Curve and QUIS questionnaire. The experiment included valid responses from a total of 23 participants. The results show that an interactive human-computer interface can achieve a good long-term waiting experience. It is also necessary to make changes to the UI or functions of the interactive screen after a period of time to ensure a good user experience. A toolbox including the QUIS questionnaire and UX Curve was proven effective in measuring the temporal aspects of user experience of the computer interface. The findings obtained in the experiments help understand the long-term user experience of human-computer interfaces. They may also provide a reference for developing different long-term user experience evaluation methods in different product contexts.

User experience evaluation method of sports product based on genetic algorithm

User experience evaluation method of sports product based on genetic algorithm

User experience evaluation method of sports product based on genetic algorithm

User experience evaluation method of sports product based on genetic algorithm

The combination of user experience evaluation method in asessing the application of suicide risk idea identification

The global pandemic COVID-19 has led to extreme loss of human life worldwide. <span lang="EN-US">The pandemic has made a profound impact on the psyche of some people, and it has led to suicide. The need for confident handling of specific risk factors for suicide is needed. Therefore, to support Indonesian governments to control the increment of suicidal ideas for adolescents using a combination of unmoderated remote usability testing (URUT) and usability metric for user experience (UMUX)-Lite. Then we adopted the school-based mental health program to make a prototype mobile application using the risk factor for suicidal ideation (RFSI) instrument to identify suicidal ideas in adolescents. Participants’ characteristics included late adolescents aged 19-22 years, male and female. The results show that the time-based efficiency on the registered task obtained from the calculation is 0.025 goals/sec. In one second, participants could complete a 0.025 of the job; although all participants could complete all tasks well and quickly, they provided good satisfaction scores. Some design improvements are needed on the prototype by considering user input</span>.

The user experience in vernacular design and erudite design

This paper presents the results of a conclusion work on the specializationcourse in UX Design from Univille. It aims to investigate how the userexperience occurs when using vernacular products and erudite products. Themethodology is a case study, with a qualitative-quantitative and descriptiveapproach. This study analyzes and compares two different products, onefrom vernacular design and the other from erudite design, using the userexperience evaluation method called 'AttrakDiff' (HASSENZAHL et al., 2008).

Kullanıcı Deneyimi Değerlendirme Araştırmalarında Elektroensefalografi Kullanımının İncelenmesi

Nowadays, there is a growing interest in User Experience (UX) evaluation in Human-Computer Interaction (HCI) field to evaluate information systems. Meanwhile, the application of neuroscientific measurement tools in user experience studies is constantly increasing. Within the scope of this study, a systematic mapping is conducted on the use of electroencephalography (EEG), one of the neuroscientific measurement tools, in UX evaluation studies published between 2010-2020. 89 studies are gathered from Web of Science (WoS) database, Science Direct (Elsevier), IEEE Xplore Library, ACM Digital Library, according to the scope of the study, are examined. The aim of this study is to reveal the trends and the use of EEG with the other UX evaluation methods in UX evaluation research. According to the results of the study, the types of data collected by EEG for UX evaluation are emotion and attention, data is generally collected as single episodic experience. In addition, the support vector machine is used for the classification and event-related potential is used for the feature extraction of the EEG data.

User experience evaluation of intelligent sports bracelet based on multi-factor fusion

In order to overcome the problems of the traditional methods, such as the low accuracy of calculating the weight of evaluation factors, the high error rate of evaluation and the long output time of evaluation results, a user experience evaluation method based on multi-factor fusion was proposed. Building intelligent motion bracelet user experience evaluation system, determine various evaluation factors relative to the membership degree of evaluation factor set, to construct judgment matrix, get the weights of preliminary results, the weighting results are consistency check, get the final weight calculation results, and the multi-factor fusion method was used to construct intelligent motion bracelet user experience evaluation model, get the final user experience evaluation result. Experimental results show that the calculation accuracy of the weight of evaluation factors is more than 94%, the error rate of evaluation varies from 0 to 2%, and the average output time of evaluation results is 0.62 s.

Predicting Final User Satisfaction Using Momentary UX Data and Machine Learning Techniques

User experience (UX) evaluation investigates how people feel about using products or services and is considered an important factor in the design process. However, there is no comprehensive UX evaluation method for time-continuous situations during the use of products or services. Because user experience changes over time, it is difficult to discern the relationship between momentary UX and episodic or cumulative UX, which is related to final user satisfaction. This research aimed to predict final user satisfaction by using momentary UX data and machine learning techniques. The participants were 50 and 25 university students who were asked to evaluate a service (Experiment I) or a product (Experiment II), respectively, during usage by answering a satisfaction survey. Responses were used to draw a customized UX curve. Participants were also asked to complete a final satisfaction questionnaire about the product or service. Momentary UX data and participant satisfaction scores were used to build machine learning models, and the experimental results were compared with those obtained using seven built machine learning models. This study shows that participants’ momentary UX can be understood using a support vector machine (SVM) with a polynomial kernel and that momentary UX can be used to make more accurate predictions about final user satisfaction regarding product and service usage.

User Experience Factors for People with Autism Spectrum Disorder

Autism Spectrum Disorder (ASD) is a condition characterized by difficulties with social interaction and communication. Studies show that people with ASD tend to enjoy using technology, as it provides them with a safe and trustworthy environment. Evaluating User eXperience (UX) in people with disabilities has been a challenge that studies have addressed in recent times. Several studies have evaluated the usability and UX of systems designed for people with ASD using evaluation methods focused on end users without disabilities. In reviewing studies that evaluate systems designed for people with ASD, considering the characteristics of these users, we discovered a lack of particularized UX models. We present a proposal of nine UX factors for people with ASD based on two approaches: (1) the characteristics, affinities, and needs of people with ASD, and (2) design guidelines and/or recommendations provided in studies on technological systems for people with ASD and/or interventions with these users. The nine UX factors for people with ASD provide a theoretical basis from which to adapt and/or create UX evaluation instruments and methods and to generate recommendations and/or design guidelines that are adequate for this context.

Interactive Design in Enhancing User Experience in Museum

A museum can be a suitable context to experiment with a new interaction technique which guiding visitors and improving their experience for a successful learning environment also to enrich user experience. Mobile technology is used to enhance user experience in a cultural environment that offers more information than physically exposed technology. Therefore, the introduction of augmented reality (AR) that allow visitor to experience interaction in a way that increased knowledge, learning and give additional information with any artefact exhibitions they interact in the museum is applied in this project. The objectives of this research are to develop an interactive design in enhancing user experience in artefact display and evaluate user experience. ADDIE Model is applied as the methodology that consists of five phases which are analysis, design, development, implementation, and evaluation. Principles of Interactive Design is utilized in designing the mobile AR application and developed using Unity, Blender and Vuforia. User Experience evaluation method is conducted where findings shows that most respondents are satisfied, and usage of mobile AR has enhanced their experience through navigation during museum visit that also give a lot of new insight on historical artefact that being displayed.

User experience evaluation method based on online product reviews

Evaluating the quality of the user experience (UX) of existing products is important for new product development. Conventional UX evaluation methods, such as questionnaire, have the disadvantages of the great subjective influence of investigators and limited number of participants. Meanwhile, online product reviews on e-commerce platforms express user evaluations of product UX. Because the reviews objectively reflect the user opinions and contain a large amount of data, they have potential as an information source for UX evaluation. In this context, this study explores how to evaluate product UX through using online product reviews. A pilot study is conducted to define the key elements of a review. Then, a systematic method of product UX evaluation based on reviews is proposed. The method includes three parts: extraction of key elements, integration of key elements, and quantitative evaluation based on rough number. The effectiveness of the proposed method is demonstrated by a case study using reviews of a wireless vacuum cleaner. Based on the proposed method, designers can objectively evaluate the UX quality of existing products and obtain detailed suggestions for product improvement.

Are UX Evaluation Methods Providing the Same Big Picture?

The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important part of the software development process. Researchers have been carrying out studies by employing various methods to evaluate the UX of software products. Some studies reported varied and even contradictory results when applying different UX evaluation methods, making it difficult for practitioners to identify which results to rely upon. However, these works did not evaluate the developers’ perspectives and their impacts on the decision process. Moreover, such studies focused on one-shot evaluations, which cannot assess whether the methods provide the same big picture of the experience (i.e., deteriorating, improving, or stable). This paper presents a longitudinal study in which 68 students evaluated the UX of an online judge system by employing AttrakDiff, UEQ, and Sentence Completion methods at three moments along a semester. This study reveals contrasting results between the methods, which affected developers’ decisions and interpretations. With this work, we intend to draw the HCI community’s attention to the contrast between different UX evaluation methods and the impact of their outcomes in the software development process.

Research on user experience evaluation of man-machine interaction interface based on virtual reality technology

Due to the complexity of user experience evaluation information data of human-computer interaction interface, the traditional evaluation method has a single information channel, resulting in the low quality of human-computer interaction interface. This paper proposes a user experience evaluation method based on virtual reality technology. Using virtual reality technology to restore the quality of human-computer interaction interface, build the fuzzy analytic hierarchy process of samples, and obtain the corresponding membership function. According to the superposition of the membership degree, the membership degree evaluation matrix of the first level index is established, and the user experience evaluation of human-computer interaction interface based on virtual reality technology is completed. The simulation results show that the proposed method can effectively improve the operation efficiency and accuracy, and has good stability, and has good application value.

Research on UX Evaluation Model of Computer Input Devices (Keyboard and Mouse) Based on AHP

With the rapid development of the Internet, there are more and more computer input devices for different usage scenarios, and a lot of factors need to be considered comprehensively when users select computer input devices. At present, there are still some problems need to be solved in this field: how to evaluate the user experience of computer input devices in order to give reasonable suggestions to consumers when making purchasing decisions; how can design and development personnel find the shortcomings of design solutions in the design decision process? Aiming at the above problems, a user experience evaluation system for computer input devices is proposed.Firstly, based on the user experience 5E model proposed by Whitney Quesenbury, the user experience evaluation system of computer input device was constructed by using the questionnaire method, interview method, and expert opinion method. Then, the user experience evaluation model of computer input device was constructed by AHP.This paper takes computer input equipment as the research object and studies the user experience evaluation method of computer input device through the combination of qualitative and quantitative research methods. Established a more scientific user experience evaluation system to guide the design and development personnel in the design decision process. And provides reasonable suggestions for consumers to purchase and has certain reference value in the field of user experience evaluation research.

Understanding Users’ Experiences of Riding a Two-Wheeler Vehicle and their Intentions of Purchasing Electric Two-Wheelers

More than 13.7 million people in Taiwan are scooter users, which signifies the highest density of scooter users in the world. The aim of the present study is to use the user experience (UX) evaluation methods to investigate the factors that influence the users’ satisfaction, recommendation intention, and willingness to accommodate Electric two-wheelers (E2Ws). An online survey design has been used to recruit two-wheeler owners who live in Taiwan. The results of the hierarchical multiple regression analysis, based on a sample of 315 Taiwanese, indicate that the variables of satisfaction, positive emotions, and riding experience predicted whether users intended to recommend a two-wheeler. The results also reveal that external motivation is the core factor that influences a rider’s willingness to purchase an E2W. It highlights the importance of providing opportunities for people to experience the advantages of E2Ws and services. Having good hedonic and pragmatic experiences accumulated during two-wheeler usage may further positively influence the users’ satisfaction and intrinsic motivation. It is recommended that the government and the related industries consider the above issues when formulating related policies or developing E2W or battery technologies.

MÉTODO DE EVALUACIÓN DE LA EXPERIENCIA DEL USUARIO ADAPTADO Y APLICADO A USUARIOS CIEGOS PARA EVALUAR LA USABILIDAD DE SOFTWARE EN DISPOSITIVOS MÓVILES

Existing user experience (UX) evaluation methods focus on different aspects of software systems, such as usability, accessibility, usability, value, among others.

User experience: tool for Human-Computer Interaction (HCI) design

The changes in methodology and ideological implementation of User Experience (UX) and Human Computer Interaction (HCI) in the 21st century shift focus from traditional analogue process management to digital process management of organisations’ data and content. In instance of a university interactive web portal whereby institutions provide parties with access to data and information on the university portal. A focus shift from HCI design to UX design for improved peoples’ experience when navigating the institutions portal. A focus on understanding the relationship between UX and HCI as a phenomenon, considering the analogy of interactive organisation (institution, company, government) portal. Need for system developers to adopt UX evaluation, a methodology to ensure effective usability, accessibility and efficiency of a designed system. The nature of the study has its’ background in HCI. HCI relate to the mental (cognitive), technology and affective factors that influence the way people use computer for interaction in a computer-supported collaborative work/learn (CSCW/L) environment. The objective of this study is to ascertain at what point or put succinctly, what stage of system development does a system developer commits to user experience evaluation methods (UXEMs)?Keywords: Human Computer Interaction, User Experience, User Evaluation Method

The Merits of Situated Evaluation as an Alternative UX Evaluation Method to Understand Appropriation

Oftentimes, technologies are not used in the ways designers had initially envisioned. Instead, people adapt technologies to their own needs, a phenomenon called ‘appropriation’. Appropriation is an important aspect of User Experience design, related to the situatedness and dynamics of the design, recognizing not only that initial needs and requirements may change over time, but also that a design may change the environment that it was designed for. Appropriation can also contribute to a sense of ownership as people use a design in their own way, sometimes in ways the designer did not intend. However, commonly used User Experience evaluation methods often do not focus on the appropriation process of a technology. Situated Evaluation is an approach that does focus on appropriation, although it has not yet been used extensively in the UX field. In this paper, we therefore present and critically discuss our use of the Situated Evaluation approach for the evaluation of a specific tool that aims to enhance the communication between children, parents, and teaching staff in special education. By presenting this case, we hope to inform other UX researchers and designer about the potential of the approach to understand appropriation is an important factor in UX design.