Good User Research Articles

Heuristic evaluation and usability testing of a functional dementia stages app for Hispanic family caregivers

AbstractBackgroundHispanic family caregivers of persons with Alzheimer’s disease and other dementias are not getting the anticipatory guidance they need about how functional abilities will change as dementia progresses. Existing informational resources are overwhelming to navigate and written at a high reading level. Furthermore, professional assessment of functional abilities is not universally available. Innovative, tailored approaches are needed. Our aim was to develop and test a mobile application, the Interactive Functional Assessment Staging Navigator (I‐FASTN), to support Hispanic family caregivers’ assessment of care recipients’ functional stage of dementia in either English or Spanish.MethodWe conducted heuristic evaluation with informatics experts (N = 5, English only) and usability testing with caregivers (n = 10 English, n = 10 Spanish). Participants attempted a series of tasks with the app using a think‐aloud protocol and then rate the usability of the app using mobile app heuristics (experts) and two usability instruments (caregivers). Sessions were recorded and transcribed. For heuristic evaluation, we tabulated the number of usability problems by category: cosmetic, minor, major, and catastrophic. For usability testing, recordings, notes, and transcripts were content analyzed to extract usability problems, suggestions for improvement, desired app features, and other feedback.ResultRefinements to the app were made after each of the five evaluations to address the problems encountered. Caregivers’ mean usability scores were high (4.6 and 4.7 out of 5.0), reflecting good usability overall. Chief usability problems were a confusing tutorial and difficulty finding the app’s side menu. These will be addressed by creating a video tutorial and moving all menu items to the home screen. The app was very well received by caregivers, who indicated that the concise, illustrated content met their informational needs. However, analog alternatives are still needed by caregivers unaccustomed to using apps as they had difficulty moving on from even the simplest screens (see Figure 1a).ConclusionCaregivers are not receiving informational support in a way that meets their needs. The focus should be on providing concise information that addresses the practical aspects of caregiving, tailored to the care recipient’s functional stage.

Development of Web-based School Uniforms order Application in a Private School with Prototyping Model

Strada SMK Daan Mogot, a private school in Tangerang City, oversees several operations. Student registration, academic exams, uniform measurements, and book purchases are carried out at the beginning of each school year. The Uniform Team tasked with handling this activity experienced difficulties due to the large volume of data, making conventional techniques inefficient to carry out. This research focuses on simplifying uniform ordering procedures from the uniform team to the uniform manufacturing supplier. The Uniform Team recorded and measured orders by hand, which resulted in time-consuming management and limited real-time data monitoring for the Principal. A web-based solution that allows easy access to uniform ordering data is needed to speed up these operations. The successful development and installation of this application at SMK Strada Daan Mogot is a significant achievement, with good User Acceptance Test results and confirming alignment with user needs. This progress is an essential step toward optimizing school operations.

FLAP: a framework for linking free-text addresses to the Ordnance Survey Unique Property Reference Number database

IntroductionLinking free-text addresses to unique identifiers in a structural address database [the Ordnance Survey unique property reference number (UPRN) in the United Kingdom (UK)] is a necessary step for downstream geospatial analysis in many digital health systems, e.g., for identification of care home residents, understanding housing transitions in later life, and informing decision making on geographical health and social care resource distribution. However, there is a lack of open-source tools for this task with performance validated in a test data set.MethodsIn this article, we propose a generalisable solution (A Framework for Linking free-text Addresses to Ordnance Survey UPRN database, FLAP) based on a machine learning–based matching classifier coupled with a fuzzy aligning algorithm for feature generation with better performance than existing tools. The framework is implemented in Python as an Open Source tool (available at Link). We tested the framework in a real-world scenario of linking individual’s (n=771,588) addresses recorded as free text in the Community Health Index (CHI) of National Health Service (NHS) Tayside and NHS Fife to the Unique Property Reference Number database (UPRN DB).ResultsWe achieved an adjusted matching accuracy of 0.992 in a test data set randomly sampled (n=3,876) from NHS Tayside and NHS Fife CHI addresses. FLAP showed robustness against input variations including typographical errors, alternative formats, and partially incorrect information. It has also improved usability compared to existing solutions allowing the use of a customised threshold of matching confidence and selection of top n candidate records. The use of machine learning also provides better adaptability of the tool to new data and enables continuous improvement.DiscussionIn conclusion, we have developed a framework, FLAP, for linking free-text UK addresses to the UPRN DB with good performance and usability in a real-world task.

Benchmarking usability of patient portals in Estonia, Finland, Norway, and Sweden

IntroductionPoor usability is a barrier to widespread adoption of electronic health records (EHR). Providing good usability is especially challenging in the health care context, as there is a wide variety of patient users. Usability benchmarking is an approach for improving usability by evaluating and comparing the strength and weaknesses of systems. The main purpose of this study is to benchmark usability of patient portals across countries. MethodsA mixed-methods survey approach was applied to benchmark the national patient portals offering patient access to EHR in Estonia, Finland, Norway, and Sweden. These Nordic countries have similar public healthcare systems, and they are pioneers in offering patients access to EHR for several years. In a survey of 29,334 patients, both patients’ quantitative ratings of usability and their qualitative descriptions of very positive and very negative peak experiences of portal use were collected. ResultsThe usability scores ranged from good to fair level of usability. The narratives of very positive and very negative experiences included the benefits of the patient portals and experienced usability issues. The regression analysis of results showed that very positive and negative experiences of patient portal use explain 19%-35% of the variation of usability scores in the four countries. The percentage of patients who reported very positive or very negative experiences in each country was unrelated to the usability scores across countries. ConclusionsThe survey approach could be used to evaluate usability with a wide variety of users and it supported learning from comparison across the countries. The combination of quantitative and qualitative data provided an approximation of the level of the perceived usability, and identified usability issues to be improved and useful features that patients appreciate. Further work is needed to improve the comparability of the varied samples across countries.

Implementation of RESHOT Method to Create a Good User Experience in an Application

In recent years User Experience (UX) has become something that must be implemented in making applications. Every application design practitioner has applied this discipline, but often they wonder how to simplify a user's journey flow by using applications and make it easier, faster, and simpler. This research aims to explain a method that can simplify the User Experience comprehensively. RESHOT is used (Refine the challenge, Remove, Shrink, Hide, Organize, Time). This method will make applications pay more attention to aspects that can increase user satisfaction. As a result, this study contributes to an explanation of simplifying the flow of uploading donor data files using the RESHOT method in the X blood donor data collection application. The results of streamlining the flow of uploading donor data files have been tested on five respondents and have a 100% user success rate in completing tasks with an average processing time of 14.5 seconds. In testing, there is a misclick rate of 10.7%. This is because the user wants to explore the designed application. And this is also a limitation of this study, namely not making the overall application design interaction.

Patients' Perception of Usability and Utility of a Digital Health Tool for Electronic Patient-Reported Outcomes Monitoring in Real-Life Hematology Practice: Evidence from the Gimema-Alliance Platform

Background Digital health tools are increasingly being used in oncology practice to better monitor patients' health status. They may include electronic-patient-reported outcome (ePRO) monitoring systems, with automated alerts triggered to the physician depending on specific conditions (e.g., when patients report clinically relevant problems). Although implementation of these tools in real-life practice may offer valuable benefits, it is important to assess their usability and utility from the users' standpoint. Objective The aim of this study was to evaluate the patients' perception of usability and utility of a digital health tool for ePRO monitoring of patients with hematologic malignancies in real-life practice. Methods In December 2020, the GIMEMA Group developed a digital health platform for adult patients with hematologic malignancies (GIMEMA-ALLIANCE platform) with the goal of facilitating patient-centered care. The platform was open to enrollment until December 2022 and involved 26 hospitals. After providing written informed consent, patients received a personal password to access the secure patient portal and complete ePRO questionnaires assessing health-related quality of life (HRQoL) and symptoms (EORTC QLQ-C30 and selected items from the EORTC Item Library). Real-time graphical presentation of PRO results is displayed for both patients and physicians. The platform allows hematologists to receive real-time alerts in the presence of clinically important problems and symptoms. For the purpose of this study, a dedicated section in the patient portal was developed to evaluate the usability and utility of the platform. In this section, patients had the possibility to complete the System Usability Scale (SUS). The SUS is a 10-item widely used questionnaire to evaluate users' perceived system satisfaction. Its score ranges from 0 to 100 and a score ≥70 is considered a threshold for an acceptable usability. Analyses were performed overall and by age group category, based on the median age of the patient population. Patients also completed an ad-hoc survey consisting of 6 items covering aspects on the utility of the platform, for example in favoring shared decision-making or improving the communication with the treating hematologist. Only patients who have completed the ePRO questionnaires at least twice, i.e. those who had the possibility to sufficiently test its functionalities, were considered eligible for completing the survey on usability and utility of the platform. Results Out of the 362 eligible patients, a total of 161 (44%) completed the survey. No difference in age and sex was found between patients who completed or not the survey. The median age of patients who completed the survey was 59 years (IQR: 51 - 67) and 53 (34%) were women. The most prevalent diagnosis was multiple myeloma (n=40, 25%). At the time of survey completion, 69% of the patients were receiving a treatment for their disease. The mean SUS score of the overall population was 80.8 (SD 15.5) and the majority of patients (n=131, 81%) gave a rating ≥70 (the prespecified threshold for the acceptable usability). The mean SUS score for the younger and the older groups was 80.5 (SD 14.9) and 81.4 (SD 16), respectively. Eighty-eight percent of patients agreed or strongly agreed that the platform was easy to use, 83% felt very confident in using the platform, and 72% found the various functionalities offered by the platform well integrated (Figure 1). Positive feedbacks on the utility of the platform were also collected. For example, 71% of patients considered the ePRO questionnaires useful for their health conditions and 63% would recommend its use to other patients. However, amongst the patients who had visits at the clinic (n=127), only 39% reported that their doctor discussed ePRO results with them, and this may explain the lower agreement for some items (Figure 2). For example, 38% of the patients strongly agreed/agreed that the platform helped them to improve the communication with their doctor, while 44% neither agreed or disagreed and 18% strongly disagreed/disagreed. Conclusion This study showed a good usability and utility of the GIMEMA-ALLIANCE platform from the patients' perspective, and this was true for younger and older patients. Future areas of improvement should include actions to facilitate physicians in discussing ePRO results during the clinical encounter with their patients.

3 Mobile Toolbox: Enrollment of a Large Normative Sample Using the UCSF Brain Health Registry

Objective:A critical need in the neuropsychology field is development and validation of efficient, scalable assessments of cognition. The Mobile Toolbox (MTB), a novel suite of mobile device-compatible, app-based cognitive assessments, was developed to address this need. The goals of this study were (1) To collect longitudinal normative data for the MTB assessments in a large, ethnoculturally and educationally diverse cohort; (2) To assess the feasibility and usability of remote assessment using MTB.Participants and Methods:Participants were recruited from the UCSF Brain Health Registry (BHR), an online cohort (N>100,000) that collects longitudinal cognitive, functional, behavioral, and health data using online neuropsychological tests and self- and study-partner report surveys. BHR participants who opted to learning about additional research opportunities were sent automated email invitations to enroll in the MTB study. Those who indicated study interest were provided instructions within the BHR online portal for downloading the MTB app. All participants had the opportunity to complete a single baseline administration of MTB (Word Meaning, Sequences, Spelling, Arranging Pictures, Arrow Matching, Faces and Names, Shape-Color Sorting, Number Match). Those who completed the baseline assessment within three days were invited to continue into the longitudinal study, where they complete MTB assessments at a single, short-term timepoint (day 7, 14, or 21; study arms sequentially assigned), and then at 6-month intervals. Enrollment across demographic groups was monitored, and study invitations were sent to specific demographic groups, with the goal of enrolling a sample of 800 participants in the longitudinal study: equal distribution across eight, 10-year age bands (ages 18-80+); 60% with <16 years of education; 10% non-Latinx Black, 15% Latinx, and 5% non-White other ethnocultural identity.Results:Between January-June 2022, 48,110 BHR participants were invited to the MTB study. Of those, 8294 (17%) expressed interest, 3401 (7%) completed the baseline assessment, 850 (1.8%) were assigned to the longitudinal study, and 782 (1.6%) completed a short-term longitudinal assessment. Study staff received 797 help tickets submitted by participants asking for email support to complete MTB. The baseline cohort had and average age of 64 years and an average of 16.6 years of education, 76.2% female, 2.1% non-Latinx Black, 7.1% Latinx, 86.8% non-Latinx White, and 4% from other ethnocultural groups. The longitudinal cohort had an average age of 62.3 years and an average of 16.1 years of education, 80% female, 2.8% non-Latinx Black, 8.5% Latinx, 83.5% non-Latinx White; and 5% other ethnocultural group. Compared to those invited to the study, those who enrolled in the longitudinal study were older, had higher educational attainment, and were more likely to be female and self-identify as non-Latinx White (p<0.05 for all).Conclusions:Efficient enrollment and task completion of a large cohort in a novel, app-based mobile cognitive assessment is feasible in a completely remote setting. Most participants were able to complete MTB without individual support, indicating good usability. This approach can be scaled up to efficiently assess cognition in many research and healthcare settings. A remaining challenge is achieving robust ethnocultural and educational diversity.

Pengembangan Platform Coffee Shop KURLEB dengan Fokus pada User Interface dan Prinsip UX Law

The increasing trend and public interest in coffee shops, also known as cafes. One of the cafes named Kopi KurangLebih has great potential to attract customers due to its strategic location, high-quality menu, and aesthetic ambiance. Although Kopi KurangLebih already has an Instagram account to showcase its content and engage with followers, the information provided is limited and lacks proper organization. Visitors to the coffee shop struggle to make menu choices due to the absence of a platform to display the available options. To address these challenges and improve the quality of service, a website is needed to document and present information that assists customers in making menu selections. The current reliance on social media as a source of information for coffee shops is inefficient and temporary, as the information shared only appears briefly on users' timelines. Hence, the development of an attractive and informative website for Kopi KurangLebih becomes necessary. The website should be designed according to user needs and the resources available to Kopi KurangLebih. By utilizing a digital information medium in the form of a website, potential customers can access and obtain information easily, thereby increasing their interest and purchasing power. The research also applies the Three Circles method and incorporates various UX Law principles into the user interface (UI) design. Through observations and analysis, the research identifies the values of Kopi KurangLebih, customer needs, and competitor values. This research successfully built a UI prototype of the KURLEB website, transforming it into an effective digital platform for promoting, storing, and providing information about Kopi KurangLebih. It also achieved a good user experience by providing relevant information, intuitive navigation, and appealing visual aesthetics. With a well-designed UI and the applied principles of UX Law, this website delivers a positive user experience, enhances customer engagement, and contributes to the sustainable marketing of Kopi KurangLebih as a local coffee shop brand.

Accuracy and Precision of Mandible Segmentation and Its Clinical Implications: Virtual Reality, Desktop Screen and Artificial Intelligence

Objective3D modeling is a major challenge in computer-assisted surgery (CAS). Manual segmentation, as the gold standard, is tedious, time consuming, and particularly challenging for the mandible, while artificial intelligence (AI)-based segmentation is a promising and time-saving alternative. However, little is known about the clinical implications of various segmentation methods. MethodIn this cross-over study, ten mandibles were segmented in virtual reality (VR), on a desktop screen (DS) by five experts and via five AI models. The exported mandible models were evaluated using metrics, a public reference (PUBDS), and blinded assessments by two radiologists. ResultsAverage segmentation-to-volume accuracy (1 = poor, 5 = perfect) was comparable for human segmentation (VR: 4.56; DS: 4.33; PUBDS: 4.55) and significant better than AI-based segmentation (AI: 3.80), while the average segmentation-to-segmentation accuracy revealed that DS (91.4 %/0.37 mm [Dice coefficient/average Hausdorff distance]) was more comparable to PUBDS than to VR (90.1 %/0.44 mm). The precision of VR (96.8 %/0.14 mm) and DS (96.6 %/0.15 mm) was superior to PUBDS (94.1 %/0.21 mm) and the AI method (89.2 %/0.60 mm). While VR was significantly faster than DS and PUBDS for the manual segmentation methods (p = 0.007/< 0.001), in contrast, the AI method is not time sensitive due to its possible hardware scalability. ConclusionAccuracy and precision of mandible segmentation depends primarily on CT quality and anatomical site, which should be considered in clinical applications and the generation of AI training data and could negatively impact CAS. Although current AI models have perfect intra-model reliability, they demonstrate higher inter-model variability and are accompanied by invalid outliers making human review still necessary. In summary, the use of VR in manual segmentation showed high accuracy and precision overall while saving time, making it the preferred method over DS due to its good usability.

Establishment of a prediction model for prehospital return of spontaneous circulation in out-of-hospital patients with cardiac arrest.

Out-of-hospital cardiac arrest (OHCA) is a leading cause of death worldwide. To explore factors influencing prehospital return of spontaneous circulation (P-ROSC) in patients with OHCA and develop a nomogram prediction model. Clinical data of patients with OHCA in Shenzhen, China, from January 2012 to December 2019 were retrospectively analyzed. Least absolute shrinkage and selection operator (LASSO) regression and multivariate logistic regression were applied to select the optimal factors predicting P-ROSC in patients with OHCA. A nomogram prediction model was established based on these influencing factors. Discrimination and calibration were assessed using receiver operating characteristic (ROC) and calibration curves. Decision curve analysis (DCA) was used to evaluate the model's clinical utility. Among the included 2685 patients with OHCA, the P-ROSC incidence was 5.8%. LASSO and multivariate logistic regression analyses showed that age, bystander cardiopulmonary resuscitation (CPR), initial rhythm, CPR duration, ventilation mode, and pathogenesis were independent factors influencing P-ROSC in these patients. The area under the ROC was 0.963. The calibration plot demonstrated that the predicted P-ROSC model was concordant with the actual P-ROSC. The good clinical usability of the prediction model was confirmed using DCA. The nomogram prediction model could effectively predict the probability of P-ROSC in patients with OHCA.

Evaluasi User Engagement dan User Experience pada Aplikasi Satu Sehat

Various efforts to prevent and trace the wider spread of the Covid-19 Virus have been carried out by the government. One of them is done with through technology by providing the application namely SatuSehat application which has variety of features aimed on helping the society. However, along with the imminent evolution of this application into SatuSehat application, these various features that exist, are still rarely known by the public. In addition, from previous studies, there are user experience evaluation has been carried out which shows that low evaluation results. Even though this application has been widely downloaded by the public. This study is aimed at re-measuring the user experience of SatuSehat application and is accompanied by user engagement evaluation to SatuSehat application and its relationship with the user experience. User experience evaluation will utilize the UEQ-S method while the user engagement evaluation will utilize the UEQ-SF method. The results showed that SatuSehat application has a positive overall user experience evaluation result which is supported by quite good user engagement evaluation results. The results of the study even show that there is a strong correlation between user engagement and user experience from the SatuSehat application.

Designing a User-Centered Inspection Device’s Handle for the Aircraft Manufacturing Industry

In aircraft manufacturing settings, workers are frequently exposed to biomechanical risk factors, mainly in the later stages of the production processes, including inspection tasks. To support the development of a novel inspection device appropriate for the end-users and their tasks, this study presents a user-centered approach for the device’s handle. Three different handles were proposed, and the current study aims to find out which handle can offer (1) the best ergonomic conditions and (2) the best stability in holding the device in hand during an inspection task. To this end, 23 volunteers participated in the experimental assessment, which comprised qualitative and quantitative data. A questionnaire was used for subjective comfort assessment. Partial times to execute the task studied, stability metrics of the device during its handling, and kinematic and electromyographic data of the upper limb recruited were measured and analyzed to compare the three handles. Outstanding results include the higher comfort perceived by the participants working with the selected handle for the final design, as well as the reduction in muscle effort. Globally, the results obtained demonstrated that the handle user-centered design potentiates good efficiency and usability of the novel device.

Virtual reality and augmented reality smartphone applications for upskilling care home workers in hand hygiene: a realist multi-site feasibility, usability, acceptability, and efficacy study.

To assess the feasibility and implementation, usability, acceptability and efficacy of virtual reality (VR), and augmented reality (AR) smartphone applications for upskilling care home workers in hand hygiene and to explore underlying learning mechanisms. Care homes in Northwest England were recruited. We took a mixed-methods and pre-test and post-test approach by analyzing uptake and completion rates of AR, immersive VR or non-immersive VR training, validated and bespoke questionnaires, observations, videos, and interviews. Quantitative data were analyzed descriptively. Qualitative data were analyzed using a combined inductive and deductive approach. Forty-eight care staff completed AR training (n = 19), immersive VR training (n = 21), or non-immersive VR training (n = 8). The immersive VR and AR training had good usability with System Usability Scale scores of 84.40 and 77.89 (of 100), respectively. They had high acceptability, with 95% of staff supporting further use. The non-immersive VR training had borderline poor usability, scoring 67.19 and only 63% would support further use. There was minimal improved knowledge, with an average of 6% increase to the knowledge questionnaire. Average hand hygiene technique scores increased from 4.77 (of 11) to 7.23 after the training. Repeated practice, task realism, feedback and reminding, and interactivity were important learning mechanisms triggered by AR/VR. Feasibility and implementation considerations included managerial support, physical space, providing support, screen size, lagging Internet, and fitting the headset. AR and immersive VR apps are feasible, usable, and acceptable for delivering training. Future work should explore whether they are more effective than previous training and ensure equity in training opportunities.

Multimodal Interaction Grammar Analysis Based on Two-Stage User-Based Elicitation in 3D Modeling

Traditional computer-aided design (CAD) tools based on keyboard and mouse interactions present challenges to efficiency and quality in terms of free creation, iteration efficiency, and operational experience. This paper proposes a multimodal interactive guiding grammar framework for virtual-reality modeling scenarios. In studies on the characteristics of multimodal combinations, the present heuristic method leads to a high cognitive load and experimental cost, and the heuristic is difficult. Therefore, we propose a two-stage heuristic method. Subsequently, we use this method to decompose the interaction task into two stages: modalities and interactive operations. A clearer and more specific reference for multimodal selection is provided for the interaction design phase, based on the two dimensions of modality and task. This can reduce the heuristic cost and difficulty of users in completing tasks in multimodal interaction scenarios. Finally, the proposed virtual modeling platform which is used for experimental verification, and the results shows that, compared with traditional modeling, the interactive modeling method built according to the results of modal interaction in this study can better satisfy users in terms of emotional experience. In the index evaluation, high scores are achieved, with an average score of 5 points (1 and 7 are the lowest and highest scores of the evaluation index, respectively), and the large-area distribution of high scores also shows a good user experience. To a certain extent, this method improves the interaction mode of the previous 3D modeling.

The Finnish versions of food allergy quality of life questionnaires including parent form 10.

Examining health-related quality of life (HRQoL) is important to improve patient care. In this study, we translate and evaluate the Finnish versions of the Food Allergy Specific Quality of Life Questionnaires (FAQLQs) from a Finnish perspective and undertake a detailed evaluation of the 10-question Parent Form Questionnaire (FAQLQ-PF10). This validation study was performed to evaluate the Finnish versions of the FAQLQs. Validation was performed by analysing clinical characteristics, factor loadings and Cronbach's α reliability estimates. The inclusion criteria for participants in this study were having a doctor-diagnosed food allergy or being a parent of a child with a doctor-diagnosed food allergy and being able to answer the questionnaire in Finnish. Altogether, 247 questionnaires were completed in this study. Most of the respondents had multiple food allergies (77%, 189/247). Spearman's correlations related to the 10-question parent form (FAQLQ-PF10), the 30-question parent form (FAQLQ-PF) and the Food Allergy Severity Measurement-Parent Form (FAIM-PF) were statistically significant (p value = 0.000-0.007). The reliability of the Finnish versions of the FAQLQs measured by Cronbach's α was overall good (0.75-0.981). The Finnish versions of the FAQLQs are reliable and suitable to use, and the FAQLQ-PF10 has good usability.

Evaluasi Usability Pada Aplikasi M-Pise LPD Digital Di Kabupaten Jembrana dengan Metode Usability Testing

This study aims to evaluate usability on the user's M-Pise LPD Digital application page in Jembrana Regency by using the usability testing method with Performance Measurement and RTA (Retrospective Think Aloud) techniques. The usability aspects reviewed are effectiveness, efficiency, and user satisfaction. In this study there were 20 respondents who were involved consisting of a group of advanced respondents and a group of novice respondents. The results showed that (1) the M-Pise LPD Digital application was still not effective when viewed from errors (errors) when the respondent was doing the task, (2) the M-Pise LPD Digital application in terms of efficiency has proven to be efficient seen from statistical testing Mann Whiteney showed that there was no difference in time between the beginner and advanced groups of respondents so that it could be said to be efficient, (3) User satisfaction was still unsatisfied as seen from the SUS questionnaire score of 64. Thus the M-Pise application page did not have good usability. Thus the recommendations for improvement given are based on the results of performance measurements, namely errors. Recommendations for improvement will focus on improving menu components and features. Meanwhile, based on the results of the problems and suggestions for the results of the RTA, namely simplification of features and improvements as well as clarity of the layout of letters, numbers and icons.

Development and usability testing of a fully immersive VR simulation for REBOA training

BackgroundResuscitative endovascular balloon occlusion of the aorta (REBOA) is a potentially life-saving procedure for bleeding trauma patients. Being a rare and complex procedure performed in extreme situations, repetitive training of REBOA teams is critical. Evidence-based guidelines on how to train REBOA are missing, although simulation-based training has been shown to be effective but can be costly and complex. We aimed to determine the feasibility and acceptance of REBOA training using a fully immersive virtual reality (VR) REBOA simulation, as well as assess the confidence in conducting the REBOA procedure before and after the training.MethodsProspective feasibility pilot study of prehospital emergency physicians and paramedics in Bern, Switzerland, from November 2020 until March 2021. Baseline characteristics of trainees, prior training and experience in REBOA and with VR, variables of media use (usability: system usability scale, immersion/presence: Slater-Usoh-Steed, workload: NASA-TLX, user satisfaction: USEQ) as well as confidence prior and after VR training were accessed.ResultsREBOA training in VR was found to be feasible without relevant VR-specific side-effects. Usability (SUS median 77.5, IQR 71.3–85) and sense of presence and immersion (Slater-Usoh-Steed median 4.8, IQR 3.8–5.5) were good, the workload without under-nor overstraining (NASA-TLX median 39, IQR 32.8–50.2) and user satisfaction high (USEQ median 26, IQR 23–29). Confidence of trainees in conducting REBOA increased significantly after training (p < 0.001).ConclusionsProcedural training of the REBOA procedure in immersive virtual reality is possible with a good acceptance and high usability. REBOA VR training can be an important part of a training curriculum, with the virtual reality-specific advantages of a time- and instructor-independent learning.

Brain Health Registry Study Partner Portal: Novel infrastructure for digital, dyadic data collection.

In Alzheimer's disease (AD) research, subjective reports of cognitive and functional decline from participant-study partner dyads is an efficient method of assessing cognitive impairment and clinical progression. Demographics and subjective cognitive/functional decline (Everyday Cognition Scale [ECog]) scores from dyads enrolled in the Brain Health Registry (BHR) Study Partner Portal were analyzed. Associations between dyad characteristics and both ECog scores and study engagement were investigated. A total of 10,494 BHR participants (mean age=66.9±12.16 standard deviations, 67.4% female) have enrolled study partners (mean age=64.3±14.3 standard deviations, 49.3% female), including 8987 dyads with a participant 55 years of age or older. Older and more educated study partners were more likely to complete tasks and return for follow-up. Twenty-five percent to 27% of older adult participants had self and study partner-report ECog scores indicating a possible cognitive impairment. The BHR Study Partner Portal is a unique digital tool for capturing dyadic data, with high impact applications in the clinical neuroscience and AD fields. Highlights The Brain Health Registry (BHR) Study Partner Portal is a novel, digital platform of>10,000 dyads. Collection of dyadic online subjective cognitive and functional data is feasible. The portal has good usability as evidenced by positive study partner feedback. The portal is a potential scalable strategy for cognitive impairment screening in older adults.

A Novel Three-minute Game-based Cognitive Risk Screening Tool-WeChat Mini-program-based Design and Large-sample Feasibility Studies

To develop a novel cognitive screening tool for older adults in China. "Game-based Cognitive Assessment-3 Minute Version"(G3) was designed and developed based on WeChat mini-program. And its feasibility was analyzed. G3 mini-program contains three one-minute mini digital games and supports users' self-assessment of cognitive functions with instant access to reports. G3 had a good correlation with Montreal Cognitive Assessment Basic (MoCA-B) with Pearson's r =0.611 (P<0.001). Among natural users aged 50 and older (71 179), the G3 initiation and completion rates were 99.55% and 92.28%, respectively. The average time to complete G3 assessments was (278.5±73.73) seconds. The novel G3 mini-program has good feasibility and usability for older Chinese adults, and can be used for cognitive screening and home self-assessment.

Development and validation of InfeQ game as active methodology to learn infectious diseases during medical graduation

Health education is always in movement, constant changing over the years and adjusting to new challenges, enabling new generations to learn. Through this journey, new methods were created. We recently crossed the biggest Covid-19 pandemic, which accelerated the processes and advances that unite education and technology. Problem-based learning, communication skills training, and simulation-based learning became part of new graduation curriculum. The aim of this study was to introduce a new method of learning in infectious diseases, using gamification. In this project, a mobile application with game components was developed, as an auxiliary teaching tool in infectious and parasitic diseases for medical school students. Residency test questions were selected and presented as: Sexually Transmitted Infections (N=30), General Infectious Diseases (N=101), Antimicrobials (N=33) and HIV/AIDS (N=30). During playing game evaluation, students answer a cycle of 10 objective questions, where correct answers and response speed for classification parameters, ranking, are measured. At the end, correct answers to the candidates are reached. Estimates were collected from 116 medical students (N=108) and infectious diseases' specialists (N=8), 35.4% of whom were male with a mean age of 25.8 years. Results showed that the application received a good usability evaluation, obtaining an average SUS score equal to 90.5. The mean CVI was 92.2. The game was registered by the National Institute of Industrial Property, under the title InfeQ®.